Coasty

Coasty, a Y Combinator-backed company, operates evaluation infrastructure for AI agents that perform computer-use tasks, running coarena.ai, the open leaderboard for computer-use agents, and developing its own production-grade computer-use models trained on the same infrastructure used to grade competitors. An open leaderboard arena provides live, blind matchups comparing agents across real tasks with transparent outcome-based ranking, real-world environments offer full Windows and Linux desktops with production applications and deterministic snapshots, and outcome-based grading measures actual task completion rather than subjective metrics with full run traces for debugging. Private evaluation suites keep contamination-free task benchmarks confidential unless owners choose to publish, and custom benchmarking authors tasks from client workflows with outcome graders and human verification.