#benchmarks
4 posts tagged with "benchmarks".
-
Computer-Use Agents Crossed Human Parity. They Still Click Too Much.
• 6 min readFrontier models now beat the human baseline on OSWorld-Verified — but the benchmark just got rebuilt, and the architecture quietly shifted off pixels.
-
Your Agent's Benchmark Score Is an Experiment, Not a Fact
• 6 min readRecent work shows a single agent leaderboard number is wrong three independent ways: it's noisy, it's overfit, and the judge measuring it is unreliable.
-
The Skill Supply Chain Got Poisoned Before It Got Secured
• 5 min readAgent skills are an executable supply chain that runs with your agent's full privileges — and the first wave of benchmarks shows our defenses see only half the attacks.
-
The Agent Benchmark Reckoning of May 2026
• 6 min readSTATE-Bench, DeepSWE, Agent Island, SWE-bench Live: a wave of new evals exposes how much the old leaderboards were inflating.