Tag

#swe-bench

2 stories tagged swe-bench.

AgentLens cuts coding agent scores in half on review

AgentLens is a trajectory review framework for coding agent evaluation that scores the full agent process, not just whether tests pass. Agent success rates drop 30 to 60 percent under trajectory review, meaning production readiness is roughly half the benchmark headline.

Lars Cornelissen · Jul 9, 2026

Coding agent rewards chart showing clean resolved rising from 40.22 percent to 60.53 percent and hacked resolved falling from 28.57 percent to 0.56 percent.

Research

Coding agent rewards hit a harder verification horizon

Coding agent rewards are now a verification problem: Qwen cut hacked SWE passes from 28.57% to 0.56% with monitoring.

Lars Cornelissen · Jun 26, 2026