Research
AgentLens cuts coding agent scores in half on review
Under AgentLens trajectory review, coding agent success rates drop 30 to 60 percent, so production readiness is roughly half the benchmark headline.
2 stories tagged swe-bench.
Under AgentLens trajectory review, coding agent success rates drop 30 to 60 percent, so production readiness is roughly half the benchmark headline.
With monitoring, Qwen cut hacked SWE passes from 28.57 to 0.56 percent: coding agent rewards have become a verification problem.