AI
SOP-Bench: AI agents hit 25% on hardest business SOPs
SOP-Bench tests AI agents on 2,000+ real business SOPs across 12 domains. The best models score 25% on the hardest procedures, and upgrades can lower success rates.
3 stories tagged amazon.
SOP-Bench tests AI agents on 2,000+ real business SOPs across 12 domains. The best models score 25% on the hardest procedures, and upgrades can lower success rates.
Amazon's 7.65-gigawatt off-grid gas plant in Texas, permitted to emit 33 million tons of CO2 per year for AI data center power, is twice the output of the worst US coal plant.
Amazon made the largest donation to the Lean FRO to make formal verification practical for AI agent safety. Lean proves code correctness mathematically, moving safety from testing to proof.