Tag

#llm-benchmarks

1 story tagged llm-benchmarks.

Bar chart comparing GPT-6 Astra, GPT-5.6 Sol, and Claude Fable 5.1 across four benchmarks. Astra leads every category: Terminal-Bench Science 64.6% vs Sol 22.4% and Fable 52.6%, AutomationBench 41.4% vs 18.1% and 31.4%, BenchCAD 95.9% vs 83.3% and 84.3%, FrontierMath Tier 4 97.6% vs 83% and 87.8%.

GPT-6 Astra benchmarks are strong, but watch the caveats

GPT-6 Astra is OpenAI's latest flagship model. It scores 98.6% on ARC-AGI-3 and tops most benchmarks, but costs 2.5x Sol and splits evaluators on real gains.

Lars Cornelissen · Sep 4, 2026