Tag

#open-models

2 stories tagged open-models.

WorkBench agents outcomes showing GPT-4 at 43 percent correct and 26 percent harmful actions, Claude Opus 4.8 at 89 percent correct and 2.5 percent harmful, and the WorkBench repo reporting Claude Fable 5 at 92 percent correct and 1.9 percent harmful.

WorkBench agents close the workplace reliability gap

WorkBench agents now solve 89 percent of workplace tasks with 2.5 percent harmful actions, changing the risk math for builders.

Lars Cornelissen · Jun 15, 2026

olmo-eval context chart showing MMLU scoring gaps from OLMES: Llama3 70B at 79.8 versus 60.7, Mistral 7B at 64.0 versus 50.3, OLMo 7B 0424 at 54.4 versus 42.4, and OLMo 7B at 28.3 versus 40.5.

olmo-eval brings statistical discipline to LLM loops

olmo-eval is an open workbench for iterative LLM evaluation. It makes tiny checkpoint gains harder to mistake for progress.

Lars Cornelissen · Jun 13, 2026