Tag

#instruction-following

1 story tagged instruction-following.

Area chart showing per-constraint pass rate declining from 72.0% at one constraint to 29.4% at twelve constraints, following the multiplicative model 72.0% times 0.922 to the k-1, illustrating LLM instruction following degradation across 15 models in the CSE benchmark.

LLM instruction following collapses past 6 constraints

LLM instruction following breaks past 5 to 6 simultaneous constraints. Per-constraint pass rates decay at 72% times 0.922 per step, probe success below 2% by k=9.

Lars Cornelissen · Aug 15, 2026