Engineering
Inference got cheap, but not for the work that pays
LLM inference costs fell between 9 and 900 times a year depending on the task. The cheapest gains landed on easy work, while frontier reasoning barely moved.
#inference-cost
1 story tagged inference-cost.