Engineering
Your agents are working too hard
AI agents are not yet mainstream, and the developers who use them report personal speed but little team-wide gain. The fix is teaching agents when to stop.
Engineering
5 stories on engineering from the Data Today newsroom.
Engineering
AI chips give 24x more per dollar, if you can afford the sticker
AI chip performance per dollar improves about 37 percent a year, yet each new flagship costs more upfront. The GB300 delivers 24 times the value of a P100 at nine times the price.
Engineering
Context windows grew 30x a year. Your retrieval stack noticed
LLM context windows have expanded about 30 times a year since 2023, from a few thousand tokens to over a million. The change quietly rewrites how RAG systems should be built.
Engineering
The world's AI compute now doubles every seven months
The installed stock of AI chips is growing 3.4 times a year, doubling every seven months. The capacity question has quietly shifted from chips to power and buildings.
Engineering
Inference got cheap, but not for the work that pays
LLM inference costs fell between 9 and 900 times a year depending on the task. The cheapest gains landed on easy work, while frontier reasoning barely moved.