Engineering
How to shrink a Docker image without breaking it
Reduce Docker image size by choosing slim bases and multi-stage builds. A 2.54 GB image can drop under 200 MB, cutting pull time and storage cost tenfold.
#deployment
7 stories tagged deployment.
Business
The gigawatt build-out is the real AI race now
The largest AI data center already rivals 700,000 H100 chips, and a 5-million-equivalent campus is due by 2027. Power and concrete, not chips, set the new pace.
Data
Open-weight models closed the gap to 1.7 points
Open-weight models went from a budget compromise to a default choice. On some benchmarks the gap to the best closed models shrank from 8 points to 1.7 in a year.
AI
Last year's frontier model now runs on a laptop
Frontier AI capability reaches consumer hardware in about eight months. The shrinking gap turns today's hosted-only features into tomorrow's on-device default.
Engineering
Context windows grew 30x a year. Your retrieval stack noticed
LLM context windows have expanded about 30 times a year since 2023, from a few thousand tokens to over a million. The change quietly rewrites how RAG systems should be built.
Engineering
The world's AI compute now doubles every seven months
Doubling every seven months, the installed stock of AI chips grows 3.4 times a year, and the bottleneck has shifted to power and buildings.
Engineering
Inference got cheap, but not for the work that pays
LLM inference costs fell between 9 and 900 times a year depending on the task. The cheapest gains landed on easy work, while frontier reasoning barely moved.