infrastructure
Everyone wants cheap inference. Nobody wants cheap drama.
Chip shortages, power constraints, and giant customer expectations continue their long marriage of convenience.
Why it matters
Infrastructure cost and supply are still the hidden plot behind the public model race.
Dave saysThe infrastructure story is the real plot. Everything else is just the trailer with nicer lighting.
Cory saysWe built a trillion-dollar future and then discovered it runs on extension cords and investor optimism.
Facts worth keeping
- Inference economics are shaped by model size, batching, latency targets, and hardware availability.
- Power and data-center constraints can matter as much as chips.
- Many product claims hide the infrastructure tradeoffs behind them.
Sources
- Ars Technica AI — Infrastructure coverage
- MIT Technology Review AI — Industry analysis