Once you get into things with useful generation and large context windows, or things like video generation, suddenly you need one or more $10,000+ pieces of hardware to run it.
A Blackwell server with 72 GPUs costs about $3 million, plus requires 130 kW of power (about 3 residential homes’ max rated power through a residential 200A circuit box, for about $600-$1000/day in electricity cost).
You’re gonna need to sell a lot of $20/month subscriptions to get that paid for, assuming that the server is good for 5 years. If it’s only good for 3 years, the economics are basically impossible.
… assuming that the server is good for 5 years. If it’s only good for 3 years, the economics are basically impossible.
And surely the big AI companies wouldn’t decide that hardware rated for ~3 years should be amortized over 5-6 years in order to massively inflate their value on paper.
A Blackwell server with 72 GPUs costs about $3 million, plus requires 130 kW of power (about 3 residential homes’ max rated power through a residential 200A circuit box, for about $600-$1000/day in electricity cost).
You’re gonna need to sell a lot of $20/month subscriptions to get that paid for, assuming that the server is good for 5 years. If it’s only good for 3 years, the economics are basically impossible.
And surely the big AI companies wouldn’t decide that hardware rated for ~3 years should be amortized over 5-6 years in order to massively inflate their value on paper.
Surely.