There is evidence that some training runs at bigger companies are hilariously inefficient, or even that they run busywork to meet contract quotas. And that’s not to speak of the questionable efficiency of US “frontier models.”
And I’ve seen some staggering inefficiency even just deploying stuff, like “running Ollama on an H100 box” levels of ignorance. It boggles my mind. The heck are they even paying their employees for?
I’d be more interested in efficiency under load.
There is evidence that some training runs at bigger companies are hilariously inefficient, or even that they run busywork to meet contract quotas. And that’s not to speak of the questionable efficiency of US “frontier models.”
And I’ve seen some staggering inefficiency even just deploying stuff, like “running Ollama on an H100 box” levels of ignorance. It boggles my mind. The heck are they even paying their employees for?
liability sponge