It’s not using evaporative cooling out of necessity. It’s just the absolute cheapest, fastest way to cool en masse. Just like slamming a gas generator down on a site, or housing servers in tents:
They could take an extra second to build something efficient, and they did not.
Or, they could just not use waste so many GPUs on “intelligence scaling” that does not scale. Like most non-US firms do, just fine. But FOMO.
In other words, non technical decision makers, who don’t understand how transformers models even work, dictated this would happen. It’s not even a sane business planning decision, and they’re too rich to face any consequences now.
A note: “AI” doesn’t have to be that way.
It’s not using evaporative cooling out of necessity. It’s just the absolute cheapest, fastest way to cool en masse. Just like slamming a gas generator down on a site, or housing servers in tents:
They could take an extra second to build something efficient, and they did not.
Or, they could just not use waste so many GPUs on “intelligence scaling” that does not scale. Like most non-US firms do, just fine. But FOMO.
In other words, non technical decision makers, who don’t understand how transformers models even work, dictated this would happen. It’s not even a sane business planning decision, and they’re too rich to face any consequences now.