The problem is, there is no plan in the US to upgrade the power grid - either at privaty company level, state level or federal level. It's just not in the cards. And the grid is headed straight for a complete collapse with the double whammy of electric cars and AI.
The other problem is, if you keep using coal to meet electrical demands, this will certainly make zero dent on carbon emissions. The other thing that needs to happen besides upgrading the grid is a massive increase in combined renewables / battery storage solution, or of course viable fusion power (fat chance...)
This is focusing on the wrong thing. Electricity demands should be expected to drastically increase, with or without llms or other such programs. We need to be focusing on electrifying pretty much everything if we’re going to make a dent on carbon emissions, which will naturally lead to a significant increase in power demands. If that only leads to different and/or more carbon emissions, that’s a problem with the infrastructure of the grid, not what it’s powering.
And to be clear, I think these companies using stupid amounts of power to run these things is stupid as hell, but blaming them for problems that should have been addressed ages ago isn’t going to solve the problem. We need massive and sweeping infrastructure changes asap.
save