Generative AI Is an Engineering Disaster. A shockingly inefficient trillion-dollar project.

a month ago by Some_Emo_Chick to c/technology

load all comments
eicker 74 points a month ago

We are repeating an old pattern in computing: throw more hardware at the problem until efficiency becomes impossible to ignore. Bigger models have delivered remarkable gains, but they’re increasingly expensive. The next breakthroughs may come less from adding parameters and more from smarter architectures, better algorithms and more efficient inference.

path: 0 24785681, hotness: undefined, score: 74, children: 8
Vlyn 47 points a month ago

DeepSeek has really led the way here, especially as they are a bit more hardware constrained. Plus they openly publish their findings and release open source models, so high hopes there.

It's probably China's play to pop the AI bubble, but I'm all for it (:

path: 0 24785681 24786608, hotness: undefined, score: 47, children: 5
ScoffingLizard -4 points a month ago

I wonder what all is in the deepseek code that is malicious. I'd like to try it but don't want a million Mb/s of tracker shit across my network and can't run it myself.

path: 0 24785681 24786608 24797417, hotness: undefined, score: -4, children: 4
Rothe 20 points a month ago

Except there likely won't be a lot of further breakthroughs if we burn down our planet faster than we already do.

This is all an expenditure of vast amounts of energy for literally no gain for anybody except a handful of billionaires and their corporations.

path: 0 24785681 24792133, hotness: undefined, score: 20, children: 0
JustDorky 3 points a month ago

That's literally exactly what Chinese researchers are doing at DeepSeek and they've built frontier models with that philosophy

path: 0 24785681 24799490, hotness: undefined, score: 3, children: 0
technology
technology

@lemmy.world

login for more options
87401
21271
15822

This is a most excellent place for technology news and articles.

Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


go to feed...