AI staff 'genuinely frightened' for humanity's future, ex-Anthropic researcher tells BBC

25 days ago by Return_of_Chippy to c/technology

It comes as the AI firm's boss has called for the technology's development to be slowed down, citing "serious" risks.

I'm not an AI techie and I'm not well educated on LLMs/AI in general. The issue I'm having is the dichotomy between how people talk about it. I've heard completely opposite ends of the spectrum. From AI is quickly becoming advanced enough to threaten human society, all the way to its a glorified dictionary/search engine that can't really do much of anything. I know Lemmy has a steep anti-AI slant. But, can someone talk about this in a way I can wrap my head around why the divide seems so big?

load all comments
laniaeia 7 points 24 days ago

@Return_of_Chippy@lemmy.world I think the answer is somewhere in the middle probably. The issue from what I've read seems to come from humans giving AI too much control and it having misaligned goals. See AI alignment on this, there is a lot of research literature on it, I can't say I am familiar with most of it but I do know the basic gist of what it is about.

There is also risk of it being used with bad intentions, we see that with AI systems used in war, and also the pollution and general societal impact. It is also a powerful tool in the hands of an autocratic leader. This for me personally is what worries me the most.

Also should note that "AI" as technology is very wide, LLMs are just one type of it. It "AI" as in more generally machine learning is a very powerful method that has a lot of uses in scientific research. Crucially, I should also mention that I do dislike the term "AI" little bit since it creates and association with the fictional sentient artificial intelligence which it is not. It's not even clear whether it can ever be sentient, but that is a different and very hard question.

While I do think there is a motive for large AI companies to boast that their AIs are escaping and dangerous to make it seem more legitimate, I also think this is not the whole story. If it was just overglorification of a faulty technology, we wouldn't have all the real advancements in say scientific research that AI has brought. At the same time however, the front of AI they are trying to push to like average consumer is very sloppy.

Also, the topic is complex imo, can't say I have some authoritative account of it. Also also, I am quite disconnected from the discourse online since it sucks ass.

path: 0 25920061, hotness: undefined, score: 7, children: 2
TronBronson 3 points 24 days ago

The nuanced take way down at the bottom as usual.

path: 0 25920061 25922559, hotness: undefined, score: 3, children: 0
Return_of_Chippy 3 points 24 days ago

Thats all good info, thanks for taking the time to type it out for me.

path: 0 25920061 25920306, hotness: undefined, score: 3, children: 0
technology
technology

@lemmy.world

login for more options
88764
22234
14582

This is a most excellent place for technology news and articles.

Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


go to feed...