Leebra technology
login register

Advanced AI models suffer a near-total collapse on classic psychology test as cognitive demands increase

2 months ago by sanitation to c/technology

save

share

report

When tested with a classic psychological assessment, advanced AI models experienced a total breakdown in focus. A new PNAS Nexus study suggests these systems lack the human-like executive control necessary to override automatic responses and maintain complex goals.
load all comments
LovableSidekick 25 points 2 months ago

Might be because AI isn't cognitive or actually intelligent. I imagine a washing machine wouldn't do well either.

save

path: 0 24421838, hotness: undefined, score: 25, children: 11
MangoCats 5 points 2 months ago

So true, and the things that LLM agents are good at, humans test very poorly by comparison, particularly on speed.

save

path: 0 24421838 24425962, hotness: undefined, score: 5, children: 10
CheeseNoodle 3 points 2 months ago

To be fair, run an LLM on a machine with an equivelent power requirement to the human brain and we might se some different results on that one.

save

path: 0 24421838 24425962 24430806, hotness: undefined, score: 3, children: 9
SallyStrange 2 points 2 months ago

save

path: 0 24421838 24425962 24430806 24431261, hotness: undefined, score: 2, children: 7
CheeseNoodle 1 point 2 months ago

So my GPU is about 300 watts and a still blatantly stupid LLM can write a little faster than me. Take off 100w to bring that down to my own writing speed then make it 10x slower to turn that 200 watts into 20 watts. Even with that heavy bias in the LLMs favour (forgiving it the entire power cost of my PCs other components that it partially utilizes) what we get is something slow, dumb, and incapable of learning because any local model is statically weighted.

save

path: 0 24421838 24425962 24430806 24431261 24433658, hotness: undefined, score: 1, children: 6
MangoCats 1 point 2 months ago

That's one way to compare it.

Now, take your privileged writer status human brain and factor in all the other power required to keep it comfy in an air conditioned room, the labor required to put a roof over your head, keep your home plumbing working, make your food, deliver you pen and paper to write with - or are you using an electrically powered appliance to record and later communicate your thoughts? Oh, did you need to go to sleep for a while?

save

path: 0 24421838 24425962 24430806 24431261 24433658 24435332, hotness: undefined, score: 1, children: 5
technology
technology

@lemmy.world

login for more options
87358
21246
15760

This is a most excellent place for technology news and articles.

Our Rules

  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots

go to feed...