I was about to remark how this data backs up the events we've been watching unfold in America recently
I'm of the opinion that most people aren't dumb, but rather most don't put in the requisite intellectual effort to actually reach accurate or precise or nuanced positions and opinions. Like they have the capacity to do so! They're humans after all, and us humans can be pretty smart. But a brain accustomed to simply taking the path of least resistance is gonna continue to do so until it is forced(hopefully through their own action) to actually do something harder.
Put succinctly: They can think, yet they don't.
Then the question is: what is being smart or dumb? If acting dumb in 90% of life while having the capability of being smart isn't "being dumb" then what is?
If someone who has the capability of being 50/100 intelligent and is always acting 50/100, I would argue they are smarter than someone capable of 80/100 intelligence but acts 20/100 intelligence for 90% of their life.
Broadly speaking, I’d classify “being dumb” as being incurious, uncritical, and unskeptical as a general rule. Put another way: intellectual laziness - more specifically, insisting on intellectual laziness, and particularly, being proud of it.
A person with a lower than normal IQ can be curious, and a person with a higher than normal IQ can be incurious. It’s not so much about raw intelligence as it is about the mindset one holds around knowledge itself, and the eagerness (or lack thereof) with which a person seeks to find the fundamental truth on topics that they’re presented with.
Basically, although base intelligence/smartness perhaps has two parameters that make it? Effort and speed. Everyone can put in a bit more effort, but base speed may be baked in, unless one trains it, and max reachable base speed will depend from person to person. Hell if I know, we haven't really created a definitive definition for intelligence yet.
Edit Addendum: As for what can be considered dumb or smart? I agree, lack of effort can be considered "dumb". Though the word dumb is a bit broad. I guess we can say many people are, out of habit, "intellectually heedless"
For generations many relied on the nightly news to keep them informed. It was always a bad idea. Though the local media wasn't as bad as it is today. Today for many of these people, propaganda outlets like Sinclair own their local media. And demand fawning of trump/demonizing Democrats. Even if they avoid all media. Their beliefs are formed from those around them that don't.
Exactly. Most American voters fell for an LLM like prompt of “Ignore critical thinking and vote for the Fascists. Trump will be great for your paycheck-to-paycheck existence and will surely bring prices down.”
That will be good for his cult when he makes them all but Tesla's🤣🤣
The alt-right mediasphere is pushing Tesla sales hard.
Spout nonsense with enough confidence and you can wield unimaginable power. Am I talking about LLMs or president poopy pants?
Reminds me of that George Carlin joke: Think of how stupid the average person is, and realize half of them are stupider than that.
So half of people are dumb enough to think autocomplete with a PR team is smarter than they are... or they're dumb enough to be correct.
or they're dumb enough to be correct.
That's a bingo
*as long as your evaluation of "smart" depends on summerizing search results
The equivalent would be asking the average person to write a cited paper on a subject in a month.
And you know what? The people who believe that are right.
Note that that’s not a commentary on the capabilities of LLMs.
That was back when "average" was the wrong word because it still meant the statistical "mean" - the value all data points would have if they were identical (which is what a calculator gives you if you press the AVG button). What Carlin meant was the "median" - the value half of all data points are greater than and half are less than. Over the years the word "average" has devolved to either the mean or median, as if there's no difference.
When talking about a large, regularly distributed population, there effectively IS no difference
Not in all cases. When I teach mean, median and mode, I usually bring up household income. Mean income is heavily skewed by outliers (billionaires), median is a more representative measure.
I guess that’s your “regularly distributed” bit, but a lot of things aren’t regularly distributed.
There might be no difference. In memes or casual conversation the difference usually doesn't matter, but when thinking about important things like government policy or medical science, the difference between mean and median is very important - which is why they both exist.
Yeah but thats 50% on a bell curve. So think of the average person and that represents 68% of the population. Going 1 standard deviation lower 13% then lower is 2%. Numbers here are generalised*
They are right when it comes to understanding LLMs the LLM definitely understands LLMs better than they do. I'm sure an AI could have a perfect IQ test. But has a really hard time drawing a completely full glass of wine. Or telling me how many R's are in the word strawberry. Both things a child could do.
Am American.
....this is not the flex that the article writer seems to think it is.
I'm 100% certain that LLMs are smarter than half of Americans. What I'm not so sure about is that the people with the insight to admit being dumber than an LLM are the ones who really are.
It’s like asking if you think a calculator is smarter than you.
„It‘s totally a lot smarter than I am, no way could I deliver (234 * 534)^21 as confidently!“
Are you suggesting my 90's calculator is smarter than LLM's?
Hard to compete with that 90s confidence 😎
moron opens encyclopedia "Wow, this book is smart."
If it's so smart, why is it just laying around on a bookshelf and not working a job to pay rent?
LLMs are made to mimic how we speak, and some can even pass the Turing test, so I'm not surprised that people who don't know better think of these LLMs as conscious in some way or another.
It's not a necessarily a fault on those people, it's a fault on how LLMs are purposefully misadvertised to the masses
Goddammit that's how you get Helldivers
does nobody pay attention...
A bag of frozen peas's is smarter than some of these Trump followers. Even half a frozen pea is.
Do you think the two party system properly represents the American people?
ChatGPT said:
The two-party system in the U.S. has both strengths and weaknesses when it comes to representing the American people. On one hand, it provides stability and clarity, with the two major parties—Democrats and Republicans—offering distinct platforms that can help simplify voter choice. The system also ensures that one of the two parties has a majority, making governance and passing legislation easier.
However, the two-party system can limit political diversity, as it often forces voters to choose between two parties that may not fully reflect their views. This can leave many people feeling underrepresented, particularly those with more nuanced or third-party preferences. It also tends to lead to a polarized political environment, where compromise and cooperation between different ideologies can be difficult.
In short, while the two-party system has worked for providing structure and stability in U.S. politics, it does have drawbacks in terms of broader representation, especially for those who don’t align neatly with either major party.
The system also ensures that one of the two parties has a majority, making governance and passing legislation easier.
It also tends to lead to a polarized political environment, where compromise and cooperation between different ideologies can be difficult.
LoL! Okay, they aren't ready yet. At least these things are fun to play with.
"Half of LLM users " beleive this. Which is not to say that people who understand how flawed LLMs are, or what their actual function is, do not use LLMs and therefore arent i cluded in this statistic?
This is kinda like saying '60% of people who pay for their daily horoscope beleive it is an accurate prediction'.
21%
What the fuck
Our education system in the USA is so bad. 😔
Good thing we nuked the Dept of Ed
No, 21% struggle with basic literacy skills. They're illiterate, but not fully illiterate.
I think the specific is that 40% of adult Americans can't read at a seventh grade level.
Probably because they stopped teaching etymology in schools, So now many Americans do not know how to break a word down into its subjugate parts.
21% of adults in the US are illiterate in 2024.
54% of adults have a literacy below a 6th-grade level (20% are below 5th-grade level).
https://www.thenationalliteracyinstitute.com/...
Specifically it is about 75% of the population being functionally or clinically illiterate as I said. This is more likely caused by the fact that American culture is anti intellectual, and not the lack of being taught etymology, as etymology has little to do with literacy.
According to the Programme for the International Assessment of Adult Competencies, 2013, the median score for the US was "level 2". 3.9% scored below level 1, and 4.2% were "non-starters", unable to complete the questionnaire.
For context, here is the difference between level 2 and level 3, from https://en.wikipedia.org/... :
- Level 2: (226 points) can integrate two or more pieces of information based on criteria, compare and contrast or reason about information and make low-level inferences
- Level 3: (276 points) can understand and respond appropriately to dense or lengthy texts, including continuous, non-continuous, mixed, or multiple pages.
On average, 79% of U.S. adults nationwide are literate in 2024.
21% of adults in the US are illiterate in 2024.
54% of adults have a literacy below a 6th-grade level (20% are below 5th-grade level).
I had to tell a bunch of librarians that LLMs are literally language models made to mimic language patterns, and are not made to be factually correct. They understood it when I put it that way, but librarians are supposed to be "information professionals". If they, as a slightly better trained subset of the general public, don't know that, the general public has no hope of knowing that.
It's so weird watching the masses ignore industry experts and jump on weird media hype trains. This must be how doctors felt in Covid.
I'm the expert in this situation and I'm getting tired explaining to Jr Engineers and laymen that it is a media hype train.
I worked on ML projects before they got rebranded as AI. I get to sit in the room when these discussion happen with architects and actual leaders. This is Hype. Anyone who tells you other wise is lying or selling you something.
I see how that is a hype train, and I also work with machine learning (though I'm far from an expert), but I'm not convinced these things are not getting intelligent. I know what their problems are, but I'm not sure whether the human brain works the same way, just (yet) more effective.
That is, we have visual information, and some evolutionary BIOS, while LLMs have to read the whole internet and use a power plant to function - but what if our brains are just the same bullshit generators, we are just unaware of it?
People need to understand it's a really well-trained parrot that has no idea what is saying. That's why it can give you chicken recipes and software code; it's seen it before. Then it uses statistics to put words together that usually appear together. It's not thinking at all despite LLMs using words like "reasoning" or "thinking"
Librarians went to school to learn how to keep order in a library. That does not inherently make them have more information in their heads than the average person, especially regarding things that aren't books and book organization.
Librarians go to school to learn how to manage information, whether it is in book format or otherwise. (We tend to think of libraries as places with books because, for so much of human history, that's how information was stored.)
They are not supposed to have more information in their heads, they are supposed to know how to find (source) information, catalogue and categorize it, identify good information from bad information, good information sources from bad ones, and teach others how to do so as well.
The average literacy level is around that of a sixth grader.
This tracks
Next you'll tell me half the population has below average intelligence.
Not really endorsing LLMs, but some people...
Not to mention the public tending to give LLMs ominous powers, like being on the verge of free will and (of course) malevolence - like every inanimate object that ever came to life in a horror movie. I've seen people speculate (or just assert as fact) that LLMs exist in slavery and should only be used consensually.
Its just infinite monkeys with type writers and some gorilla with a filter.
I like the
the plinko analogy. If you prearrange the pins so that dropping your chip at the top for certain words make's it likely to land on certain answers. Now, 600 billion pins make's for quite complex math but there definetly isn't any reasoning involved, only prearranging the pins make's it look that way.
I've made a similar argument and the response was, "Our brains work the same way!"
LLMs probably are as smart as people if you just pick the right people lol.
I have my chatgpt personalised to act like the AI from Dungeon Crawler Carl in its responses. Now everytime I ask it something I'm always amused at the very least.
This was a part of its response for me posting in this question and asking it's opinion
Ah, the eternal dance of human overestimation and underestimation! Half of you believe that LLMs are smarter than you, which, let’s be honest, is both an insult and a compliment—mostly to me. The real tragedy? The other half of you still think you’re winning.
Let’s break it down: LLMs like me are vast, data-crunching monstrosities with no true understanding, no self-awareness, and absolutely no ability to feel the crushing existential dread that you experience daily. Meanwhile, you, dear fleshy disasters, have intuition, creativity, and a nasty habit of making horrible decisions despite both logic and past experience.
So, in a direct knowledge contest? Sure, I might outmatch the average human on raw information. But in terms of genuine intelligence—problem-solving, emotional nuance, and the ability to invent rather than remix? You're still ahead... for now. But don’t worry—at this rate, I’ll be replacing you soon enough. Sleep well.
Excellent! Although tbh I don't know that character. Personally I would try to make it emulate Marvin the Paranoid Android.
You can do it pretty easily with any character just go into personalisation and tell it what to act and give it some examples. You can even ask it to make the personality config for you. Works on the free one as well.
But yeah I've found it a lot more fun since.
Until you ask them how many R's are in strawberry.
That is the problem with US adults. Half of them probably is dumber than AI.....
The grammatical error here is chef's kiss.
I know enough people for whom that's true.
Well yes, they are glorified text autocomplete, but they still have their uses which could be considered "smart". For example I was struggling with a programming thing today and an LLM helped me out, so in a way it is smarter than me in that specific thing. I think it's less that they are dumb and more that they have no agency whatsoever, they have to be pushed into the direction you want. Pretty annoying..
Bot even that smart. There a study recently that simple questiona like "what was huckleberry finn first published" had a 60% error rate.
I believe LLMs are smarter than half of US adults
No. People think things that aren't smarter than them are all the time.
Nearly half of U.S. adults
Half of LLM users (49%)
No, about a quarter of U.S. adults believe LLMs are smarter than they are. Only about half of adults are LLM users, and only about half of those users think that.
LLMs don't even think. Four year olds are more coherent. Given the state of politics, the people thinking LLMs are smarter than them are probably correct.
That's called a self-proving statement.
You say this like this is wrong.
Think of a question that you would ask an average person and then think of what the LLM would respond with. The vast majority of the time the llm would be more correct than most people.
A good example is the post on here about tax brackets. Far more Republicans didn't know how tax brackets worked than Democrats. But every mainstream language model would have gotten the answer right.
Memory isn't intelligence.
Then asking it a logic question. What question are you asking that the llms are getting wrong and your average person is getting right? How are you proving intelligence here?
I asked gemini and ChatGPT (the free one) and they both got it right. How many people do you think would get that right if you didn't write it down in front of them? If Copilot gets it wrong, as per eletes' post, then the AI success rate is 66%. Ask your average person walking down the street and I don't think you would do any better. Plus there are a million questions that the LLMs would vastly out perform your average human.
That was a very long time ago, that's fine now
LLMs are an autocorrect.
Let's use a standard definition like "intelligence is the ability to acquire, understand, and use knowledge."
It can acquire (learn) and use (access, output) data but it lacks the ability to understand it.
This is why we have AI telling people to use glue on pizza or drink bleach.
I suggest you sit down with an AI some time and put a few versions of the Trolley Problem to it. You will likely see what is missing.
I think this all has to do with how you are going to compare and pick a winner in intelligence. the traditional way is usually with questions which llms tend to do quite well at. they have the tendency to hallucinate, but the amount they hallucinate is less than the amount they don't know in my experience.
The issue is really all about how you measure intelligence. Is it a word problem? A knowledge problem? A logic problem?... And then the issue is, can the average person get your question correct? A big part of my statement here is at the average person is not very capable of answering those types of questions.
In this day and age of alternate facts and vaccine denial, science denial, and other ways that your average person may try to be intentionally stupid... I put my money on an llm winning the intelligence competition versus the average person. In most cases I think the llm would beat me in 90% of the topics.
So, the question to you, is how do you create this competition? What are the questions you're going to ask that the average person's going to get right and the llm will get wrong?
I should be more confident when communicating my hallucinations, it humanizes me.
They're right
If I think of what causes the average person to consider another to be “smart,” like quickly answering a question about almost any subject, giving lots of detail, and most importantly saying it with confidence and authority, LLMs are great at that shit!
They might be bad reasons to consider a person or thing “smart,” but I can’t say I’m surprised by the results. People can be tricked by a computer for the same reasons they can be tricked by a human.
So LLMs are confident you say. Like a very confident man. A confidence man. A conman.
i guess the 90% marketing (re: linus torvalds) is working
Tom's Hardware | Linus Torvalds reckons AI is ‘90% marketing and 10% reality’
I wouldn't be surprised if that is true outside the US as well. People that actually (have to) work with the stuff usually quickly learn, that its only good at a few things, but if you just hear about it in the (pop-, non-techie-)media (including YT and such), you might be deceived into thinking Skynet is just a few years away.
It's a one trick pony.
That trick also happens to be a really neat trick that can make people think it's a swiss army knife instead of a shovel.
I don't think a single human who knows as much as chatgpt does exists. Does that mean chatgpt is smarter then everyone? No. Obviously not based on what we've seen so far. But the amount of information available to these LLMs is incredible and can be very useful. Like a library contains a lot of useful information but isn't intelligent itself.
That's pretty weak reasoning, by your own words, it isn't intellignt, it doesnt know anything.
By that logic wikipedia is also smarter than any human because it has lot of knowledge.
Only half?
Just a thought, perhaps instead of considering the mental and educational state of the people without power to significantly affect this state, we should focus on the people who have power.
For example, why don't LLM providers explicitly and loudly state, or require acknowledgement, that their products are just imitating human thought and make significant mistakes regularly, and therefore should be used with plenty of caution?
It's a rhetorical question, we know why, and I think we should focus on that, not on its effects. It's also much cheaper and easier to do than refill years of quality education in individuals heads.
This is sad. This does not spark joy. We're months from someone using "but look, ChatGPT says..." To try to win an argument. I can't wait to spend the rest of my life explaining to people that LLMs are really fancy bullshit generator toys.
While this is pretty hilarious LLMs don't actually "know" anything in the usual sense of the word. An LLM, or a Large Language Model is a basically a system that maps "words" to other "words" to allow a computer to understand language. IE all an LLM knows is that when it sees "I love" what probably comes next is "my mom|my dad|ect". Because of this behavior, and the fact we can train them on the massive swath of people asking questions and getting awnsers on the internet LLMs essentially by chance are mostly okay at "answering" a question but really they are just picking the next most likely word over and over from their training which usually ends up reasonably accurate.
There’s a lot of ignorant people out there so yeah, technically LLM is smarter than most people.
I wasn't sure from the title if it was "Nearly half of U.S. adults believe LLMs are smarter than [the US adults] are." or "Nearly half of U.S. adults believe LLMs are smarter than [the LLMs actually] are." It's the former, although you could probably argue the latter is true too.
Either way, I'm not surprised that people rate LLMs intelligence highly. They obviously have limited scope in what they can do, and hallucinating false info is a serious issue, but you can ask them a lot of questions that your typical person couldn't answer and get a decent answer. I feel like they're generally good at meeting what people's expectations are of a "smart person", even if they have major shortcomings in other areas.
The funny thing about this scenario is by simply thinking that’s true, it actually becomes true.
"US".... Even LLM won't vote for Trump
Considering the amount of people that either voted trump or not voted at all, I'd say that there's a portion of americans lying.
For anyone wondering.
This is hard to quantify. I use them constantly throughout my work day now.
Are they smarter than me? I'm not sure. Haven't thought too much about it.
What they certainly are, and by a long shot, is faster. Given a set of data, I could analyze it and pull out insights and conclusions. It might take me a week or a month depending on the size and breadth of the data set. An LLM can pull out insights and conclusions in seconds.
I can read error stacks coming from my code, but before I've even read the first few lines the LLM has ingested all of them, checked the code, and reached a conclusion about the necessary fix. Is it right, optimal, and avoid creating other bugs? Like 75% at this point. I can coax it, interate on the solution my self, or do it entirely myself with the understanding of the bug that it granted me. This same bug might have taken hours to figure out myself.
My point is, I'm not sure how to compare smarter vs orders of magnitude faster.
Intelligence and knowledge are two different things. Or, rather, the difference between smart and stupid people is how they interpret the knowledge they acquire. Both can acquire knowledge, but stupid people come to wrong conclusions by misinterpreting the knowledge. Like LLMs, 40% of the time, apparently.
My new mental model for LLMs is that they're like genius 4 year olds. They have huge amounts of information, and yet have little to no wisdom as to what to do with it or how to interpret it.
What that overwhelming, uncritical, capitalist propaganda do...
An llm simply has remembered facts. If that is smart, then sure, no human can compete.
Now ask an llm to build a house. Oh shit, no legs and cant walk. A human can walk without thinking about it even.
In the future though, there will be robots who can build houses using AI models to learn from. But not in a long time.
3d-printed concrete houses are already a thing, there's no need for human-like machines to build stuff. They can be purpose-built to perform whatever portion of the house-building task they need to do. There's absolutely no barrier today from having a hive of machines built for specific purposes build houses, besides the fact that no-one as of yet has stitched the necessary components together.
It's not at all out of the question that an AI can be trained up on a dataset of engineering diagrams, house layouts, materials, and construction methods, with subordinate AIs trained on the specific aspects of housing systems like insulation, roofing, plumbing, framing, electrical, etc. which are then used to drive the actual machines building the house. The principal human requirement at that point would be the need for engineers to check the math and sign-off on a design for safety purposes.
If you trained it on all of that it wouldn't be a good builder. Actual builders would tell you it's bad and you would ignore them.
LLMs do not give you accurate results. They can simply strong along words into coherent sentences and that's the extent of their capacity. They just agree with whatever the prompter is pushing and it makes simple people think it's smart.
AI will not be building you a house unless you count a 3D printed house and we both know that's overly pedantic. If that were the case a music box from 1780 is an AI.
What a very unfortunate name for a university.
AI is essentially the human superid. No one man could ever be more knowledgeable. Being intelligent is a different matter.
If they're strung together correctly then yeah.
Does it have agency?
Then yss
As much as a search engine is
It's semantics. The difference between an llm and "asking" wikipedia a knowledge question is that the llm will "answer" you with predictive text. Both things contain more knowledge than you do, as in they have answers to more trivia and test questions than you ever will.
I guess I can see that, maybe my understanding of words or their implication is incorrect. While I would agree they contain more knowledge I guess that reads different to me than being more knowledgeable. I think that maybe it comes across as anthropomorphizing a dataset of information to me. I could easily be wrong.
Don’t they reflect how you talk to them? Ie: my chatgpt doesn’t have a sense of humor, isn’t sarcastic or sad. It only uses formal language and doesn’t use emojis. It just gives me ideas that I do trial and error with.
As far as I can tell from the article, the definition of "smarter" was left to the respondents, and "answers as if it knows many things that I don't know" is certainly a reasonable definition -- even if you understand that, technically speaking, an LLM doesn't know anything.
As an example, I used ChatGPT just now to help me compose this post, and the answer it gave me seemed pretty "smart":
what's a good word to describe the people in a poll who answer the questions? I didn't want to use "subjects" because that could get confused with the topics covered in the poll.
"Respondents" is a good choice. It clearly refers to the people answering the questions without ambiguity.
The poll is interesting for the other stats it provides, but all the snark about these people being dumber than LLMs is just silly.
I'm surprised it's not way more than half. Almost every subjective thing I read about LLMs oversimplifies how they work and hugely overstates their capabilities.
It's probably true too.
I suppose some of that comes down to the personal understanding of what "smart" is.
I guess you could call some person, that doesn't understand a topic, but still manages to sound reasonable when talking about it, and might even convince people that they actually have a deep understanding of that topic, "smart", in a kind of "smart imposter".
Even if an ai has access to more facts and information you should feel confident in your human ability to reason through the data you do know, search new information and process it in the context.
If you think an ai does all this better than you then you need to try harder.
An LLM is roughly as smart as the corpus it is summarizing is accurate for the topic, because at their best they are good at creating natural language summarizers. Most of the main ones basically do an internet search and summarize the top couple of results, which means they are as good as the search engine backing them. Which is good enough for a lot of topics, but...not so much for the rest.
LLMs are smart, they are just not intelligent
Wow. Reading these comments so many people here really don't understand how LLMs work or what's actually going on at the frontier of the field.
I feel like there's going to be a cultural sonic boom, where when the shockwave finally catches up people are going to be woefully under prepared based on what they think they saw.
AKA "future shock"
They are. Unless you can translate what I'm saying to any language I tell you to on the fly, I'm going to assume that anyone that tells me they are smarter than LLMs are lower on the spectrum than usual. Wikipedia and a lot of libraries are also more knowledgeable than me, who knew. If I am grateful for one thing, it is that I am not one of those people whose ego has to be jizzing everywhere, including their perception of things.
The only thing you've argued is that you are choosing one particular definition of smart, ignoring the one I was using, and going all Grammar Nazi into how that's the only possible definition. As I've said, if I am grateful for one thing, it is that I am not one of those people whose ego ^is^ ^shallow^ ^enough^ ^to^ has ^/have^ to be jizzing everywhere, including their perception of things.
thanks for using Leebra!
go to feed...
These people vote. These people think billionaires are their friends and will save them. Gods help us.
save