[Survey] Can you tell which images are AI generated?

3 years ago by popcar2 to c/technology

This is a casual survey to see if people are able to tell which images are created by AI, and which are created by humans. Try to answer as accurately as you can, and feel free to guess!

Hey everyone. I made a casual survey to see if people can tell the difference between human-made and AI generated art. Any responses would be appreciated, I'm curious to see how accurately people can tell the difference (especially those familiar with AI image generation)

davidgro 21 points 3 years ago

Got 9/20.

That was a good selection of images, quite tricky.

I'm proud of getting both the LEGO minifig ones correct.

path: 0 4165858, hotness: undefined, score: 21, children: 2
qdJzXuisAndVQb2 6 points 3 years ago

Another 9/20er here. I did feel like I was guessing a lot, it was almost satisfying to get such a midway score.

path: 0 4165858 4167789, hotness: undefined, score: 6, children: 1
cyberwolfie 2 points 3 years ago

I also got 9/20, feeling certain about only a handful, and completely thrown off by others. Since all questions were yes/no, expected score would be 10/20, so my score correctly reflects that I had no real idea what was AI-generated or not. I expect the average score to be close to 10/20, skewed somewhat higher by those who might have a keen eye for some telltale signs of AI-trickery.

path: 0 4165858 4167789 4200789, hotness: undefined, score: 2, children: 0
Noved 17 points 3 years ago

The one that got me was definitely the fruits, I didn't realize that AI was able to generate decent text yet lol

path: 0 4166521, hotness: undefined, score: 17, children: 2
popcar2 10 points 3 years ago

DALL-E 3 is the only model that gets text right. It usually yields consistent results but can still jumble on words if you ask it to say too much. It's a big step forward regardless.

AI generated photo of a cat saying "I'm king of the world!"

path: 0 4166521 4171997, hotness: undefined, score: 10, children: 1
davidgro 6 points 3 years ago

That's incredible. I'm usually surprised when there's a single correct word.

path: 0 4166521 4171997 4173344, hotness: undefined, score: 6, children: 0
candyman337 12 points 3 years ago

I take issue with this because the devil is usually in the details with ai images and these are all low rez jpgs making it harder to tell with some of these.

path: 0 4165552, hotness: undefined, score: 12, children: 3
popcar2 8 points 3 years ago

Unfortunately it seems like google forms resizes the image to fit the forms. If I had known this before I would've used something else, but oh well. I've stretched the images as far as they can go now, which seems to be around 740x740.

path: 0 4165552 4165988, hotness: undefined, score: 8, children: 0
biddy 2 points 3 years ago

True, but low rez web jpegs is a huge part of the market for images. AI will replace stock photos and that's incredibly disruptive on it's own.

path: 0 4165552 4198477, hotness: undefined, score: 2, children: 0
SzethFriendOfNimi 1 point 3 years ago

Right? Are hands visible? Because those are a bear to get right

path: 0 4165552 4165798, hotness: undefined, score: 1, children: 0
astanix 9 points 3 years ago

Well I got less than 50%, maybe I'm an AI. What is even real anymore!?

path: 0 4165059, hotness: undefined, score: 9, children: 0
ram 7 points 3 years ago

12/20, most of my mistakes were in saying human-made work was AI generated.

path: 0 4167981, hotness: undefined, score: 7, children: 0
reflex_aliens 7 points 3 years ago

3/20. I almost got everything perfectly backwards!

path: 0 4170294, hotness: undefined, score: 7, children: 0
Cwiiis 7 points 3 years ago

10/20 but I'm a little annoyed that what looks exactly like a panel from Berserk is apparently AI generated... Feels like the training data might just be replicated in entirety there, either that or someone asked it to generate "Guts from Berserk" 😛

path: 0 4180355, hotness: undefined, score: 7, children: 1
Gullible 2 points 3 years ago

You can always notice AI based on the random belts on armor clad figures. It’s a neat belt, but why did it begin and end at the center of their chest?

path: 0 4180355 4193090, hotness: undefined, score: 2, children: 0
muhyb 5 points 3 years ago

I got real life ones correct, almost all paintings too (10 was tricky) but charcoal drawings are kinda impossible to guess.

path: 0 4170144, hotness: undefined, score: 5, children: 0
ar0177417 5 points 3 years ago

10/20

path: 0 4181139, hotness: undefined, score: 5, children: 1
Zeragamba 1 point 3 years ago

same score here

path: 0 4181139 4204868, hotness: undefined, score: 1, children: 0
TheBlue22 5 points 3 years ago

10/20, got tricked by the horse in one of them, it looked really messed up, like something AI would make.

I guess the artist cant make horses

path: 0 4177911, hotness: undefined, score: 5, children: 0
FooBarrington 5 points 3 years ago

Cool test, thanks for putting this together! I got 8/20 - this essentially proved to me that for many cases, AI generation is not really distinguishable anymore.

path: 0 4167508, hotness: undefined, score: 5, children: 0
Traegs 4 points 3 years ago

I got 12/20 and most of the ones I got wrong are the ones I was second guessing myself on.

path: 0 4205904, hotness: undefined, score: 4, children: 0
gullible 4 points 3 years ago

Detail plays a huge role in determining AI, and many of the pictures appear compressed which makes that criterion… difficult to consider. I’m not surprised that I got half right, regardless. The man on the bench really got me, why is his ankle thread-thin?

path: 0 4168427, hotness: undefined, score: 4, children: 0
TonyTonyChopper 4 points 3 years ago

12/20, these new systems are way too good at what they do. With drawings it's basically impossible to tell unless there are obvious mistakes. And the mugshots are spot on too.

path: 0 4176531, hotness: undefined, score: 4, children: 0
starman2112 3 points 3 years ago

Wow, I got exactly half of them right. I reasoned my way through four of them–I assume AI can't handle refraction or reflection very well, so I reasoned that 1, 2, and 12 were all fakes. On 17, the scarf is too detailed to be a Lego piece.

Every other guess was vibes based, and on my vibes-based guesses I got 6/16

path: 0 4166193, hotness: undefined, score: 3, children: 0
rbn 3 points 3 years ago

Questions 11, 12, and 20 we're all graded incorrectly as the correct answer contradicts the specified source.

Based on the automatic grading I got 12 out of 20. Based on the feedback / comments I got 15 correct.

I'm quite proud that within the human photographies I classified 100% correct but I guess it'll be impossible for me if the algorithms just improve a tiny little bit.

path: 0 4165201, hotness: undefined, score: 3, children: 1
popcar2 2 points 3 years ago

They were fixed after posting but that may be after you opened the link, answers should be good now.

path: 0 4165201 4165247, hotness: undefined, score: 2, children: 0
ArtyTester 3 points 3 years ago

I got all the “real life” pictures correct, but most of the drawings and paintings were in line with straight guessing.

There are things that stick out as “wrong” on a picture of life, but in a drawing or paining the question is “is this wrong or just what the artist decided to do?”

path: 0 4169577, hotness: undefined, score: 3, children: 0
hulemy 3 points 3 years ago

9/20 damnit, thought I'd be better at this

path: 0 4169516, hotness: undefined, score: 3, children: 0
PrimalHero 3 points 3 years ago

6/20 I am bad at this

path: 0 4180768, hotness: undefined, score: 3, children: 0
motor_spirit 2 points 3 years ago
path: 0 4204667, hotness: undefined, score: 2, children: 0
virku 2 points 3 years ago

Question 11 didn't have a correct answer.

path: 0 4164635, hotness: undefined, score: 2, children: 1
popcar2 2 points 3 years ago

Fixed, thanks for reporting.

path: 0 4164635 4164875, hotness: undefined, score: 2, children: 0
ma11en 2 points 3 years ago

13/20

path: 0 4166042, hotness: undefined, score: 2, children: 2
FiniteLooper 1 point 3 years ago

11/20, I’m surprised. I thought I would do better at seeing that standard AI look and feel, but those other art aunties really threw me off. I wasn’t aware some of them could be generated from an AI so well!

path: 0 4166042 4167855, hotness: undefined, score: 1, children: 1
apprehensively_human 2 points 3 years ago

AI generated photographs, or I guess AI generated images that are trying to appear photoreal are usually pretty easy to spot.

The stylized artistic ones are often really hard because you could have a human work of art that is trying to purposefully mimic an AI generator, which looks like the case with Strawberry Taiyaki Cat

path: 0 4166042 4167855 4168208, hotness: undefined, score: 2, children: 0
HipPriest 2 points 3 years ago

8/20 here. Proud of getting some right. Really shocked about the answers to some!

A tricky test indeed

path: 0 4167737, hotness: undefined, score: 2, children: 0
Codename_goose 2 points 3 years ago

11/20 I feel slightly upset by the fact that it’s still a 50/50 coin flip for me which was which.

path: 0 4173161, hotness: undefined, score: 2, children: 0
Mr_Dr_Oink 2 points 3 years ago

14/20

Cool survey.

Some of the similar ones i got the wrong way around, but i was quite happy with my answers for others where i was quite confident there were (to me) obvious indicators of AI and got them right.

path: 0 4177563, hotness: undefined, score: 2, children: 0
southernwolf 2 points 3 years ago

14/20, nicely done! I will say, I maybe would have wanted to see more AI results than just from Dall-e 3, though given I still missed 6 of the, that speaks very highly of Dall-e 3's capabilities. But some midjourney and SDXL images would have made for a wider guessing selection too.

path: 0 4182741, hotness: undefined, score: 2, children: 1
MellowBright 2 points 3 years ago

I agree. I've only been using Stable Diffusion so I was surprised to see it's lack of presence. I feel like half to ones I got wrong were because I'm too used to SD's quirks.

Dall-e has apparently gotten really damn good lately. The talking fruit in particular. Being context aware enough to create accurate speech bubbles is crazy neat. One huge step closer to AI comic books.

path: 0 4182741 4195808, hotness: undefined, score: 2, children: 0
crowfx 2 points 3 years ago

Got 7/20.

Those images are actually hard to distinguish for me. An eye opening experience.

path: 0 4203179, hotness: undefined, score: 2, children: 0
KoboldCoterie 1 point 3 years ago

Well, I did alright on the people, but I got almost all of the landscapes incorrect. I'll also admit to guessing on a number of them; if I had to explain exactly what I was basing my answer on for ones I said were AI, I'd have missed 2 more, because I just couldn't see anything that looked off, it was just a hunch.

path: 0 4165959, hotness: undefined, score: 1, children: 0
Danar 1 point 3 years ago

Questions 12 and 20 seem to have incorrect answers. The correct answer is "no", but the comment says they were created by DALLE-3

path: 0 4165062, hotness: undefined, score: 1, children: 1
popcar2 2 points 3 years ago

Fixed both right before seeing this comment, I'm really not awake enough for this :P

path: 0 4165062 4165164, hotness: undefined, score: 2, children: 0
RocketBucket 1 point 3 years ago

15/20 - Nice survey, was quite tricky

path: 0 4176923, hotness: undefined, score: 1, children: 0
NaturalViber 1 point 3 years ago

I got 14/20. I am the real human that has gotten the high score. I am not a bot. Real human only.

path: 0 4206933, hotness: undefined, score: 1, children: 0
baggins 1 point 3 years ago

The link doesn't work.

path: 0 4165772, hotness: undefined, score: 1, children: 0
slazer2au 1 point 3 years ago

11/20

I have used SD so I can see some of the ai tell tale signs but haven't used Dall-E at all.

path: 0 4168940, hotness: undefined, score: 1, children: 0
Jimmycakes 1 point 3 years ago

I got 13.

path: 0 4199291, hotness: undefined, score: 1, children: 0
technology
technology

@lemmy.ml

login for more options
43403
4124
2028

This is the official technology community of Lemmy.ml for all news related to creation and use of technology, and to facilitate civil, meaningful discussion around it.


Ask in DM before posting product reviews or ads. All such posts otherwise are subject to removal.


Rules:

1: All Lemmy rules apply

2: Do not post low effort posts

3: NEVER post naziped*gore stuff

4: Always post article URLs or their archived version URLs as sources, NOT screenshots. Help the blind users.

5: personal rants of Big Tech CEOs like Elon Musk are unwelcome (does not include posts about their companies affecting wide range of people)

6: no advertisement posts unless verified as legitimate and non-exploitative/non-consumerist

7: crypto related posts, unless essential, are disallowed

go to feed...