AI-generated poetry is indistinguishable from human-written poetry and is rated more favorably - Scientific Reports

2 years ago by arrakark to c/technology

As AI-generated text continues to evolve, distinguishing it from human-authored content has become increasingly difficult. This study examined whether non-expert readers could reliably differentiate between AI-generated poems and those written by well-known human poets. We conducted two experiments with non-expert poetry readers and found that participants performed below chance levels in identifying AI-generated poems (46.6% accuracy, χ2(1, N = 16,340) = 75.13, p < 0.0001). Notably, participants were more likely to judge AI-generated poems as human-authored than actual human-authored poems (χ2(2, N = 16,340) = 247.04, p < 0.0001). We found that AI-generated poems were rated more favorably in qualities such as rhythm and beauty, and that this contributed to their mistaken identification as human-authored. Our findings suggest that participants employed shared yet flawed heuristics to differentiate AI from human poetry: the simplicity of AI-generated poems may be easier for non-experts to understand, leading them to prefer AI-generated poetry and misinterpret the complexity of human poems as incoherence generated by AI.
load all comments
DuckWrangler9000 16 points 2 years ago

The thing I really hate about AI is when they say it can make art. For centuries, art has been a form of expression and communicating all sorts of human emotions and experiences. Some art reflects pain or memories experienced in life. Other art is designed out of intellectual curiosity or to evoke thought. AI isn't human, so it can't do anything other than copy or simulate. It's artificial after all. So it makes images. But there's no backstory or feelings or emotion or suffering. It's truly meaningless.

path: 0 13519306, hotness: undefined, score: 16, children: 15
testfactor 22 points 2 years ago

In 1962 Phillip K Dick put out a book called "Man in the High Castle." In it there was a scene that stuck out to me, and seems more and more relevant as this AI wave continues.

In it a man has two identical lighters. Each made in the same year by the same manufacturer. But one was priceless and one was worthless.

The priceless one was owned by Abraham Lincoln and was in his pocket on the night he was assassinated. He had a letter of certification as such, and could trace the ownership all the way back to that night.

And he takes them both and mixes them up and asks which is the one with value. If you can no longer discern the one with "historicity," then where is it's value?

And every time I see an article like this I can't help but think about that. If I tell you about the life and hardship of an artist, and then present you two poems, one that he wrote and one that was spit out by an LLM, and you cannot determine which has the true hardship and emotion tied to it, then which has value? What if I killed the artist before he could reveal which one was the "true" poem? How do you know which is a powerful expression of the artist's oppression, and which is worthless, randomly generated swill?

path: 0 13519306 13520195, hotness: undefined, score: 22, children: 3
catloaf 10 points 2 years ago

Art, like the value of Lincoln's lighter, is in the eye of the beholder.

Often, people find art in completely natural occurrences. Or even human designs seen in certain ways, like how two or more separate buildings might come together in unintended ways.

So, even if it's not strictly intentional human art, it's still valid to appreciate it.

path: 0 13519306 13520195 13520363, hotness: undefined, score: 10, children: 0
whereisk 9 points 2 years ago

There’s no contradiction here.

With high value art you definitionally buy a story not the content. Without a certificate of authenticity or a story that goes with it there is no story and no value to it.

With K Dick’s example the two lighters would become of different but equivalent value, perhaps the new value is in the story of how two identical copies and yet different came to be.

You could 3d scan the statue of David and reproduce it down to its tiniest detail. And yet the copy is only worth as much as the cost to make it or even less, while the original is invaluable.

You can see the Mona Lisa on your phone any time you want and yet millions will take the trip to the Louvre to see what is most likely not even the original.

The story and the history of an object is what you purchase when buying art or antiques of high value.

path: 0 13519306 13520195 13520416, hotness: undefined, score: 9, children: 1
greenskye 21 points 2 years ago

I think there's an argument about art being the emotions it invokes in the viewer rather than the creator. Humans can find art in natural phenomena, which also has no feelings or backstory involved.

I'm not really defending AI slop here, just disagreeing with your definition of art and the relation to the creator rather than the viewer.

path: 0 13519306 13519386, hotness: undefined, score: 21, children: 1
FaceDeer 6 points 2 years ago

Indeed, there are whole categories of art such as "found art" or the abstract stuff that involves throwing splats of paint at things that can't really convey the intent of the artist because the artist wasn't involved in specifying how it looked in the first place. The artist is more like the "first viewer" of those particular art pieces, they do or find a thing and then decide "that means something" after the fact.

It's entirely possible to do that with something AI generated. Algorithmic art goes way back. Lots of people find graphs of the Mandelbrot Set to be beautiful.

path: 0 13519306 13519386 13520830, hotness: undefined, score: 6, children: 0
treefrog 9 points 2 years ago
path: 0 13519306 13523968, hotness: undefined, score: 9, children: 1
whatalute 3 points 2 years ago

I think Lemmy's general demographic skews towards techy early-adopters and lots of STEM background folks and it shows with topics like this. I'm not saying that's a negative thing, just that it's the vibe here.

Art is just such a broad topic, it gets messy. Plus I think the verbage around discussing it isn't as universally defined as in other topics. It doesn't always fit neatly into categories and boxes that can make it harder to have nuanced discussions.

path: 0 13519306 13523968 13534181, hotness: undefined, score: 3, children: 0
leisesprecher 7 points 2 years ago

Or, maybe, we have to accept that art and all the grandiose and deep narratives around it are bullshit. It's an illusion, it's just a tool so some of us feel more important.

All that crap about not being made by humans is just the fear that the illusion of grandeur of humans might collapse.

path: 0 13519306 13519531, hotness: undefined, score: 7, children: 4
FaceDeer 6 points 2 years ago

I do get the sense sometimes that the more extreme anti-AI screeds I've come across have the feel of narcissistic rage about them. The recognition of AI art threatens things that we've told ourselves are "special" about us.

path: 0 13519306 13519531 13520851, hotness: undefined, score: 6, children: 1
treefrog 3 points 2 years ago
path: 0 13519306 13519531 13524002, hotness: undefined, score: 3, children: 1
technocrit -1 points 2 years ago

AI isn’t human, so it can’t do anything other than copy or simulate.

There's no such thing as "AI".

But computers can also generate art through averaging. It can average the feelings, impact, etc. That's part of why generated art is popular. It's still people creating new works from the old. It's still "art" by any reasonable definition.

path: 0 13519306 13527661, hotness: undefined, score: -1, children: 1
DuckWrangler9000 0 points 2 years ago

How do you mean there's no such thing as AI?

path: 0 13519306 13527661 13528014, hotness: undefined, score: 0, children: 0
technology
technology

@lemmy.world

login for more options
88912
22289
14644

This is a most excellent place for technology news and articles.

Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


go to feed...