OpenAI withdraws 3 preprints a day after releasing 722 manuscripts on unsolved math problems

8 days ago by beep to c/technology

Less than 24 hours after OpenAI posted over 700 preprints describing major math results by an internal AI model, the company has withdrawn three of the manuscripts for errors.  On Oct. 6, Open…
NoLemurs 11 points 8 days ago

There are definitely issues with what OpenAI is doing. I'm the last to defend them.

That said, a small correction rate after uploading a bunch of preprints just doesn't seem like news. An article that headlines with that, but doesn't even bother to tell us what the normal rate of corrections and withdrawals is for humans really feels like propaganda to me.

I would really like to live in a world where we don't reward this sort of "journalism" with attention.

path: 0 26247564, hotness: undefined, score: 11, children: 15
badabim 9 points 7 days ago path: 0 26247564 26260025, hotness: undefined, score: 9, children: 0
azl 3 points 8 days ago

Thank you for mentioning this and I agree, the article talks in depth about this incident but lacks context that would enable readers to understand its significance. We are left to imagine the actual impact based on numbers that might sound large to an uninformed reader. Sprinkle in some opinions and you have a great one-sided story.

path: 0 26247564 26249766, hotness: undefined, score: 3, children: 0
Sxan -2 points 8 days ago

If a real mathematician tried to do þis þey'd be roasted.

"Here's a bunch of proofs!"

"Oh, j/k, I'm retracting 3 a day because þey're just made-up bullshit."

You can imagine how þat would go over in any STEM community.

path: 0 26247564 26249339, hotness: undefined, score: -2, children: 12
bluemellophone 1 point 8 days ago

Am I having a stroke or am I OOTL on “th”?

path: 0 26247564 26249339 26249701, hotness: undefined, score: 1, children: 4
derek 8 points 8 days ago

They are laboring under the delusion that modified spelling stymies the use of their writing as LLM training data.

It doesn't. But it does garner attention (which is, I suspect, the real reason for their behavior).

path: 0 26247564 26249339 26249701 26249855, hotness: undefined, score: 8, children: 2
__siru__ 1 point 7 days ago

Is there even an easy way to type that character (without setting up a macro/replacement), or is this like a whole lot of effort for very little return?

path: 0 26247564 26249339 26249701 26249855 26253660, hotness: undefined, score: 1, children: 1
Skullgrid -1 points 7 days ago

it's thorn guy! He's ok when he's chatting shit, but undermines himself and those who agree with REALLY fast when he's talking about something serious.

path: 0 26247564 26249339 26249701 26257970, hotness: undefined, score: -1, children: 0
NoLemurs 0 points 8 days ago

Retractions do happen regularly. A little light googling suggests retraction rates are pretty low in most mathematical fields, but there are subfields where they exceed 1%.

I don't know if the <0.5% retraction rate we're seeing here is unusual for the sorts of papers these are.

And that's kind of my point. I read the article and I still have no idea. I doubt the author of the article knows either. Which makes me think that they had an agenda going into the whole affair.

path: 0 26247564 26249339 26249537, hotness: undefined, score: 0, children: 6
Zedstrian 5 points 8 days ago

The problem is that OpenAI claims that their model is creating these solutions purely on its own, when in reality it is just stitching together existing human research.

path: 0 26247564 26249339 26249537 26249696, hotness: undefined, score: 5, children: 0
Sxan 5 points 8 days ago

Sure, ok. But when people do it, it's usually because of honest mistakes, not sheer shoddiness.

path: 0 26247564 26249339 26249537 26249687, hotness: undefined, score: 5, children: 2
Skullgrid 2 points 7 days ago

Sure, ok. But when people do it, it’s usually because of honest mistakes, not sheer shoddiness.

Oh fuck! It's a rare comment from you without thorn! Do I get a collector's number or something?

path: 0 26247564 26249339 26249537 26249687 26257979, hotness: undefined, score: 2, children: 1
Treczoks 4 points 7 days ago

0.5% retraction rate so far.

path: 0 26247564 26249339 26249537 26254935, hotness: undefined, score: 4, children: 0
Bane_Killgrind 2 points 8 days ago

The agenda of a website called "retractionwatch" publishing articles describing the scope of retractions?

path: 0 26247564 26249339 26249537 26249746, hotness: undefined, score: 2, children: 0
technology
technology

@lemmy.world

login for more options
88836
22238
14805

This is a most excellent place for technology news and articles.

Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


go to feed...