AI giants learn what everyone else on the modern internet already knows

3 months ago by BeatTakeshi to c/fuck_ai

Anthropic's distillation complaints expose an awkward question: does AI's fair use argument cut both ways?

Well I think I will start saying "your intelligence seems artificial" as an insult

psx_crab 19 points 3 months ago

Release the Epstein file then you coward.

save

path: 0 24760023, hotness: undefined, score: 19, children: 4

november 9 points 3 months ago

...what does that have to do with this?

save

path: 0 24760023 24765704, hotness: undefined, score: 9, children: 1

luciferofastora 1 point 3 months ago

Don't you know that everything is now just a distraction from the files, every influential person has their fingers in keeping them locked away and every journalist reporting on anything else is just part of the distraction effort?

I get that people don't want the issue to be swept under the rug, and I agree that there probably is a lot more awful shit in there, but because it's everywhere, it's starting to just become background noise. In the attempt to keep the topic from insignificance, they're wearing it out.

Besides, while past atrocities are definitely worth examining, I'm personally more concerned about present and near-future ones. Justice won't un-rape the children, but unchecked AI grift is burning the future.

save

path: 0 24760023 24765704 24826981, hotness: undefined, score: 1, children: 0

DriftingLynx 8 points 3 months ago

I didn't realize Alistair Barr had that kind of power.

save

path: 0 24760023 24764631, hotness: undefined, score: 8, children: 0

LodeMike 5 points 3 months ago

File? Singular?

save

path: 0 24760023 24775292, hotness: undefined, score: 5, children: 0

TheKaul 11 points 3 months ago

It would be nice if we could read more than 3 paragraphs of the article.

Copied this from a crosspost: https://removepaywalls.com/...

save

path: 0 24765830, hotness: undefined, score: 11, children: 0

Culminate 10 points 3 months ago

Glad that we can take their work for free to. Hopefully the community can produce open weight models that run locally so we don't need to pay these fools.

save

path: 0 24767642, hotness: undefined, score: 10, children: 1

its_kim_love 9 points 3 months ago

Fuck AI

save

path: 0 24767642 24771734, hotness: undefined, score: 9, children: 0

vk6flab 8 points 3 months ago

Yum .. Unsupervised Text Extruders are now digesting the Excrement from their Assumed Intelligence overlord's competitors.

Can't wait to smell the results ...

save

path: 0 24785330, hotness: undefined, score: 8, children: 0

ghodawalaaman 2 points 3 months ago

Welcome to the new internet, Anthropic, OpenAI, and Google. Get used to it.

save

path: 0 24794662, hotness: undefined, score: 2, children: 0

T156 2 points 3 months ago

I'm not the most knowledgeable about LLMs, but I don't see the threat distillation is supposed to pose.

Surely what you'd get from training something on a model's outputs and reasoning chain would just get you something that sounds like that model. The model won't magically become more intelligent just because it's trained on data from a smarter model. It doesn't have the relevant vectors and mathematics, it's only got the text output. A lot of the model changes tend to be architectural than just more data these days.

At least from my layman's viewpoint, it seems very much like claiming that watching television would let someone build a better television just from what they saw. The whole fear around distillation just sounds like nonsense.

save

path: 0 24793311, hotness: undefined, score: 2, children: 1

davad 1 point 2 months ago

Actually, the opposite has been expected for a while. Read up on "Model Collapse" if you're interested in more details. It's a term specific to GenAI, but more generally "overfitting" is a known challenge in machine learning.

save

path: 0 24793311 25303888, hotness: undefined, score: 1, children: 0