Wikipedia 20220820 Dump

2 months ago by slalomtic0s to c/datahoarder

There was talk sometime ago about hoarding the 20220830 Wikipedia dump as some of the big AI models went public soon after.

Now I can’t find it anywhere. Any suggestions?

wiccan2 14 points 2 months ago

I'd also be interested in this of anyone finds it.

In the mean time, I have managed to find 202205 on Internet Archive: https://archive.org/...

path: 0 25456737, hotness: undefined, score: 14, children: 0
pastermil 8 points 2 months ago

Okay, what is so special about this snapshot?

path: 0 25460892, hotness: undefined, score: 8, children: 1
lama 10 points 2 months ago

I think the idea is that it's pre-LLM

path: 0 25460892 25461792, hotness: undefined, score: 10, children: 0
BuckFutter 1 point 2 months ago

Earliest one I have is the 2023-09 zim (wikipedia_en_all_maxi_2023-09.zim) so not quite that far back.

path: 0 25489098, hotness: undefined, score: 1, children: 0
datahoarder

@lemmy.ml

login for more options
10680
291
58

Who are we?

We are digital librarians. Among us are represented the various reasons to keep data -- legal requirements, competitive requirements, uncertainty of permanence of cloud services, distaste for transmitting your data externally (e.g. government or corporate espionage), cultural and familial archivists, internet collapse preppers, and people who do it themselves so they're sure it's done right. Everyone has their reasons for curating the data they have decided to keep (either forever or For A Damn Long Time). Along the way we have sought out like-minded individuals to exchange strategies, war stories, and cautionary tales of failures.

We are one. We are legion. And we're trying really hard not to forget.

-- 5-4-3-2-1-bang from this thread

go to feed...