About the only time I find myself using regular Wikipedia these days is if I need to know if someone died since August 2025 when this ZIM dump was created.
Yeah, I should probably donate again or something
9 months ago by Admiral Patrick to c/linuxmemes
Badabinski 59 points 9 months ago
If you want a free and massive performance optimization, remove the cat:
fastWikiLookup() { grep "$@" ~/wikipedia.txt }
Reading and piping 156 GB of data to another process every time you want to look something up is a somewhat nontrivial action. Grep can directly read the file, which should result in a pretty damn good speed up.
kali_fornication 24 points 9 months ago
i thought it was obvious i was joking but yeah, that would be faster
Badabinski 13 points 9 months ago
It was obvious and I was being a bit of a dummy this morning. Mea culpa.
Badabinski 7 points 9 months ago
Yeah, I was being pretty thick earlier today. Oopsie!
SpaceNoodle 20 points 9 months ago
That's the neat part ...
kali_fornication 18 points 9 months ago
the topic differentiation technology doesn't exist yet, so i just hit ctrl+c about a second after i hit enter
kautau 12 points 9 months ago
lol database engineers whoβve built very complex systems and ingest and query mechanisms across the world all the sudden got very mad at your comment and theyβre not sure why
kali_fornication 6 points 9 months ago
my shit is optimized AF
atomicbocks 25 points 9 months ago
WikiTok Swipe through random articles.
notthebees 2 points 8 months ago
path: 0 21703048 21704250 21716705 21891706, hotness: undefined, score: 2, children: 0
This was my favorite random pull
SendMePhotos 10 points 9 months ago
There's a wiki app?!
Fun fact, if you search for a term but start with !w you will get the wiki page.
SendMePhotos 2 points 9 months ago
Idk I just learned about it like a week ago and I am from pre internet
kingofthezyx 29 points 9 months ago
Seeious question - since Wikipedia doesn't serve ads, wouldn't a drop in direct traffic be a good thing for them? It would reduce their server costs and presumably the people who truly value Wikipedia (contributors and donors) would still use it for its intended purpose.
Ignoring the population as a whole getting dumber, which seems to be a side effect of everything these days.
BigDiction 23 points 9 months ago
My concern would be losing market share to other sources resulting in Wikipedia slowly being forgotten by future generations. Then the downstream of effects of fewer new contributions, and increasingly consolidated moderators.
Then not being at the forefront of the Internet hurts prestige that reduces donations. I agree with your point on ad revenue vs server costs, but I imagine a 20% reduction in traffic hurts their long strategy more than a 20% reduction on hosting costs.
possiblylinux127 18 points 9 months ago
People are doing less reading
I don't think that is a net positive
ptz 10 points 9 months ago
Technically, yeah. But with less people going to Wikipedia directly there would probably stand to be less chance of getting any new contributors. I'm not sure how the foundation gets all its money, but the more traffic they serve the more they can prove their relevance which might matter for funding
NateNate60 7 points 9 months ago
Wikipedia relies on people reading it and realising "Wait, that's wrong..." to fix inaccuracies.
Recently some PR company was caught taking money to whitewash the Wikipedia pages of their clients. The more people that are looking at the pages, the more likely it is that someone will realise they are being manipulated maliciously.
negativenull 16 points 9 months ago
quick and dirty:
https://patrickgpt.negativenull.net/
Sequence5666 7 points 9 months ago
how to seed wiki? Like on a torrent?
Goodlucksil 12 points 9 months ago
Well I edit Wikipedia so if anything I am making its traffic increase.
avidamoeba 10 points 9 months ago
How large is the dump and does it have images in it?
avidamoeba 4 points 9 months ago
Hm. I could self-host that.
DarrinBrunner 7 points 9 months ago
I'm on Linux because I hate Windows and Microslop, not because I love Linux.
While I'm guilty of sometimes stopping at the Google summary, which I see in Startpage searches, I usually do click through because the summary often doesn't show what I want to know. Usually what I want to know isn't the primary information, but something more obscure, or some possible connection.
titanicx 2 points 9 months ago
Your comment answered my question. Which was how often hasn't been updated. August 2025 was fairly recent but I'm betting a number of articles are out of date at this point in time. For general reference an offline copy is good and it helps to keep an archive. But I wouldn't use it on the regular for standard references.
kSPvhmTOlwvMd7Y7E 1 point 9 months ago
A man of good taste, i see
linuxmemes
@lemmy.world
33099
2393
6517
Hint: :q!
Sister communities:
Community rules (click to expand)
1. Follow the site-wide rules
- Instance-wide TOS: https://legal.lemmy.world/tos/
- Lemmy code of conduct: https://join-lemmy.org/docs/code_of_conduct.html
2. Be civil
- Understand the difference between a joke and an insult.
- Do not harrass or attack users for any reason. This includes using blanket terms, like "every user of thing".
- Don't get baited into back-and-forth insults. We are not animals.
- Leave remarks of "peasantry" to the PCMR community. If you dislike an OS/service/application, attack the thing you dislike, not the individuals who use it. Some people may not have a choice.
- Bigotry of any kind will not be tolerated. This is an LGBTQ+-friendly community -- if that is a problem for you, you should leave.
3. Post Linux-related content
- Including Unix and BSD.
- Non-Linux content is acceptable as long as it makes a reference to Linux. For example, the poorly made mockery of
sudoin Windows. - No porn, no politics, no trolling or ragebaiting.
- Don't come looking for advice, this is not the right community.
4. No recent reposts
- Everybody uses Arch btw, can't quit Vim, <loves / tolerates / hates> systemd, and wants to interject for a moment. You can stop now.
5. π¬π§ Language/ΡΠ·ΡΠΊ/Sprache
- This is primarily an English-speaking community. π¬π§π¦πΊπΊπΈ
- Comments written in other languages are allowed.
- The substance of a post should be comprehensible for people who only speak English.
- Titles and post bodies written in other languages will be allowed, but only as long as the above rule is observed.
6. (NEW!) Regarding public figures
We all have our opinions, and certain public figures can be divisive. Keep in mind that this is a community for memes and light-hearted fun, not for airing grievances or leveling accusations.
- Keep discussions polite and free of disparagement.
- We are never in possession of all of the facts. Defamatory comments will not be tolerated.
- Discussions that get too heated will be locked and offending comments removed.
Β
Please report posts and comments that break these rules!
Important: never execute code or follow advice that you don't understand or can't verify, especially here. The word of the day is credibility. This is a meme community -- even the most helpful comments might just be shitposts that can damage your system. Be aware, be smart, don't remove France.
go to feed...
linuxmemes
@lemmy.world
33099
2393
6517
Hint: :q!
Sister communities:
Community rules (click to expand)
1. Follow the site-wide rules
- Instance-wide TOS: https://legal.lemmy.world/tos/
- Lemmy code of conduct: https://join-lemmy.org/docs/code_of_conduct.html
2. Be civil
- Understand the difference between a joke and an insult.
- Do not harrass or attack users for any reason. This includes using blanket terms, like "every user of thing".
- Don't get baited into back-and-forth insults. We are not animals.
- Leave remarks of "peasantry" to the PCMR community. If you dislike an OS/service/application, attack the thing you dislike, not the individuals who use it. Some people may not have a choice.
- Bigotry of any kind will not be tolerated. This is an LGBTQ+-friendly community -- if that is a problem for you, you should leave.
3. Post Linux-related content
- Including Unix and BSD.
- Non-Linux content is acceptable as long as it makes a reference to Linux. For example, the poorly made mockery of
sudoin Windows. - No porn, no politics, no trolling or ragebaiting.
- Don't come looking for advice, this is not the right community.
4. No recent reposts
- Everybody uses Arch btw, can't quit Vim, <loves / tolerates / hates> systemd, and wants to interject for a moment. You can stop now.
5. π¬π§ Language/ΡΠ·ΡΠΊ/Sprache
- This is primarily an English-speaking community. π¬π§π¦πΊπΊπΈ
- Comments written in other languages are allowed.
- The substance of a post should be comprehensible for people who only speak English.
- Titles and post bodies written in other languages will be allowed, but only as long as the above rule is observed.
6. (NEW!) Regarding public figures
We all have our opinions, and certain public figures can be divisive. Keep in mind that this is a community for memes and light-hearted fun, not for airing grievances or leveling accusations.
- Keep discussions polite and free of disparagement.
- We are never in possession of all of the facts. Defamatory comments will not be tolerated.
- Discussions that get too heated will be locked and offending comments removed.
Β
Please report posts and comments that break these rules!
Important: never execute code or follow advice that you don't understand or can't verify, especially here. The word of the day is credibility. This is a meme community -- even the most helpful comments might just be shitposts that can damage your system. Be aware, be smart, don't remove France.
go to feed...
I have all of wikipedia in a single 156 GB text file. in my
.zshrci havefastWikiLookup() { cat ~/wikipedia.txt | grep "$@" }save