Guarding My Git Forge Against AI Scrapers

10 months ago by tofu to c/selfhosted

A summary of the techniques in place to protect my git forge
load all comments
xyro 11 points 10 months ago

Good read, I use crowdsec to block most of the traffic considered as malicious (which tend to overlap with scrappers), but I should look into Locaine to feed garbage to the remaining ones instead of throttling.

path: 0 20982764, hotness: undefined, score: 11, children: 1
JustTesting 6 points 10 months ago

it's iocaine not Locaine, tripped me up at first as well.

path: 0 20982764 20991420, hotness: undefined, score: 6, children: 0
selfhosted
selfhosted

@lemmy.world

login for more options
62929
6793
5408

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

Detailed Rules Post

  1. Be civil.

  2. No spam.

  3. Posts are to be related to self-hosting.

  4. Don't duplicate the full text of your blog or readme if you're providing a link.

  5. Submission headline should match the article title.

  6. No trolling.

  7. Promotion posts require active participation, with an account that is at least 30 days old. F/LOSS without a paywall has exceptions, with requirements. See the rules link for details. Tags [CBH] or [AIP] are required, see the links in Rule 8 for details.

  8. AI-related discussions and AI-involved promotional posts have additional requirements for tagging, as noted in Rule 7 and the AI & Promotional Post Expanded Rules post, and find example disclosures here.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

go to feed...