Drunk & Root@sh.itjust.works to Selfhosted@lemmy.worldEnglish · 2 days agoHow to combat large amounts of Ai scrapersmessage-squaremessage-square40fedilinkarrow-up198arrow-down14file-text
arrow-up194arrow-down1message-squareHow to combat large amounts of Ai scrapersDrunk & Root@sh.itjust.works to Selfhosted@lemmy.worldEnglish · 2 days agomessage-square40fedilinkfile-text
everytime i check nginx logs its more scrapers then i can count and i could not find any good open source solutions
minus-squarelemonuri@lemmy.mllinkfedilinkEnglisharrow-up3·1 day agoThe scraper blocklist on crowdsec requires a paid subscription, though, or did you find another workaround?
minus-squareHelloRoot@lemy.lollinkfedilinkEnglisharrow-up1·21 hours agoI don’t remember how I set it up a long time ago. But when I look at my server logs I only see myself. Afaik I just added the biggests lists. But I don’t remember.
The scraper blocklist on crowdsec requires a paid subscription, though, or did you find another workaround?
I don’t remember how I set it up a long time ago. But when I look at my server logs I only see myself.
Afaik I just added the biggests lists. But I don’t remember.