Pro@programming.dev to Technology@lemmy.worldEnglish · 2 days agoCodeberg: army of AI crawlers are extremely slowing us; AI crawlers learned how to solve the Anubis challenges.i.imgur.comexternal-linkmessage-square225fedilinkarrow-up11.1Karrow-down112file-text
arrow-up11.09Karrow-down1external-linkCodeberg: army of AI crawlers are extremely slowing us; AI crawlers learned how to solve the Anubis challenges.i.imgur.comPro@programming.dev to Technology@lemmy.worldEnglish · 2 days agomessage-square225fedilinkfile-text
minus-squareqaz@lemmy.worldlinkfedilinkEnglisharrow-up2·15 hours agoI think the issue is that the scrapers are fully automatically collecting text, jumping from link to link like a search engine indexer.
I think the issue is that the scrapers are fully automatically collecting text, jumping from link to link like a search engine indexer.