Pay up or stop scraping: Cloudflare program charges bots for each crawl
Cloudflare now beta testing pay-per-crawl feature to stop endless AI scraping.
arstechnica.com/tech-policy/20…
Cloudflare is now experimenting with tools that will allow content creators to charge a fee to AI crawlers to scrape their websites.
#ai #artificial-intelligence #artificial-stupidity #cloudflare #scraping #ai-scraping #pay-per-crawl #bots
Andrew Pam likes this.
Brad Koehn ☑️ reshared this.
Tom Grzybow
in reply to David • • •So, Cloudflare turning the internet into a toll road is a virtue?
I tried blocking Cloudflare once. Once.
David
in reply to David • • •Tom Grzybow
in reply to David • • •David
in reply to David • • •You can move to Onionland where there's some built-in DoS protection with the PoW feature. Problem is: it just gives preference to the clients that supply PoW. It doesn't (at least not yet) allow services to require PoW.
onionservices.torproject.org/t…
Another option is to move to I2P. I've had a self-hosted Onionland web site attacked, but never an I2P web site.
Does anyone know about a web server that allows you to simply drop connections when there are too many? Yes, this doesn't stop DoS, but it does protect the server from having to provide too much processing power. Just drop the connection as soon a
inetd
accepts it if there are already a lot of connections.Proof Of Work - The Onion Services Ecosystem
onionservices.torproject.org