We apologize for a period of extreme slowness today. The army of AI crawlers just leveled up and hit us very badly.
The good news: We're keeping up with the additional load of new users moving to Codeberg. Welcome aboard, we're happy to have you here. After adjusting the AI crawler protections, performance significantly improved again.
Aral Balkan reshared this.
Bradley Kuhn
in reply to Codeberg • • •The AI ballyhoo *is* a real DDoS against one of the few code hosting sites that has taken a stand against slurping #FOSS code into LLM training sets — in violation of #copyleft licenses.
This is what lawless & deregulation bring us. ∃ plenty of blame to go around, but #Microsoft & #GitHub deserve the bulk of it as they trailblazed the idea that FOSS code-hosting sites are lucrative targets.
giveupgithub.org
#GiveUpGitHub #FreeSoftware #OpenSource
Give Up GitHub - Software Freedom Conservancy
giveupgithub.orgGabriel Sanches
in reply to Codeberg • • •Alex
in reply to Codeberg • • •Jes - Hedgehog Edition
in reply to Codeberg • • •Shufei 🧮
in reply to Codeberg • • •kajer
in reply to Codeberg • • •Codeberg
in reply to Codeberg • • •Codeberg
in reply to Codeberg • • •Aleksandra Fedorova
in reply to Codeberg • • •"AI crawlers learned how to solve the Anubis challenges"
Why does EU discuss chat control and not AI crawlers control again?
p̷t̵r̴a̵c̷e̶
in reply to Codeberg • • •eBPF could be more effective and easy on the CPU, since it acts on a way lower network layer. Anubis kinda has it's limits and it's way too easy to circumvent (as you found out)
Maybe it's worth it to consider eBPF (if not already happened)
And thanks guys for your work. I'm a proud supporter and I'll continue to support your work. Companies shouldn't control the Open Source space
Sakura | 🅥 |
in reply to Codeberg • • •Akseli
in reply to Codeberg • • •ulveon.net
in reply to Codeberg • • •Anubis is extremely easy to bypass, you just have to change the User-Agent to not contain Mozilla, please get proper bot protection.
ulveon.net/p/2025-08-09-vangua…
This post talks briefly about other alternatives. Try Berghain, Balooproxy, or go-away.
Vanguard (Part 1): Telegram raid protection
Ulveon's Thoughtstanavit
in reply to Codeberg • • •May be would it be possible to use the tool described in :
saturation.social/@clive/11497…
Clive Thompson
2025-08-05 22:37:02
taijidude
in reply to Codeberg • • •