git.sr.ht is being disrupted by aggressive LLM crawlers.
An aggressive botnet is scraping git.sr.ht to obtain data to train large language models. It has been able to circumvent the defenses we ordinarily deploy to mitigate these botnets, and as a consequence git.sr.ht is unstable. We have taken some aggressive measures to ensure some service remains available, but for the time being we have disabled a large number of routes for the web service to keep the load managable, which will cause disruptions to ordinary users.
(19:00 UTC — Jun 6)Mitigations have been deployed.
The mitigations we deployed are working, for the time being, and we were able to narrow the impact to affect fewer legitimate users. However, some users may still experience issues using git.sr.ht at this time.
(20:45 UTC — Jun 6)