Some website hosts are having issues with scrapers hammering their sites. Below are tools and information that they are using to combat this:

https://en.wikipedia.org/wiki/Tarpit_(networking)#Anti-AI_tarpits

https://vercel.com/blog/the-rise-of-the-ai-crawler

https://zadzmo.org/code/nepenthes/

https://anubis.techaro.lol/

Some website hosts are having issues with scrapers hammering their sites. Below are tools and information that they are using to combat this:

https://en.wikipedia.org/wiki/Tarpit_(networking)#Anti-AI_tarpits

https://vercel.com/blog/the-rise-of-the-ai-crawler

https://zadzmo.org/code/nepenthes/

https://anubis.techaro.lol/