←back to thread

Anubis Works

(xeiaso.net)
313 points evacchi | 1 comments | | HN request time: 0.201s | source
Show context
pabs3 ◴[] No.43669909[source]
Recently I heard of a site blocking bot requests with a message telling the bot to download the site via Bittorrent instead.

Seems like a good solution to the badly behaved scrapers, and I feel like the web needs to move away from the client-server model towards a swarm model like Bittorrent anyway.

replies(1): >>43670110 #
1. seba_dos1 ◴[] No.43670110[source]
Even if these stupid bots would just learn to clone git repos instead of crawling through GitLab UI pages it would already be helpful.