←back to thread

Cloudflare.com's Robots.txt

(www.cloudflare.com)
145 points sans_souse | 5 comments | | HN request time: 0.638s | source
1. palsecam ◴[] No.42164269[source]
That’s a funny one!

Anyone knows of others like that?

Here is mine: https://FreeSolitaire.win/robots.txt

replies(2): >>42164327 #>>42165802 #
2. jsheard ◴[] No.42164327[source]
Google used to have a /killer-robots.txt which forbid the T-1000 and T-800 from accessing Larry Page and Sergey Brin, but they took that down at some point.
replies(1): >>42165463 #
3. shaunpud ◴[] No.42165463[source]
https://web.archive.org/web/20160530160330/https://www.googl...
4. segphault ◴[] No.42165802[source]
Stripe has a humans.txt: https://stripe.com/humans.txt
replies(1): >>42171443 #
5. ttepasse ◴[] No.42171443[source]
humans.txt is a small scale initiative: https://humanstxt.org/