←back to thread

Blocking LLM crawlers without JavaScript

(www.owl.is)
198 points todsacerdoti | 1 comments | 15 Nov 25 23:30 UTC | HN request time: 0.198s | source
Show context
bakigul ◴[16 Nov 25 10:59 UTC] No.45944142[source]▶
Why do people want to block LLM crawlers? Everyone wants to be visible in GPT, Claude, and others, don’t they?
replies(6): >>45944209 #>>45944222 #>>45944288 #>>45944466 #>>45946287 #>>45947378 #
1. saltysalt ◴[16 Nov 25 11:18 UTC] No.45944222[source]▶
Exactly! With many people moving to AI-driven search, if you are not in their indexes you traffic will reduce even further.

And I say this as someone who built a search engine with no AI: I know my audience for that service is very niche, with the vast majority of people using AI search because it's more convenient.