←back to thread

AI companies cause most of traffic on forums

(pod.geraspora.de)
770 points ta988 | 1 comments | 30 Dec 24 14:37 UTC | HN request time: 0.211s | source
Show context
jeffbee ◴[30 Dec 24 16:44 UTC] No.42550920[source]▶
Ironic that there is a dichotomy between Google and Bing with orders of magnitude less traffic than AI organizations, because only Google really has fresh docs. Bing isn't terrible but their index is usually days old. But something like Claude is years out of date. Why do they need to crawl that much?
replies(3): >>42550982 #>>42551146 #>>42551368 #
1. patrickhogan1 ◴[30 Dec 24 17:04 UTC] No.42551146[source]▶
My guess is that when a ChatGPT search is initiated, by a user, it crawls the source directly instead of relying on OpenAI’s internal index, allowing it to check for fresh content. Each search result includes sources embedded within the response.

It’s possible this behavior isn’t explicitly coded by OpenAI but is instead determined by the AI itself based on its pre-training or configuration. If that’s the case, it would be quite ironic.