←back to thread

Sourcegraph went dark

(eric-fritz.com)
424 points kaycebasques | 1 comments | | HN request time: 0.2s | source
Show context
MzHN ◴[] No.41298043[source]
They also recently(?) silently destroyed[1] their public search index at sourcegraph.com/search. Since GitHub only recently got a working search and even that is behind login, I used to search a lot using Sourcegraph. It even supported searching GitLab.

Now it seems that all GitLab repos are gone from the index and a huge number of GitHub repos as well. If I can't trust the search I'll just have no choice but to fall back to GitHub.

It's a shame since their index was at some point even better than GitHub's own, although GitHub seems to have caught up.

[1] https://community.sourcegraph.com/t/most-public-repos-no-lon...

replies(2): >>41298091 #>>41298516 #
sqs ◴[] No.41298516[source]
We still have tons of repositories searchable at https://sourcegraph.com/search, almost a million. We did cull lots of non-GitHub repositories and repositories with less star. It was very complex to keep up with millions of repositories due to GitHub rate limits and scaling. We tried to keep as many as possible while still being able to focus on making a good product for customers (our biggest customer has ~600k repositories).

We're still spending millions of dollars annually to offer public code search, so our intent is certainly not to "destroy" it! If you have repositories you want us to add that are below the star threshold, please post at https://community.sourcegraph.com/t/most-public-repos-no-lon....

replies(4): >>41298765 #>>41299440 #>>41302898 #>>41303125 #
1. MzHN ◴[] No.41299440[source]
I appreciate that it is a free service and thank you for the time it worked for me.

At the same time I am a bit sad to see my use cases break. I often resort to more advanced code search when I have really obscure problems, for which the answers might be some old GitHub (or GitLab) repositories. I'm less interested in up-to-date information for those, so a stale index is better than no index for me.

But I can also feel the pain of working with GitHub and GitLab and their rate limits and such.