←back to thread

Sourcegraph went dark

(eric-fritz.com)
424 points kaycebasques | 2 comments | | HN request time: 0.68s | source
Show context
MzHN ◴[] No.41298043[source]
They also recently(?) silently destroyed[1] their public search index at sourcegraph.com/search. Since GitHub only recently got a working search and even that is behind login, I used to search a lot using Sourcegraph. It even supported searching GitLab.

Now it seems that all GitLab repos are gone from the index and a huge number of GitHub repos as well. If I can't trust the search I'll just have no choice but to fall back to GitHub.

It's a shame since their index was at some point even better than GitHub's own, although GitHub seems to have caught up.

[1] https://community.sourcegraph.com/t/most-public-repos-no-lon...

replies(2): >>41298091 #>>41298516 #
sqs ◴[] No.41298516[source]
We still have tons of repositories searchable at https://sourcegraph.com/search, almost a million. We did cull lots of non-GitHub repositories and repositories with less star. It was very complex to keep up with millions of repositories due to GitHub rate limits and scaling. We tried to keep as many as possible while still being able to focus on making a good product for customers (our biggest customer has ~600k repositories).

We're still spending millions of dollars annually to offer public code search, so our intent is certainly not to "destroy" it! If you have repositories you want us to add that are below the star threshold, please post at https://community.sourcegraph.com/t/most-public-repos-no-lon....

replies(4): >>41298765 #>>41299440 #>>41302898 #>>41303125 #
1. IceWreck ◴[] No.41302898[source]
> (our biggest customer has ~600k repositories

I'm wondering what kind of company has (or needs) 600k repos.

replies(1): >>41303841 #
2. meepmorp ◴[] No.41303841[source]
I assume that's 600k repos tracked, not necessarily owned, by the customer. Which is still a lot, but to me seemed a more likely reading.