The man who killed Google Search?

Ex-Google search engineer here (2019-2023). I know a lot of the veteran engineers were upset when Ben Gomes got shunted off. Probably the bigger change, from what I've heard, was losing Amit Singhal who led Search until 2016. Amit fought against creeping complexity. There is a semi-famous internal document he wrote where he argued against the other search leads that Google should use less machine-learning, or at least contain it as much as possible, so that ranking stays debuggable and understandable by human search engineers. My impression is that since he left complexity exploded, with every team launching as many deep learning projects as they can (just like every other large tech company has).

The problem though, is the older systems had obvious problems, while the newer systems have hidden bugs and conceptual issues which often don't show up in the metrics, and which compound over time as more complexity is layered on. For example: I found an off by 1 error deep in a formula from an old launch that has been reordering top results for 15% of queries since 2015. I handed it off when I left but have no idea whether anyone actually fixed it or not.

I wrote up all of the search bugs I was aware of in an internal document called "second page navboost", so if anyone working on search at Google reads this and needs a launch go check it out.

Machine learning or not, seo spam sort of killed search. It’s more or less impossible to find real sites by interesting humans these days. Almost all results are Reddit, YouTube, content marketing, or seo spam. And google’s failure here killed the old school blogosphere (medium and substack only slightly count), personal websites, and forums

Same is happening to YouTube as well. Feels like it’s nothing but promoters pushing content to gain followers to sell ads or other stuff because nobody else’s videos ever surface. Just a million people gaming the algorithm and the only winners are the people who devote the most time to it. And by the way, would I like to sign up for their patreon and maybe one of their online courses?

I think a case can be made that the spam problem can be traced all the way back to Google buying Doubleclick.

Its really easy to spot the crap websites that are scaping content-creating websites ... because they monetize by adding ads.

If Google was _only_ selling ads on the search results page, then it could promote websites that are sans ads.

Instead, it is incentivised to push users to websites that contain ads, because it also makes money there.

And that means scraping other sites to slap your ads onto them can be very profitable for the scammers.

We need a Reverse Google search that will weed out the garbage.

https://kagi.com/ de-prioritizes SEO ad sites and also lets you blacklist sites from your search reaults. Never going back to google after trying it

Doesn't seem to be doing great? The example search I got on their home page was 'best headphones' which pretty immediately surfaces http://www.quietheadphones.com/ - which is openly for sale, and also covered in affiliate links.

A bit farther down the page is a 'best headphones for 2020' article.

And this is the example result set they push on the home page to a potential buyer.

You guys pay for this thing?

What are you comparing it against? Do you actually have a better alternative or just having a bad day?

The fact that you tried to pick on 2 of the results for such a generic keyword, show that it's miles ahead of mainstream search engines which are filled with SEO spam.

I tried that same search on Google, duckduckgo, bing, brave, yandex, even yahoo and needless to say the results were pretty much all SEO spam, list-style keywords farming from generic websites such as NYTimes (how tf is NYTimes an authoritive source on purchasing headphones?). Whereas in Kagi you get a wide range of helpful results focused around reviews/enthusiasts/forums, here are some of the results: youtube video reviews, reddit discussion, discussions on sound design forums, a Quora qusetion, the headphones page on best buy, amazon, walmart, etc.

And as the other comment said, Kagi also has life-saving features that empower the user to have control over the search results [0]. As far as I know the only weak point in Kagi (at the moment) is doing more local-focused searches.

Regardless of the quality of results (which mind you, are already quite superior), it'd be still worth paying for if only to support its ad-less search model and help nurture it. Prove that it's a viable model for the sake of the web. For everyone sake. It's a great effort for that alone. Combine both the model and high-quality results and it's the best in class with no one even close.

[0] https://help.kagi.com/kagi/features/website-info-personalize...