Most active commenters
  • fuzztester(8)
  • gverrilla(4)
  • immibis(3)

←back to thread

The man who killed Google Search?

(www.wheresyoured.at)
1884 points elorant | 54 comments | | HN request time: 0.003s | source | bottom
Show context
gregw134 ◴[] No.40136741[source]
Ex-Google search engineer here (2019-2023). I know a lot of the veteran engineers were upset when Ben Gomes got shunted off. Probably the bigger change, from what I've heard, was losing Amit Singhal who led Search until 2016. Amit fought against creeping complexity. There is a semi-famous internal document he wrote where he argued against the other search leads that Google should use less machine-learning, or at least contain it as much as possible, so that ranking stays debuggable and understandable by human search engineers. My impression is that since he left complexity exploded, with every team launching as many deep learning projects as they can (just like every other large tech company has).

The problem though, is the older systems had obvious problems, while the newer systems have hidden bugs and conceptual issues which often don't show up in the metrics, and which compound over time as more complexity is layered on. For example: I found an off by 1 error deep in a formula from an old launch that has been reordering top results for 15% of queries since 2015. I handed it off when I left but have no idea whether anyone actually fixed it or not.

I wrote up all of the search bugs I was aware of in an internal document called "second page navboost", so if anyone working on search at Google reads this and needs a launch go check it out.

replies(11): >>40136833 #>>40136879 #>>40137570 #>>40137898 #>>40137957 #>>40138051 #>>40140388 #>>40140614 #>>40141596 #>>40146159 #>>40166064 #
JohnFen ◴[] No.40136833[source]
> where he argued against the other search leads that Google should use less machine-learning

This better echoes my personal experience with the decline of Google search than TFA: it seems to be connected to the increasing use of ML in that the more of it Google put in, the worse the results I got were.

replies(3): >>40137620 #>>40137737 #>>40137885 #
1. fuzztester ◴[] No.40137737[source]
Same here with YouTube, assuming they use ML, which is likely.

They routinely give me brain-dead suggestions such as to watch a video I just watched today or yesterday, among other absurdities.

replies(5): >>40138204 #>>40138215 #>>40138255 #>>40139304 #>>40139333 #
2. 998244353 ◴[] No.40138204[source]
For what it's worth, I do not remember a time when YouTube's suggestions or search results were good. Absurdities like that happened 10 and 15 years ago as well.

These days my biggest gripe is that they put unrelated ragebait or clickbait videos in search results that I very clearly did not search for - often about American politics.

replies(5): >>40138761 #>>40139567 #>>40139761 #>>40141227 #>>40143825 #
3. layer8 ◴[] No.40138215[source]
This is happening to me to, but from the kind of videos it's suggested for I suspect that people actually do tend to rewatch those particular videos, hence the recommendation.
4. gverrilla ◴[] No.40138255[source]
YT Shorts recommendations are a joke. I'm an atheist and very rarely watch anything related to religion, and even so Shorts put me in 3 or 4 live prayers/scams (not sure) the last few months.
replies(6): >>40138312 #>>40138566 #>>40138595 #>>40138673 #>>40139142 #>>40141197 #
5. epcoa ◴[] No.40138312[source]
Prayers for the unbelievers makes some sense.

But I associate YouTube promotions with garbage any how. The few things I might buy like Tide laundry detergent are entirely despite occasional YouTube promotion.

replies(1): >>40138772 #
6. delfinom ◴[] No.40138566[source]
I imagine my blocked channels list is stress testing YouTube at this point from the amount of shit Shorts results it's fed me after 2 years. Lol

Besides the religious crap, ill randomly get shit in India in hindu, having had not watched anything Indian and not even remotely Indian.

replies(2): >>40138752 #>>40139285 #
7. dekhn ◴[] No.40138595[source]
Similarly, Google News. The "For You" section shows me articles about astrology because I'm interested in astronomy. I get suggestions for articles about I-80 because I search for I-80 traffic cams to get traffic cam info for Tahoe, but it shows me I-80 news all the way across the country, suggestions about MOuntain View because I worked there (for google!) over 3 years ago, commanders being fired from the Navy (because I read a couple articles once), it goes on and on. From what I can tell, there are no News Quality people actually paying attention to their recommendations (and "Show Fewer" doesn't actually work. I filed a bug and was told that while the desktop version of the site shows Show Fewer for Google News, it doesn't actually have an effect).
replies(1): >>40140310 #
8. bitwize ◴[] No.40138714{3}[source]
That's a feature, not a bug.
9. gverrilla ◴[] No.40138752{3}[source]
I only get those when it's new content with <20 likes and they are testing it out. Doesn't bother me, I like to receive some untested content - even though 99% of it is pure crap (like some random non-sense film with a trendy music on top).
10. peoplenotbots ◴[] No.40138761[source]
Long long time ago; youtube "staff" would manually put certain videos on the top of the front page when they started. Im sure there we're biases and prioritization of marketing dollars but at least there was human recommending it compared to poorly recorded early family guy clips. I dont know when they stopped manually adding "editors/staff" choice videos but I recall some of my favorite early youtubers like CGPGgrey claim that recommendation built the career.
replies(1): >>40139212 #
11. gverrilla ◴[] No.40138772{3}[source]
Lmao. I'm very positive that the conversion rate for placing an atheist in a live mass out of the blue is very very very low. Because I never stayed for more than 3 seconds, I'm not sure if it's real religious content or a scam, though - and they don't even let me report live shorts :(
replies(1): >>40140316 #
12. AlexCoventry ◴[] No.40139142[source]
YT Shorts itself is kind of a mystery to me. It's an objective degradation of the interface; why on earth would I want to use it? It doesn't even allow adjustment of the playback speed or scrubbing!
replies(4): >>40139268 #>>40139586 #>>40139877 #>>40140765 #
13. superluserdo ◴[] No.40139212{3}[source]
See this >15-year-old video "How to get featured on YouTube" - https://www.youtube.com/watch?v=-uzXeP4g_qA, which I remember as being originally uploaded to the official Youtube channel but looks like it's been removed now, this reupload is from October 2008.
14. fuzztester ◴[] No.40139268{3}[source]
Solid point. Not to mention that Shorts content is mainly linkbait and/or garbage.
15. fuzztester ◴[] No.40139285{3}[source]
>in hindu

Hindi is the word for the language, bro.

replies(1): >>40139422 #
16. makeitdouble ◴[] No.40139304[source]
I think it's probably pushing pattern it sees in other users.

There's videos I'll watch multiple times, music videos are the obvious kind, but for some others I'm just not watching/understanding it the first time and will go back and rewatch later.

But I guess youtube has no way to understand which one I'll rewatch and which other I don't want to see ever again, and if my behavior is used as training data for the other users like you, they're probably screwed.

replies(1): >>40139364 #
17. sakesun ◴[] No.40139333[source]
Install "Unhook" chrome extension. That changed my life.
18. godshatter ◴[] No.40139364[source]
A simple "rewatch?" line along the top would make this problem not so brain dead bad, imho. Without it you just think the algorithm is bad (although maybe it is? I don't know).
19. etc-hosts ◴[] No.40139422{4}[source]
I knew I could count on you.
replies(1): >>40140297 #
20. FullstakBlogger ◴[] No.40139567[source]
15 years ago, I used to keep many tabs of youtube videos open just because the "related" section was full of interesting videos. Then each of those videos had interesting relations. There was so much to explore before hitting a dead-end and starting somewhere else.

Now the "related" section is gone in favor of "recommended" samey clickbait garbage. The relations between human interests are too esoteric for current ML classifiers to understand. The old Markov-chain style works with the human, and lets them recognize what kind of space they've gotten themselves into, and make intelligent decisions, which ultimately benefit the system.

If you judge the system by the presence of negative outliers, rather than positive, then I can understand seeing no difference.

replies(2): >>40140561 #>>40141829 #
21. barnabyjones ◴[] No.40139586{3}[source]
I think there is a large demo of people now who actually prefer to watch videos in portrait.
replies(2): >>40140605 #>>40141429 #
22. Narishma ◴[] No.40139761[source]
I do remember when Youtube would show more than 2 search results per page on my 23" display.

Or when they would show more than 3 results before spamming irrelevant videos.

Or when they didn't show 3 unskippable ads in a 5 minute video.

Or when they had a dislike button so you would know to avoid wasting time on low quality videos.

replies(2): >>40140281 #>>40141257 #
23. minetest2048 ◴[] No.40139877{3}[source]
You can scrub on the mobile player, that's what makes it so much frustrating because you can't do that on desktop
replies(1): >>40140267 #
24. fuzztester ◴[] No.40140267{4}[source]
What does scrubbing mean in this context? Blocking the Shorts?
replies(2): >>40140405 #>>40140435 #
25. WWLink ◴[] No.40140281{3}[source]
> I do remember when Youtube would show more than 2 search results per page on my 23" display.

Wait what?! You "Consume Content" on a COMPUTER? What are you some kinda grandpa? Why aren't you consuming content from your phone like everyone else? Or casting it from your phone to your SMART TV! Great way to CONSUME CONTENT!

CONSUME CONTENT CONSUME CONTENT CONSUME CONTENT CONSUME CONTENT CONSUME CONTENT CONSUME CONTENT CONSUME CONTENT CONSUME CONTENT CONSUME CONTENT

replies(2): >>40140566 #>>40140568 #
26. fuzztester ◴[] No.40140297{5}[source]
You bet. Think nought of it. We gave the world zero, after all. Even computers owe us. ;)

https://en.m.wikipedia.org/wiki/0

27. WWLink ◴[] No.40140310{3}[source]
Part of the reason I switched from google to duckduckgo for searching was I didn't WANT "personalization" I want my search results to be deterministic. If I am in Seattle and search for "ducks" I want the exact fucking same search results as if I travel to Rio de Janeiro and search for "ducks".

Honestly, I'd prefer my voice assistant (siri mostly) to be like that as well. It was at first, and I think everyone hated that lol.

28. BuyMyBitcoins ◴[] No.40140316{4}[source]
“Conversion rate”. I’m not sure if you intended that pun but it’s pretty good.
29. mondobe ◴[] No.40140405{5}[source]
Seeking to a certain part of the video. On mobile, you can do it by dragging the progress bar at the bottom of the screen.
30. nevster ◴[] No.40140435{5}[source]
Scrubbing means quickly moving the current playback position back and forward
31. Aerroon ◴[] No.40140561{3}[source]
>The relations between human interests are too esoteric for current ML classifiers to understand.

I would go further and say that it is impossible. Human interests are contextual and change over time, sometimes in the span of minutes.

Imagine that all the videos on the internet would be on one big video website. You would watch car videos, movie trailers, listen to music, and watch porn in one place. Could the algorithm correctly predict when you're in the mood for porn and when you aren't? No, it couldn't.

The website might know what kind of cars, what kind of music, and what kind of porn you like, but it wouldn't be able to tell which of these categories you would currently be interested in.

I think current YouTube (and other recommendation-heavy services) have this problem. Sometimes I want to watch videos about programming, but sometimes I don't. But the algorithm doesn't know that. It can't know that without being able to track me outside of the website.

replies(3): >>40141005 #>>40141819 #>>40192374 #
32. skydhash ◴[] No.40140566{4}[source]
Lol, Youtube on Apple TV is great. Mostly because I either need to find something fast or I switch it off because the remote is not conducive to skipping. But the only time I watch Youtube on my computer is for a specific video. The waste of space is horrendous. Same with Twitter (rarely visited), just a 3/4 inches wide column of posts on my 24 inch screen.
33. Aerroon ◴[] No.40140568{4}[source]
I'm not consuming the content on my phone, because the user experience of using these services on my phone sucks. Just the app vs website difference with urls is a difference in behavior I hate let alone all the UI differences that make the mobile experience awkward.

I don't know about the TV though.

34. skydhash ◴[] No.40140605{4}[source]
If you’re watching a single subject of interest video on your phone (TikTok type of content), it’s great. But landscape videos is more pleasant and there’s a reason we move from 4:3 for media. But that actually means watching the videos, but what I see is a lot of skipping.
replies(1): >>40192455 #
35. kmeisthax ◴[] No.40140765{3}[source]
So, there's a few ways to explain it. From a business strategy level, TikTok exists, and is a threat to YouTube, so we need to compete with it.

From a user perspective, Shorts highlights a specific format of YouTube that happened to have been around for a lot longer than people realize. TikTok isn't anything new, Vine was doing exactly the same thing TikTok was a decade prior. It was shut down for what I can only assume was really dumb reasons. A lot of Viners moved to YouTube, but they had to change their creative process to fit what the YouTube algorithm valued at the time: longer videos.

Pre-Shorts, there really wasn't a good place on YouTube for short videos. Animators were getting screwed by the algorithm because you really can't do daily uploads of animation[0] and whatever you upload is going to be a few minutes max. A video essayist can rack up hundreds of thousands of hours of watch time while you get maybe a thousand.

(Fun fact: YouTube Shorts status was applied retroactively to old short videos, so there's actually Shorts that are decades old. AFAIK, some of the Petscop creator's old videos are Shorts now.)

But that's why users or creators would want to use Shorts. A lot of the UX problems with Shorts boils down to YouTube building TikTok inside of YouTube out of sheer corporate envy. To be clear, they could have used the existing player and added short-video features on top (e.g. swipe-to-skip). In fact, any Short can be opened in the standard player by just changing the URL! There's literally no difference other than a worse UI because SOMEONE wanted "launched a new YouTube vertical" on their promo packet!

FWIW the Shorts player is gradually getting its missing features back but it's still got several pain points for me. One in particular that I think exemplifies Shorts: if I watch Shorts on a portrait 1080p monitor - i.e. the perfect thing to watch vertical video on - you can't see comments. When you open the comments drawer it doesn't move over enough and the comments get cut off. The desktop experience is also really bad; occasionally scrolling just stops working, or it skips two videos per mousewheel event, or one video will just never play no matter how much I scroll back and forth.

[0] Vtubers don't count

replies(1): >>40269296 #
36. FullstakBlogger ◴[] No.40141005{4}[source]
>I would go further and say that it is impossible. Human interests are contextual and change over time, sometimes in the span of minutes.

Theres a general problem in the tech world where people seem to inexplicably disregard the issue of non-reducibility. The point about the algorithm lacking access to necessary external information is good.

A dictionary app obviously can't predict what word I want to look up without simulating my mind-state. A set of probabilistic state transitions is at least a tangible shadow of typical human mind-states who make those transitions.

37. alovelace ◴[] No.40141197[source]
Just because you're an atheist doesn't mean you won't engage with religious content though. YT rewards all kinds of engagement not just positive ones. I.e. if you leave a snide remark or just a dislike on a religious short that still counts as engagement.
replies(1): >>40143636 #
38. alovelace ◴[] No.40141227[source]
It all depends on your use case but a lot of people seem to be in agreement it fell off in the mid to late 10s and the suggestions became noticeably worse.
39. throwaway2037 ◴[] No.40141257{3}[source]

    > Or when they didn't show 3 unskippable ads in a 5 minute video.
On desktop Chrome, a modern ad-blocking browser extension will block 100% of YouTube adverts. I haven't watched one, literally, in years. I don't watch YouTube from a mobile phone, but I think the situation is different. (Can anyone else comment about the mobile experience?)
replies(1): >>40141695 #
40. watwut ◴[] No.40141429{4}[source]
I dont mind portrait. I mind inability to jump forward in the video.
41. snickerer ◴[] No.40141695{4}[source]
On Android devices I use the app PipePipe to avoid the YouTube ad hell. I recommend it.

I also use Firefox for Android, which has Addon support. Ublock Origin works on the phone and disables a a lot of the ad horror.

replies(1): >>40150822 #
42. nox101 ◴[] No.40141819{4}[source]
I think there are things they could do and that ML could maybe help?

* They could let me directly enter my interests instead of guessing

* They could classify videos by expertise (tags or ML) and stop recommending beginner videos to someone who expresses an interest in expert videos.

* They could let me opt out of recommending videos I've already watched

* They could separate sites into larger categories and stop recommending things not in that category. For me personally, when I got to youtube.com I don't want music but 30-70% of the recommendations are for music. If the split into 2 categories (videos.youtube.com - no music) and (music.youtube.com - only music) they'd end up recommending far more to me that I'm actually interested in at the time. They could add other broad categories like (gaming.youtube.com, documentaries.youtube.com, science.youtube.com, cooking.youtube.com, ...., as deep as they want). Classifying a video could be ML or creator decided. If you're only allowed one category they would be incentive to not mis-classify. If they need more incentive they could dis-recommend your videos if you mis-classify too many/too often).

* They could let me mark videos as watched and actually track that the same as read/unread email. As it is, if you click "not interested -> already watched" they don't mark the video as visibly watched (the red bar under the video). Further, if you start watching again you lose the red-bar (it gets reset to your current position). I get that tracking where you are in a video is something that's different for email vs video but at the same time (1) if I made it to 90% of the way through then for me at least, that's "watched" - same as "read" for email and I'd like it "archived" (don't recommend this to me again) even if I start watching it again (same as reading an email marked as "read)

replies(1): >>40142586 #
43. rvba ◴[] No.40141829{3}[source]
They probably optimize your engagement NOW - with clickbaity videos. So their KPIs show big increases. But in long term you realize that what you watch is garbage and stop watching alltogether.

Someone probably changed the engine that shows videos for you - exactly as with search.

replies(1): >>40149937 #
44. fuzztester ◴[] No.40142586{5}[source]
Those are some good suggestions, particularly the first one:

>let me directly enter my interests

replies(1): >>40192451 #
45. gverrilla ◴[] No.40143636{3}[source]
Yes I know, not the case, and before you ask, I also don't engage with atheist videos. But that's only one example: the recommendations are really bad in a lot of ways for me.
46. pfannkuchen ◴[] No.40143825[source]
YouTube seems to treat popular videos as their own interest category and it’s very aggressive about recommending them if you show any interest at all. If you watch even one or two popular videos (like in the millions of views), suddenly the quality of the recommendations drops off a cliff, since it is suggesting things that aren’t relevant to your interest categories, it’s just suggesting popular things.

If I entirely avoid watching any popular videos, the recommendations are quite good and don’t seem to include anything like what you are seeing. If I don’t entirely avoid them, then I do get what you are seeing (among other nonsense).

47. astrange ◴[] No.40149937{4}[source]
I have to say, all my YouTube recommendations are good and they're rarely clickbait. If you sign out they're pretty bad though.
48. fuzztester ◴[] No.40150822{5}[source]
>PipePipe

It feels a bit funny asking this, since we're talking about Google (i.e. YouTube), but did you mean ;) PipeTube? I know there is a PeerTube too.

replies(1): >>40156732 #
49. snickerer ◴[] No.40156732{6}[source]
I don't know PipeTube. I meant PipePipe, which works well for me: https://github.com/InfinityLoop1308/PipePipe
50. immibis ◴[] No.40192374{4}[source]
you can click one of the ML-selected categories at the top of your homepage to tell it what you'd like to see today
51. immibis ◴[] No.40192451{6}[source]
YouTube has this feature
replies(1): >>40302975 #
52. immibis ◴[] No.40192455{5}[source]
Landscape videos were more pleasant on landscape screens, which are rarely used now, so they aren't more pleasant now.
53. AlexCoventry ◴[] No.40269296{4}[source]
Thanks, that was helpful.
54. fuzztester ◴[] No.40302975{7}[source]
Where in the menu is it? I admit I have not checked out YouTube menus or features much.