←back to thread

420 points rvz | 5 comments | | HN request time: 0s | source
Show context
pfraze ◴[] No.41412758[source]
Copying over my latest backend status update; figure folks would find it interesting

Servers are holding up so far! Fortunately we were overprovisioned. If we hit 4mm new signups then things should get interesting. We did have some degradations (user handles entering an invalid state, event-stream crashed a couple times, algo crashed a couple times, image servers hit bad latencies) but we managed to avoid a full outage.

We use an event-sourcing model which is: K/V database for primary storage (actually sqlite), into a golang event stream, then into scylladb for computed views. Various separate services for search, algorithms, and images. Hybrid on-prem & cloud. There are ~20 of the k/v servers, 1 event-stream, 2 scylla clusters (I believe).

The event-stream crash would cause the application to stop making progress on ingesting events, but we still got the writes, so you'd see eg likes failing to increment the counter but then magically taking effect 60 seconds later. Since the scylla cluster and the KV stores stayed online, we avoided a full outage.

replies(9): >>41412984 #>>41413343 #>>41413506 #>>41413569 #>>41415242 #>>41415812 #>>41416225 #>>41417516 #>>41417547 #
pcwalton ◴[] No.41413569[source]
It's frustrating that anything related to X/Twitter is such a predictably-partisan tinderbox because this is really interesting technical information. Thank you for sharing it!
replies(1): >>41414443 #
kstenerud ◴[] No.41414443[source]
It's partisan/political because Musk is partisan/political. And it's not just Musk.

We've been living in a fantasy land of "no political affiliation" in the tech world for decades, and now that the age of the hyper-rich has come once again, they are realizing the benefits of using the power they wield to shape the worlds they live in.

So now in the early stages of this century's great fight, we'll see our beloved tech giants join the political fray in full force, dragging their follower armies along for the ride.

And it works, too. Just look at the comments here.

replies(9): >>41414549 #>>41414566 #>>41414571 #>>41414596 #>>41414987 #>>41415229 #>>41415701 #>>41416661 #>>41417566 #
nox101 ◴[] No.41414596[source]
so strange for you to blame this on Musk. Twitter was already super partisan long before he took it over
replies(3): >>41414616 #>>41414672 #>>41415420 #
JumpCrisscross ◴[] No.41414616[source]
> Twitter was already super partisan long before he took it over

Sure. But Elon changed teams. He used to be bipartisan. But he chose a champion in the aftermath of Covid and--by the looks of it--he's chosen a bad one.

(In an alternate universe where Musk stuck to what he's good at, I could see the entire Artemis programme being delegated to SpaceX and a bipartisan adoption of Tesla as America's EV standard bearer. Instead, there is real political capital in creating a rival to SpaceX. And Tesla is going to have to constantly be on the defence against cheap Chinese imports from the Democrats and establishment Republicans.)

replies(4): >>41414695 #>>41414984 #>>41415488 #>>41415814 #
pfannkuchen ◴[] No.41414695{3}[source]
I think people see Musk differently from how he actually is. Or at least how he sees himself.

He has always said, for many years, that he got into SpaceX to work towards the goal of making humans a multiplanetary species, and he got into electric cars to work towards the goal of having a sustainable energy society.

I think he legitimately believes that “the woke mind virus” is an existential threat to our society, and if that threat isn’t addressed then the other goals don’t matter because society will collapse before they can be realized.

From a near term business perspective his political actions are dumb, but from a personal motivation perspective they make total sense.

Or in other words, Musk is primarily driven by a savior complex, not greed (which is unfortunate for investors).

replies(6): >>41414719 #>>41414836 #>>41414915 #>>41415329 #>>41415787 #>>41416745 #
JumpCrisscross ◴[] No.41414719{4}[source]
> he legitimately believes that “the woke mind virus” is an existential threat to our society

Sure. I don't think he's a hypocrite. He has, however, hyper fixated on a topic that's in vogue in tech circles but totally irrelevant elsewhere.

Unlike in technology, where one can credibly fail upwards, doing that in politics comes at the cost of influence. And in this block order we're seeing, tangibly, the consequences of Elon Musk's deteriorating influence.

replies(3): >>41414884 #>>41414973 #>>41415560 #
jokethrowaway ◴[] No.41415560{5}[source]
The reason I don't move to the USA is because of woke people, scary numbers of mental health and crime.

The reason I moved country is because woke politics is making life worse. Crime is through the roof, kids can't go out in the cities by themselves because it's too dangerous. They started doing mandatory "gender identity" education in school, teaching crap to my kids.

I'm still in Europe and observing a progressive decline so I'm ready to move to Asia, the Caribbean, South America (Argentina maybe?) or maybe switch to the enemy and go to Russia or China, depending on how the situation evolves.

Dictatorship for dictatorship, I just want a low tax, safe place and governments to bother me as little as possible.

replies(2): >>41416337 #>>41426360 #
1. johnisgood ◴[] No.41416337{6}[source]
Some countries in Eastern Europe actively opposes gender stuff (it is banned in education). I do not know why "gender" is being asked in the first place, it should be "sex", and that is biological. Why do we ask for gender on websites, for example? What is the purpose of it, really?
replies(1): >>41424830 #
2. ben_w ◴[] No.41424830[source]
> Why do we ask for gender on websites, for example? What is the purpose of it, really?

I can only think of two reasons:

1) Localised messages to and from the user. Not every language supports gender-neutral singular "you/they".

2) Demographic tracking e.g. for advertising: I've been given unskippable ads on YouTube for sanitary pads, and have forgotten which ad network presented me with one for dick pills.

replies(1): >>41434646 #
3. johnisgood ◴[] No.41434646[source]
Hmm, are you sure about the localized messages? They typically use 'you' instead of third-person pronouns like 'he' or 'she.'
replies(1): >>41438905 #
4. ben_w ◴[] No.41438905{3}[source]
85% sure: the claim here was that there are some languages where "you" itself comes in masculine and feminine forms. I'm told this applies to Hebrew and Arabic — אתה and את — but my ability to confirm this is limited to googling wiktionary.

85% is mainly how much I trust the sources: my experience has been kind of factoid is often true, but sometimes turns out to be "this source sounds like it means X, but actually it means Y" or worse "we made it up and you'll never check".

That said, I ought to have written "I can only think of two *good* reasons", because the third reason is "whenever anyone makes a database of people, we automatically add gender without even thinking about it".

replies(1): >>41444179 #
5. johnisgood ◴[] No.41444179{4}[source]
Wouldn't asking for "sex" suffice though? What happens when someone picks "none of the above" or "prefer not to answer"?