←back to thread

420 points rvz | 9 comments | | HN request time: 0.418s | source | bottom
Show context
pfraze ◴[] No.41412758[source]
Copying over my latest backend status update; figure folks would find it interesting

Servers are holding up so far! Fortunately we were overprovisioned. If we hit 4mm new signups then things should get interesting. We did have some degradations (user handles entering an invalid state, event-stream crashed a couple times, algo crashed a couple times, image servers hit bad latencies) but we managed to avoid a full outage.

We use an event-sourcing model which is: K/V database for primary storage (actually sqlite), into a golang event stream, then into scylladb for computed views. Various separate services for search, algorithms, and images. Hybrid on-prem & cloud. There are ~20 of the k/v servers, 1 event-stream, 2 scylla clusters (I believe).

The event-stream crash would cause the application to stop making progress on ingesting events, but we still got the writes, so you'd see eg likes failing to increment the counter but then magically taking effect 60 seconds later. Since the scylla cluster and the KV stores stayed online, we avoided a full outage.

replies(9): >>41412984 #>>41413343 #>>41413506 #>>41413569 #>>41415242 #>>41415812 #>>41416225 #>>41417516 #>>41417547 #
pcwalton ◴[] No.41413569[source]
It's frustrating that anything related to X/Twitter is such a predictably-partisan tinderbox because this is really interesting technical information. Thank you for sharing it!
replies(1): >>41414443 #
kstenerud ◴[] No.41414443[source]
It's partisan/political because Musk is partisan/political. And it's not just Musk.

We've been living in a fantasy land of "no political affiliation" in the tech world for decades, and now that the age of the hyper-rich has come once again, they are realizing the benefits of using the power they wield to shape the worlds they live in.

So now in the early stages of this century's great fight, we'll see our beloved tech giants join the political fray in full force, dragging their follower armies along for the ride.

And it works, too. Just look at the comments here.

replies(9): >>41414549 #>>41414566 #>>41414571 #>>41414596 #>>41414987 #>>41415229 #>>41415701 #>>41416661 #>>41417566 #
kstenerud ◴[] No.41415229[source]
Looking at the responses, I can see that people are still viewing this through the limited lens of left vs right.

This is of course a thing in that nobody can hide their colors anymore, but I'm specifically talking about the rich now feeling empowered enough that they even have the hubris to challenge governments of the world for their own benefit, and in some cases even build their own empires to escape the limitations of governments by forming their own rich-people-only worlds.

For example: https://www.nytimes.com/2024/08/28/magazine/prospera-hondura...

So long as you continue fighting left vs right, you're fighting the wrong enemy.

replies(5): >>41415279 #>>41415586 #>>41415752 #>>41415757 #>>41416519 #
mikrotikker ◴[] No.41415279[source]
Free speech is all that matters. Musk is not perfect by any means here but he is better than the rest. He is exporting the 1st amendment to us nations who don't get to experience such freedoms. Which is what Twitter should have been doing, instead of kowtowing to the likes of the German and Saudi govts among others...
replies(6): >>41415431 #>>41415520 #>>41415528 #>>41415655 #>>41415806 #>>41415996 #
1. kstenerud ◴[] No.41415528[source]
Free speech is a dog whistle. We can't have actual "free speech" in the pure sense of the term (just like we can't have pure democracy) because it would erode public confidence and destroy our democratic nations in the process.

And there are outside actors currently working hard to ensure that this happens, because they want a return to the old imperial world order (where powerful nations capture territory and expand, and weaker nations die at their hands and are colonized).

replies(4): >>41415591 #>>41415595 #>>41415630 #>>41417100 #
2. FollowingTheDao ◴[] No.41415591[source]
> Free speech is a dog whistle. We can't have actual "free speech" in the pure sense of the term

If you are in the U.S I am sorry you have this take on free speech, because it is distorted.

Free speech is defined by law and the law is clear. Freedom of speech means the free and public expression of opinions without censorship, interference and restraint by the government.

replies(1): >>41417534 #
3. klrmvn ◴[] No.41415595[source]
It is sad that free speech became a dog whistle. Post WW2 up to at least 2000 free speech was a strong position of the left, Noam Chomsky being one of the most prominent examples.

Musk isn't hard right. There is a lot of overlap positions between him and Bill Clinton (the original one from the 1990s, I do not know what he says now), except that Musk is anti-war and obviously talks like he was on Usenet.

I can't understand that software engineers, who vigorously defended free speech and also the somewhat trollish communication style up to at least 2010, came to be assimilated and reprogrammed by their employers.

Even Zuckerberg now backpedals and says that Covid censorship and suppression of the Hunter Biden laptop story was a mistake.

replies(3): >>41415653 #>>41416042 #>>41416700 #
4. klrmvn ◴[] No.41415630[source]
The Soviet Union supported anti war, peace protests and free speech in leftist groups, but most of it was organic.

Russia purportedly supports free speech right wing groups, though I think the problem is vastly overstated in order to discredit them. Most of this is organic,too.

Whatever is the case, left or right, we cannot let our own beliefs be dictated by whatever Russia supports or co-opts at any given time. Similarly, vegetarians should not abolish their beliefs just because a notorious 20th century dictator was also a vegetarian.

5. kstenerud ◴[] No.41415653[source]
> Even Zuckerberg now backpedals and says that Covid censorship and suppression of the Hunter Biden laptop story was a mistake.

It's easy to say with the benefit of hindsight what was a mistake and what was not. Some things need to be censored - that's how it's always been. The question, of course, is WHAT needs to be censored, HOW MUCH it needs to be censored, HOW it should be censored, and WHO decides.

In the old days, it was easy: If it wasn't on prime time (TV, major newspapers, syndicated radio), it didn't exist. And this cabal served us well, providing a small number of voices to tell people who they were and what to believe.

Now with a potentially unlimited number of voices going up and down in popularity with unprecedented speed and across nations, we're headed into unknown territory, so there are going to be a lot of mistakes, and nobody can know for sure if our nations can even survive it.

replies(1): >>41416360 #
6. okr ◴[] No.41416042[source]
Because they are old and have families now. Metoo and toxic behaviours did the rest. And, it is just not that important.

For me, Musk/Trump is indeed fresh trollish air in all this seriousness and iam astounded, that no one else enjoys it. But i also have the feeling, it is a last breath before police state takes over. Because a state can not allow its citizen to go rogue.

7. bluescrn ◴[] No.41416360{3}[source]
> Some things need to be censored - that's how it's always been.

No. There are very few things that 'need to be censored' by the government (or corporations with almost government-level power), and it's hard to think of any beyond CSAM or legitimate threats to national security.

On the other hand, there are a lot of things that children should be protected from. But we're failing miserably at that. They're watching extreme porn and gore while the censors are focusing on silencing adults with the wrong political views.

8. idunnoman1222 ◴[] No.41417100[source]
Ah yes, free speech: the final death knoll of western democracy.
9. bigstrat2003 ◴[] No.41417534[source]
That is untrue and a very frustrating error (because it's so common). Freedom of speech is an ideal that one should be able to speak their mind without retaliation. The First Amendment is the law which guarantees freedom of speech with respect to the government. The two are not the same, and private actors can (and often do) violate freedom of speech.