←back to thread

420 points rvz | 1 comments | | HN request time: 0.207s | source
Show context
pfraze ◴[] No.41412758[source]
Copying over my latest backend status update; figure folks would find it interesting

Servers are holding up so far! Fortunately we were overprovisioned. If we hit 4mm new signups then things should get interesting. We did have some degradations (user handles entering an invalid state, event-stream crashed a couple times, algo crashed a couple times, image servers hit bad latencies) but we managed to avoid a full outage.

We use an event-sourcing model which is: K/V database for primary storage (actually sqlite), into a golang event stream, then into scylladb for computed views. Various separate services for search, algorithms, and images. Hybrid on-prem & cloud. There are ~20 of the k/v servers, 1 event-stream, 2 scylla clusters (I believe).

The event-stream crash would cause the application to stop making progress on ingesting events, but we still got the writes, so you'd see eg likes failing to increment the counter but then magically taking effect 60 seconds later. Since the scylla cluster and the KV stores stayed online, we avoided a full outage.

replies(9): >>41412984 #>>41413343 #>>41413506 #>>41413569 #>>41415242 #>>41415812 #>>41416225 #>>41417516 #>>41417547 #
pcwalton ◴[] No.41413569[source]
It's frustrating that anything related to X/Twitter is such a predictably-partisan tinderbox because this is really interesting technical information. Thank you for sharing it!
replies(1): >>41414443 #
kstenerud ◴[] No.41414443[source]
It's partisan/political because Musk is partisan/political. And it's not just Musk.

We've been living in a fantasy land of "no political affiliation" in the tech world for decades, and now that the age of the hyper-rich has come once again, they are realizing the benefits of using the power they wield to shape the worlds they live in.

So now in the early stages of this century's great fight, we'll see our beloved tech giants join the political fray in full force, dragging their follower armies along for the ride.

And it works, too. Just look at the comments here.

replies(9): >>41414549 #>>41414566 #>>41414571 #>>41414596 #>>41414987 #>>41415229 #>>41415701 #>>41416661 #>>41417566 #
kstenerud ◴[] No.41415229[source]
Looking at the responses, I can see that people are still viewing this through the limited lens of left vs right.

This is of course a thing in that nobody can hide their colors anymore, but I'm specifically talking about the rich now feeling empowered enough that they even have the hubris to challenge governments of the world for their own benefit, and in some cases even build their own empires to escape the limitations of governments by forming their own rich-people-only worlds.

For example: https://www.nytimes.com/2024/08/28/magazine/prospera-hondura...

So long as you continue fighting left vs right, you're fighting the wrong enemy.

replies(5): >>41415279 #>>41415586 #>>41415752 #>>41415757 #>>41416519 #
AnonymousPlanet ◴[] No.41415586[source]
As an outsider, I can't help but feel that the American election system that boils everything down to just two parties imposes a limited binary lens onto at least the American view of the world.
replies(5): >>41415615 #>>41415658 #>>41415712 #>>41416370 #>>41416420 #
chipdart ◴[] No.41415658[source]
> As an outsider, I can't help but feel that the American election system that boils everything down to just two parties imposes a limited binary lens onto at least the American view of the world.

I don't think that the American election system holds any relevance to the problem.

The problem is fueling divisiveness to manipulate people with a "us vs them" mentality.

How else can you force working class people to vote against their best interests, such as taxing the rich fairly, ensuring access to affordable health care, uphold basic workers rights, without resorting to blatant fearmongering and moral outrage with bullshit like "they want post-birth abortions, impose sexual abuse in schools, import scary criminal gangs from distant foreign lands, etc"?

Not to mention the industrial level of propaganda dumped by foreign actors to destabilize democratic nations.

replies(1): >>41417251 #
1. thechao ◴[] No.41417251[source]
My wife is a nationally recognized expert in elections in the US. The combination of FPTP and politically controlled district geometry (gerrymandering) explicitly creates a brittle system that engenders extremism. It's well understood to be both the cause and a reinforcement mechanism. The mechanism we have now was left in place in the early 19th c. explicitly to allow a small minority to be able to control their individual states. The main change since then has been cross-state unification of the party system. To give an example: here, in Texas, the most volatile Federal district was won by a representative who received only 10% of the votes in his district. Some districts were won by reps with as few as 1% of the total votes (that's total turnout). (This is due to the primary mechanism and gerrymandering.) If you can win by harnessing just 10% of the electorate, you're shopping around for the ironclad voters, and they tend to have weird views (left or right).