←back to thread

420 points rvz | 5 comments | | HN request time: 0s | source
Show context
pfraze ◴[] No.41412758[source]
Copying over my latest backend status update; figure folks would find it interesting

Servers are holding up so far! Fortunately we were overprovisioned. If we hit 4mm new signups then things should get interesting. We did have some degradations (user handles entering an invalid state, event-stream crashed a couple times, algo crashed a couple times, image servers hit bad latencies) but we managed to avoid a full outage.

We use an event-sourcing model which is: K/V database for primary storage (actually sqlite), into a golang event stream, then into scylladb for computed views. Various separate services for search, algorithms, and images. Hybrid on-prem & cloud. There are ~20 of the k/v servers, 1 event-stream, 2 scylla clusters (I believe).

The event-stream crash would cause the application to stop making progress on ingesting events, but we still got the writes, so you'd see eg likes failing to increment the counter but then magically taking effect 60 seconds later. Since the scylla cluster and the KV stores stayed online, we avoided a full outage.

replies(9): >>41412984 #>>41413343 #>>41413506 #>>41413569 #>>41415242 #>>41415812 #>>41416225 #>>41417516 #>>41417547 #
pcwalton ◴[] No.41413569[source]
It's frustrating that anything related to X/Twitter is such a predictably-partisan tinderbox because this is really interesting technical information. Thank you for sharing it!
replies(1): >>41414443 #
kstenerud ◴[] No.41414443[source]
It's partisan/political because Musk is partisan/political. And it's not just Musk.

We've been living in a fantasy land of "no political affiliation" in the tech world for decades, and now that the age of the hyper-rich has come once again, they are realizing the benefits of using the power they wield to shape the worlds they live in.

So now in the early stages of this century's great fight, we'll see our beloved tech giants join the political fray in full force, dragging their follower armies along for the ride.

And it works, too. Just look at the comments here.

replies(9): >>41414549 #>>41414566 #>>41414571 #>>41414596 #>>41414987 #>>41415229 #>>41415701 #>>41416661 #>>41417566 #
nox101 ◴[] No.41414596[source]
so strange for you to blame this on Musk. Twitter was already super partisan long before he took it over
replies(3): >>41414616 #>>41414672 #>>41415420 #
JumpCrisscross ◴[] No.41414616[source]
> Twitter was already super partisan long before he took it over

Sure. But Elon changed teams. He used to be bipartisan. But he chose a champion in the aftermath of Covid and--by the looks of it--he's chosen a bad one.

(In an alternate universe where Musk stuck to what he's good at, I could see the entire Artemis programme being delegated to SpaceX and a bipartisan adoption of Tesla as America's EV standard bearer. Instead, there is real political capital in creating a rival to SpaceX. And Tesla is going to have to constantly be on the defence against cheap Chinese imports from the Democrats and establishment Republicans.)

replies(4): >>41414695 #>>41414984 #>>41415488 #>>41415814 #
kshri24[dead post] ◴[] No.41415488{3}[source]
[flagged]
andy_ppp ◴[] No.41415598{4}[source]
I can’t believe people think that the FBI or the Biden and Trump campaigns asking for disinformation to be taken down during an election and the people at Twitter making a call on that request is somehow a smoking gun showing some kind of conspiracy. It’s ridiculous!
replies(1): >>41415652 #
kshri24[dead post] ◴[] No.41415652{5}[source]
[flagged]
1. the_why_of_y ◴[] No.41415817{6}[source]
https://www.techdirt.com/2022/12/07/hello-youve-been-referre...

Firstly, Twitter took that down because it violated their long standing policy against doxxing/posting hacked materials, not for any political reason.

Secondly, Twitter leadership realized very quickly that their policy wasn't really designed for this specific event, and within a day they changed the policy and unblocked the posts that they had blocked.

And now it's 2 years later and uninformed people still bullshit here about election interference and this being a first amendment issue (Twitter is a private company and can block whatever posts it likes).

replies(1): >>41415848 #
2. kshri24 ◴[] No.41415848[source]
> Firstly, Twitter took that down because it violated their long standing policy against doxxing/posting hacked materials, not for any political reason.

That was a BS reason chosen by Twitter. Twitter Files exposed that already. You are late.

> Secondly, Twitter leadership realized very quickly that their policy wasn't really designed for this specific event, and within a day they changed the policy and unblocked the posts that they had blocked.

Yeah you clearly haven't read the Twitter Files. It shows.

> And now it's 2 years later and uninformed people still bullshit here about election interference and this being a first amendment issue.

Because it clearly was and now even Zuckerberg has come out admitting that it was interference.

> (Twitter is a private company and can block whatever posts it likes)

Sure. But if FBI is involved, it does not become a Twitter issue alone but it becomes Government censorship through a private company. That is election interference and a first amendment violation.

replies(1): >>41416295 #
3. the_why_of_y ◴[] No.41416295[source]
> Yeah you clearly haven't read the Twitter Files. It shows.

Oh, the Twitter Files! Oh my, how I haven't read anything related to the Twitter Files!

https://www.youtube.com/watch?v=a597e6Wv_xg

https://www.techdirt.com/2023/04/07/mehdi-hasan-dismantles-t...

https://www.techdirt.com/2023/04/10/after-matt-taibbi-leaves...

https://www.rollingstone.com/politics/politics-news/elon-tru...

https://edition.cnn.com/2022/12/12/tech/twitter-files-yoel-r...

https://www.techdirt.com/2023/01/13/the-anti-twitter-files-j...

https://www.theatlantic.com/ideas/archive/2022/12/twitter-fi...

https://www.thedailybeast.com/twitter-files-hucksters-are-co...

https://www.techdirt.com/2022/12/20/no-the-fbi-is-not-paying...

https://www.cip.uw.edu/2023/08/23/starbird-house-judiciary-c...

replies(1): >>41416935 #
4. kshri24 ◴[] No.41416935{3}[source]
So your reply is to spam a bunch of links from Google Search. Cool!
replies(1): >>41417582 #
5. ◴[] No.41417582{4}[source]