←back to thread

420 points rvz | 2 comments | | HN request time: 1.175s | source
Show context
pfraze ◴[] No.41412758[source]
Copying over my latest backend status update; figure folks would find it interesting

Servers are holding up so far! Fortunately we were overprovisioned. If we hit 4mm new signups then things should get interesting. We did have some degradations (user handles entering an invalid state, event-stream crashed a couple times, algo crashed a couple times, image servers hit bad latencies) but we managed to avoid a full outage.

We use an event-sourcing model which is: K/V database for primary storage (actually sqlite), into a golang event stream, then into scylladb for computed views. Various separate services for search, algorithms, and images. Hybrid on-prem & cloud. There are ~20 of the k/v servers, 1 event-stream, 2 scylla clusters (I believe).

The event-stream crash would cause the application to stop making progress on ingesting events, but we still got the writes, so you'd see eg likes failing to increment the counter but then magically taking effect 60 seconds later. Since the scylla cluster and the KV stores stayed online, we avoided a full outage.

replies(9): >>41412984 #>>41413343 #>>41413506 #>>41413569 #>>41415242 #>>41415812 #>>41416225 #>>41417516 #>>41417547 #
pcwalton ◴[] No.41413569[source]
It's frustrating that anything related to X/Twitter is such a predictably-partisan tinderbox because this is really interesting technical information. Thank you for sharing it!
replies(1): >>41414443 #
kstenerud ◴[] No.41414443[source]
It's partisan/political because Musk is partisan/political. And it's not just Musk.

We've been living in a fantasy land of "no political affiliation" in the tech world for decades, and now that the age of the hyper-rich has come once again, they are realizing the benefits of using the power they wield to shape the worlds they live in.

So now in the early stages of this century's great fight, we'll see our beloved tech giants join the political fray in full force, dragging their follower armies along for the ride.

And it works, too. Just look at the comments here.

replies(9): >>41414549 #>>41414566 #>>41414571 #>>41414596 #>>41414987 #>>41415229 #>>41415701 #>>41416661 #>>41417566 #
wkat4242 ◴[] No.41414987[source]
To be honest with the current polarisation levels in politics it's no longer possible to be neutral. The conservative side is now even strongarming companies into abandoning their diversity programs! This is just really not ok, I'm part of the LGBTIQ+ support network in our company and this kind of thing is really making waves. People are worried, even though we're a Europe based company where this is not a contested topic (though we do have many offices in the US). See what happened to Ford, Jack Daniels, Harley Davidson, and many others. Decades of progress are being thrown out the window.

Many US companies are now feeling forced to choose a side. At least I now know which to boycott..

replies(3): >>41416005 #>>41416522 #>>41416947 #
1. itsoktocry ◴[] No.41416947[source]
>The conservative side is now even strongarming companies into abandoning their diversity programs! This is just really not ok, I'm part of the LGBTIQ+ support network in our company and this kind of thing is really making waves.

Sorry pal, you're going to have to make it on merits, not your gender or skin color.

>See what happened to Ford, Jack Daniels, Harley Davidson, and many others. Decades of progress are being thrown out the window.

Racial quotas in the workplace is not progress.

>At least I now know which to boycott..

Oh, so your boycotts are fine? Classic leftist hypocrisy.

replies(1): >>41418532 #
2. wkat4242 ◴[] No.41418532[source]
> Sorry pal, you're going to have to make it on merits, not your gender or skin color.

I'm not advocating for positive discrimination. Just no discrimination at all.

It's very important to have the proper procedures in place for when that does happen. That was part of the diversity programs. Programs against bullying, education for managers on gender identity and how to deal with the difficulties around them, how to pick up on bullying etc. It's this kind of thing that I do myself (not as a job but as a voluntary side assignment in my job). It's amazing what kind of sexism and racism you hear when you go on a company trip and have a few drinks with high-level managers. So clearly this work is still highly needed.

Don't forget these programs were started because things were going the wrong way, people who were different than the standard cishetero white male had less chance to a job and were making less money when they did get one. This is of course not acceptable.

I don't think quotas are the answer. But rather fines when a company goes too far askew. "We only hire white cristians here" just cannot be acceptable.

> Racial quotas in the workplace is not progress.

That was only one small part of the diversity programs, and not one I necessarily agree with.

> Oh, so your boycotts are fine? Classic leftist hypocrisy.

I never said boycotts are wrong anyway. If right wingers want to boycott companies like Apple, go ahead.