←back to thread

420 points rvz | 5 comments | | HN request time: 0s | source
Show context
pfraze ◴[] No.41412758[source]
Copying over my latest backend status update; figure folks would find it interesting

Servers are holding up so far! Fortunately we were overprovisioned. If we hit 4mm new signups then things should get interesting. We did have some degradations (user handles entering an invalid state, event-stream crashed a couple times, algo crashed a couple times, image servers hit bad latencies) but we managed to avoid a full outage.

We use an event-sourcing model which is: K/V database for primary storage (actually sqlite), into a golang event stream, then into scylladb for computed views. Various separate services for search, algorithms, and images. Hybrid on-prem & cloud. There are ~20 of the k/v servers, 1 event-stream, 2 scylla clusters (I believe).

The event-stream crash would cause the application to stop making progress on ingesting events, but we still got the writes, so you'd see eg likes failing to increment the counter but then magically taking effect 60 seconds later. Since the scylla cluster and the KV stores stayed online, we avoided a full outage.

replies(9): >>41412984 #>>41413343 #>>41413506 #>>41413569 #>>41415242 #>>41415812 #>>41416225 #>>41417516 #>>41417547 #
pcwalton ◴[] No.41413569[source]
It's frustrating that anything related to X/Twitter is such a predictably-partisan tinderbox because this is really interesting technical information. Thank you for sharing it!
replies(1): >>41414443 #
kstenerud ◴[] No.41414443[source]
It's partisan/political because Musk is partisan/political. And it's not just Musk.

We've been living in a fantasy land of "no political affiliation" in the tech world for decades, and now that the age of the hyper-rich has come once again, they are realizing the benefits of using the power they wield to shape the worlds they live in.

So now in the early stages of this century's great fight, we'll see our beloved tech giants join the political fray in full force, dragging their follower armies along for the ride.

And it works, too. Just look at the comments here.

replies(9): >>41414549 #>>41414566 #>>41414571 #>>41414596 #>>41414987 #>>41415229 #>>41415701 #>>41416661 #>>41417566 #
nox101 ◴[] No.41414596[source]
so strange for you to blame this on Musk. Twitter was already super partisan long before he took it over
replies(3): >>41414616 #>>41414672 #>>41415420 #
input_sh ◴[] No.41414672[source]
Who else is there to blame for Twitter refusing to designate a representative, leading to a ban?

I'm sure pre-Musk Twitter wouldn't have lost the entire market in the 7th most populous country.

replies(2): >>41414870 #>>41415296 #
extheat ◴[] No.41414870{3}[source]
There is much more story that you’re either uninformed about or willfully ignoring. The correct move was to remove people from harms way for decisions they have no control over, hence their staff exit from the country.
replies(2): >>41415325 #>>41415343 #
1. ben_w ◴[] No.41415343{4}[source]
The threats were themselves due to failing to follow a court order.

I'm not qualified to tell if the judge giving them is a partisan hack or not, just like I can't make that distinction with the judges that Musk appears to shop for in the US with what others describe as SLAPP lawsuits.

But obeying a judge isn't optional in either case.

replies(1): >>41415844 #
2. luckylion ◴[] No.41415844[source]
> The threats were themselves due to failing to follow a court order.

To the individual representatives of a company? That's very rare, and not common like you make it sound.

"The company you're representing in this legal process hasn't complied with my orders so I will have you personally arrested".

replies(1): >>41416718 #
3. ben_w ◴[] No.41416718[source]
There are various accounts on Twitter which were being investigated etc. for criminal misconduct, Twitter was given a court order to block those accounts. I have no idea if that order was itself justified (IANAL and I don't speak Brazilian) but the orders were given by someone with authority to give them.

Twitter refused the order, which means that Twitter is interfering with the legal process in Brazil. This sounds like "contempt of court" to me, which is a thing which results in a judge sending people to prison — no idea what it is in Brazil, but IIRC the maximum penalty in my country of birth is 2 years' imprisonment.

Brazil's legal system requires companies like Twitter to have an office in the country in order to receive such orders, which I think means it's literally her job to make those orders happen. Regardless, by closing the office Twitter was directly violating Brazilian law.

As companies cannot themselves be imprisoned, I do not see what alternative there would be than directing obligations onto a specific human. Buck has to stop somewhere, and while I know a lot of people who would celebrate if this judge decided that the correct somewhere was "international arrest warrant/request extradition of Elon Musk personally", I suspect this judge would have to go through a few more checkboxes before that doesn't get "major diplomatic incident" written all over it.

(Perhaps less of an incident if it's concurrent with the EU saying "We're issuing Twitter with a 6% fine on their global annual turnover for non-compliance with the Digital Services Act", which seems to be another battle Musk is Leeroy-Jenkins-ing himself into).

replies(1): >>41418539 #
4. luckylion ◴[] No.41418539{3}[source]
I can't think of any country I'd consider having a strong rule of law that would start arresting employees for the actions of their companies that they themselves have no say in.

Effectively, the judge makes it impossible for X to defend itself in court because he'll just have anyone arrested who tries. That's not something you'll find in the developed world these days.

replies(1): >>41419021 #
5. ben_w ◴[] No.41419021{4}[source]
> Effectively, the judge makes it impossible for X to defend itself in court because he'll just have anyone arrested who tries.

No, on two counts.

First, Twitter is free to seek out a lawyer to represent them in court. Most people hire lawyers for contract work rather than as a permanent employee, so this remains possible even with no assets within Brazil.

Second, there was nothing to be defended until they refused to comply with the lawfully given order within the required deadline.

That they chose to fire their staff member and close the office in order to prevent compliance with the lawfully given order, was an actual offence in its own right. To my limited understanding, it is also an offence in its own right to refuse a lawfully given court order. But in both cases, Twitter was not being punished until they actually broke the law.

Courts in the UK and the USA may issue an injunction, both to prohibit and/or to compel an action, and this may bind on people not directly before the court:

https://en.wikipedia.org/wiki/Injunction (note in particular that interim injunctions may be given prior to a ruling on the case itself)

https://en.wikipedia.org/wiki/Injunctions_in_English_law

https://en.wikipedia.org/wiki/Interim_order

https://en.wikipedia.org/wiki/Quia_timet

And, pertinently to Starlink: https://en.wikipedia.org/wiki/Asset_freezing

Compare and contrast Twitter in Brazil with Lavabit in the USA: Lavabit was ordered to provide certain information in secret (with an injunction to not talk about it); they protested, they first provided that information in an obtuse form that was considered contempt, they provided it in a form which was acceptable, then they closed their business in response and took further legal action in response to what they — and, to be clear, I — consider to have been a manner incompatible with the public view of American Democracy:

"""Levison said that he could be arrested for closing the site instead of releasing the information, and it was reported that the federal prosecutor's office had sent Levison's lawyer an email to that effect."""

and

"""Levison wrote that after being contacted by the FBI, he was subpoenaed to appear in federal court, and was forced to appear without legal representation because it was served on such short notice; in addition, as a third party, he had no right to representation, and was not allowed to ask anyone who was not an attorney to help find him one. He also wrote that in addition to being denied a hearing about the warrant to obtain Lavabit's user information, he was held in contempt of court. The appellate court denied his appeal due to no objection, however, he wrote that because there had been no hearing, no objection could have been raised. His contempt of court charge was also upheld on the ground that it was not disputed; similarly, he was unable to dispute the charge because there had been no hearing to do it in."""