←back to thread

Fly.io Postgres cluster down for 3 days, no word from them about it

(webcache.googleusercontent.com)
797 points burnerbob | 8 comments | 20 Jul 23 23:42 UTC | HN request time: 1.083s | source | bottom
Show context
DumbStarbucks ◴[21 Jul 23 02:45 UTC] No.36809439[source]▶
You unfortunately get what you pay for.

AWS is more expensive than God, but I'll be damned if you can't have a throat to choke in less than 10 minutes whenever something like this happens.

replies(4): >>36809597 #>>36809932 #>>36810207 #>>36810334 #
1. orangepurple ◴[21 Jul 23 03:15 UTC] No.36809597[source]▶
AWS support replies back to your messages when they feel like it. Their support is just as shady but they have better uptime for sure
replies(2): >>36809668 #>>36809933 #
2. erulabs ◴[21 Jul 23 03:29 UTC] No.36809668[source]▶
FWIW, our aws enterprise support reps are available 24/7 and usually respond within a few minutes.

But again, you get what you pay for.

replies(1): >>36810069 #
3. sho ◴[21 Jul 23 04:16 UTC] No.36809933[source]▶
No love for AWS, but this isn't true, at least for larger deploys. If you're running enough with them that you have an account manager, they are very good indeed. You can have someone, someone good, on the phone within minutes and they will stay on the line until the issue is sorted.

I recall an incident at my old company where we were under DDOS, it was getting through cloudflare and saturating LBs in some complicated manner (don't recall the exact details) which made it hard for us to fix ourselves. They were on the phone with us for hours, well past midnight their time, helping us sort it out. The downtime sucked, but I was certainly impressed with their truly excellent support.

4. eropple ◴[21 Jul 23 04:40 UTC] No.36810069[source]▶
I was working for a pretty big early AWS customer--one that had realized that for the low low price of all your money you could make DynamoDB scale to some truly massive numbers--and one time when we were having trouble around noon Eastern, a colleague called up our TAM. As he told it, the TAM sounded half-asleep, so my colleague asked if everything was alright.

"I'm in Hawaii on my honeymoon and my backup missed your call, so it escalated."

I probably wouldn't have answered the phone. Granted, that's why I don't do that job. But I have always had a real appreciation for the good TAMs ever since.

replies(2): >>36810163 #>>36810261 #
5. justinclift ◴[21 Jul 23 04:58 UTC] No.36810163{3}[source]▶
Wonder if that marriage lasted though? ;)
6. silisili ◴[21 Jul 23 05:18 UTC] No.36810261{3}[source]▶
Weird, I just begrudgingly went from Postgres to Dynamo because it was so much cheaper. We're not huge scale though, so I'm wondering where the costs start to diverge the other way.
replies(2): >>36811103 #>>36813602 #
7. kadoban ◴[21 Jul 23 07:42 UTC] No.36811103{4}[source]▶
With Dynamo it seems to depend a lot exactly what you're doing. If you're careful about your queries, it's pretty cheap.
8. eropple ◴[21 Jul 23 13:38 UTC] No.36813602{4}[source]▶
This was, 2012 and we were hitting read and write limits regionally.

It was not a wise plan. It did, however, run. Technically.