←back to thread

AWS Lambda Silent Crash – A Platform Failure, Not an Application Bug [pdf]

(lyons-den.com)
115 points nonfamous | 1 comments | 15 Jul 25 01:22 UTC | HN request time: 0s | source
Show context
ceejayoz ◴[15 Jul 25 02:42 UTC] No.44567373[source]▶
I saw this come up on /r/aws a few days back.

This response seemed illuminating:

https://www.reddit.com/r/aws/comments/1lxfblk/comment/n2qww9...

> Looking at (this section)[https://will-o.co/gf4St6hrhY.png], it seems like you're trying to queue up an asyncronous task and then return a response. But when a Lambda handler returns a response, that's the end of execution. You can't return an HTTP response and then do more work after that in the same execution; it's just not a capability of the platform. This is documented behavior: "Your function runs until the handler returns a response, exits, or times out". After you return the object with the message, execution will immediately stop even if other tasks had been queued up.

replies(2): >>44567415 #>>44567675 #
mcflubbins ◴[15 Jul 25 02:49 UTC] No.44567415[source]▶
If this is the case (it might very well be) I do at least find it odd that no one on AWS' side was able to explain this to them.
replies(6): >>44567446 #>>44567457 #>>44567464 #>>44567509 #>>44567669 #>>44569284 #
m3sta ◴[15 Jul 25 03:06 UTC] No.44567509[source]▶
AWS has a lot of employees. Many of them don't know AWS very well.
replies(2): >>44567698 #>>44567748 #
jamesfinlayson ◴[15 Jul 25 04:09 UTC] No.44567748[source]▶
I remember interviewing a guy who worked at Amazon - he commented that he started trusting AWS much less after getting to know some of the developers who worked on AWS.
replies(1): >>44568638 #
1. crinkly ◴[15 Jul 25 06:58 UTC] No.44568638{3}[source]▶
Yep that. We are a fairly high spend customer which gives us direct access to engineering managers there. Some of the non-core products are run by what looks like two guys in a trailer protected by a layer of NDAs and finger crossing. Had some pretty crazy problems even with their core stuff over the years which absolutely knocked my confidence.

At the same time, I've had two separate Apple SREs in the last 5 years tell me that I should never trust their cloud services.

If you can't see it and can't control it yourself, then you accept these things silently.

My distrust for this goes as far as the only thing actually being subcontracted out for me is Fastmail, DNS and domains and the mail is backed up hourly.