←back to thread

205 points anurag | 1 comments | | HN request time: 0.226s | source
Show context
Aeolun ◴[] No.45778883[source]
I read this and I have to wonder, did anyone ever think it was reasonable that a cluster that apparently needed only 120gb of memory was consuming 1.2TB just for logging (or whatever vector does)
replies(4): >>45779398 #>>45779624 #>>45779726 #>>45780688 #
bstack ◴[] No.45779398[source]
Author here: You’d be surprised what you don’t notice given enough nodes and slow enough resource growth over time! Out of the total resource usage in these clusters even at the high water mark for this daemonset it was still a small overall portion of the total.
replies(2): >>45779736 #>>45779879 #
Aeolun ◴[] No.45779879[source]
I’m not sure if that makes it better or worse.
replies(2): >>45780858 #>>45785752 #
1. antoniojtorres ◴[] No.45785752[source]
It seems realistic to me, commonplace even. Lots to do in a company like this one.