←back to thread

Alibaba Cloud says it cut Nvidia AI GPU use by 82% with new pooling system

(www.tomshardware.com)
521 points hd4 | 1 comments | 20 Oct 25 12:31 UTC | HN request time: 0s | source
Show context
mighmi ◴[20 Oct 25 17:42 UTC] No.45646800[source]▶
To what extent is this practice applicable to other loads?
replies(1): >>45652382 #
1. wsfung2008 ◴[21 Oct 25 04:06 UTC] No.45652382[source]▶
This is for platforms that serve many different models, most of which have very low usage. e.g. huggingface, civitai