←back to thread

Batch Mode in the Gemini API: Process More for Less

(developers.googleblog.com)
167 points xnx | 1 comments | 07 Jul 25 16:30 UTC | HN request time: 0.205s | source
Show context
great_psy ◴[11 Jul 25 04:34 UTC] No.44528424[source]▶
Is this an indication of the peak of the AI bubble ?

In a way this is saying that there are some GPUs just sitting around so they would rather get 50% than nothing for their use.

replies(2): >>44528499 #>>44528501 #
1. reasonableklout ◴[11 Jul 25 04:48 UTC] No.44528501[source]▶
Why do you think that this means "idle GPU" rather than a company recognizing a growing need and allocating resources toward it?

It's cheaper because it's a different market with different needs which can be served by systems optimizing for throughput instead latency. Feels like you're looking for something that's not there.