←back to thread

Batch Mode in the Gemini API: Process More for Less

(developers.googleblog.com)
167 points xnx | 5 comments | 07 Jul 25 16:30 UTC | HN request time: 1.347s | source
Show context
tripplyons ◴[11 Jul 25 01:45 UTC] No.44527652[source]▶
For those who aren't aware, OpenAI has a very similar batch mode (50% discount if you wait up to 24 hours): https://platform.openai.com/docs/api-reference/batch

It's nice to see competition in this space. AI is getting cheaper and cheaper!

replies(4): >>44528108 #>>44528444 #>>44528451 #>>44532342 #
dlvhdr ◴[11 Jul 25 04:39 UTC] No.44528451[source]▶
The latest price increases beg to differ
replies(2): >>44529179 #>>44530641 #
1. dmos62 ◴[11 Jul 25 07:09 UTC] No.44529179[source]▶
What price increases?
replies(1): >>44529317 #
2. rvnx ◴[11 Jul 25 07:33 UTC] No.44529317[source]▶
I guess the Gemini price increase
replies(1): >>44531095 #
3. dmos62 ◴[11 Jul 25 11:53 UTC] No.44531095[source]▶
Ah, 2.5 flash non-thinking price was increased to match the price of 2.5 flash thinking.
replies(1): >>44532762 #
4. Workaccount2 ◴[11 Jul 25 14:48 UTC] No.44532762{3}[source]▶
No, 2.5 flash non-thinking was replaced with 2.5 flash lite, and 2.5 flash thinking had it's cost rebalanced (input price increased/output price decreased)

2.5 flash non-thinking doesn't exist anymore. People call it a price increase but it's just confusion about what Google did.

replies(1): >>44536758 #
5. sunaookami ◴[11 Jul 25 21:03 UTC] No.44536758{4}[source]▶
They try to frame it as such but 2.5 Flash Lite is not the same as 2.5 Flash without thinking. It's worse.