(developers.googleblog.com)

167 points xnx | 1 comments | 07 Jul 25 16:30 UTC | HN request time: 0.407s | source

Show context

tripplyons ◴[11 Jul 25 01:45 UTC] No.44527652[source]▶

For those who aren't aware, OpenAI has a very similar batch mode (50% discount if you wait up to 24 hours): https://platform.openai.com/docs/api-reference/batch

It's nice to see competition in this space. AI is getting cheaper and cheaper!

fantispug ◴[11 Jul 25 03:16 UTC] No.44528108[source]▶

Yes, this seems to be a common capability - Anthropic and Mistral have something very similar as do resellers like AWS Bedrock.

I guess it lets them better utilise their hardware in quiet times throughout the day. It's interesting they all picked 50% discount.

50% is my personal threshold for a discount going from not worth it to worth it.

Batch Mode in the Gemini API: Process More for Less