That 1M tokens context window alone is going to kill a lot of RAG use cases. Crazy to see how we went from 4K tokens context windows (2023 ChatGPT-3.5) to 1M in less than 2 years.
replies(6):
2M context window on Gemini 2.0 Pro: https://deepmind.google/technologies/gemini/pro/