←back to thread

Gemini 2.5 Pro vs. Claude 3.7 Sonnet: Coding Comparison

(composio.dev)
467 points mraniki | 4 comments | 31 Mar 25 12:09 UTC | HN request time: 0.63s | source
Show context
anotherpaulg ◴[31 Mar 25 18:16 UTC] No.43537993[source]▶
Gemini 2.5 Pro set a wide SOTA on the aider polyglot coding leaderboard [0]. It scored 73%, well ahead of the previous 65% SOTA from Sonnet 3.7.

I use LLMs to improve aider, which is >30k lines of python. So not a toy codebase, not greenfield.

I used Gemini 2.5 Pro for the majority of the work on the latest aider release [1]. This is the first release in a very long time which wasn't predominantly written using Sonnet.

The biggest challenge with Gemini right now is the very tight rate limits. Most of my Sonnet usage lately is just when I am waiting for Gemini’s rate limits to cool down.

[0] https://aider.chat/docs/leaderboards/

[1] https://aider.chat/docs/faq.html#what-llms-do-you-use-to-bui...

replies(1): >>43539401 #
1. atonse ◴[31 Mar 25 20:15 UTC] No.43539401[source]▶
As someone who just adopted Cursor (and MCP) 2-3 weeks ago, Aider seems like a different world.

The examples of "create a new simple video game" cause me to glaze over.

Do you have a screencast of how you use aider to develop aider? I'd love to see how a savvy expert uses these tools for real-world solutions.

replies(1): >>43539483 #
2. anotherpaulg ◴[31 Mar 25 20:22 UTC] No.43539483[source]▶
I actually get asked for screencasts a lot, so I made recently made some [0].

The recording of adding support for 100+ new coding languages with tree-sitter [1] shows some pretty advanced usage. It includes using aider to script downloading a collection of files, and using ad-hoc bash scripts to have aider modify a collection of files.

[0] https://aider.chat/docs/recordings/

[1] https://aider.chat/docs/recordings/tree-sitter-language-pack...

replies(2): >>43541452 #>>43542939 #
3. atonse ◴[01 Apr 25 00:13 UTC] No.43541452[source]▶
This is perfect. Thank you!
4. sedgjh23 ◴[01 Apr 25 04:47 UTC] No.43542939[source]▶
This is excellent, thank you.