←back to thread

Gemini 2.5 Pro vs. Claude 3.7 Sonnet: Coding Comparison

(composio.dev)
483 points mraniki | 1 comments | 31 Mar 25 12:09 UTC | HN request time: 0.211s | source
Show context
bratao ◴[31 Mar 25 12:46 UTC] No.43534359[source]▶
From my use case, the Gemini 2.5 is terrible. I have a complex Cython code in a single file (1500 lines) for a Sequence Labeling. Claude and o3 are very good in improving this code and following the commands. The Gemini always try to do unrelated changes. For example, I asked, separately, for small changes such as remove this unused function, or cache the arrays indexes. Every time it completely refactored the code and was obsessed with removing the gil. The output code is always broken, because removing the gil is not easy.
replies(10): >>43534409 #>>43534423 #>>43534434 #>>43534511 #>>43534695 #>>43534743 #>>43535378 #>>43536361 #>>43536527 #>>43536933 #
therealmarv ◴[31 Mar 25 15:47 UTC] No.43536361[source]▶
set temperature to 0.4 or lower.
replies(1): >>43536656 #
1. mrinterweb ◴[31 Mar 25 16:12 UTC] No.43536656[source]▶
Adjusting temperature is something I often forget. I think Gemini can range between 0.0 <-> 2.0 (1.0 default). Lowering the temp should get more consistent/deterministic results.