←back to thread

Claude 3.7 Sonnet and Claude Code

(www.anthropic.com)
2127 points bakugo | 1 comments | 24 Feb 25 18:28 UTC | HN request time: 0.317s | source
Show context
anotherpaulg ◴[24 Feb 25 20:40 UTC] No.43164684[source]▶
Claude 3.7 Sonnet scored 60.4% on the aider polyglot leaderboard [0], WITHOUT USING THINKING.

Tied for 3rd place with o3-mini-high. Sonnet 3.7 has the highest non-thinking score, taking that title from Sonnet 3.5.

Aider 0.75.0 is out with support for 3.7 Sonnet [1].

Thinking support and thinking benchmark results coming soon.

[0] https://aider.chat/docs/leaderboards/

[1] https://aider.chat/HISTORY.html#aider-v0750

replies(18): >>43164827 #>>43165382 #>>43165504 #>>43165555 #>>43165786 #>>43166186 #>>43166253 #>>43166387 #>>43166478 #>>43166688 #>>43166754 #>>43166976 #>>43167970 #>>43170020 #>>43172076 #>>43173004 #>>43173088 #>>43176914 #
bearjaws ◴[24 Feb 25 20:55 UTC] No.43164827[source]▶
Thanks for all the work on aider, my favorite AI tool.
replies(1): >>43166454 #
bt1a ◴[25 Feb 25 00:03 UTC] No.43166454[source]▶
It really is best in slot. Owe it to git, which has a particular synergy with a hallucination-prone but correctable system
replies(1): >>43167992 #
doctoboggan ◴[25 Feb 25 03:55 UTC] No.43167992[source]▶
I like Aider but I've turned off auto-commit. I just can't seem to let the AI actually commit code for me. Do you regularly let Aider commit for you? How much do you review the code written by it?
replies(4): >>43168124 #>>43168129 #>>43168132 #>>43168166 #
1. joshstrange ◴[25 Feb 25 04:25 UTC] No.43168166[source]▶
I originally was against auto commit as well, but now I can’t imagine not using it. It’s essentially save points along the way. More than once, I’ve done two or three exchanges with Aider only to realize that the path that we were going down was not a good one.

Being able to get reset back to the last known good state is awesome. If you turn off auto commit, it’s a lot harder to undo one of the steps that the model takes. It’s only a matter of time until it creates nonsense, so you’ll really want the ability to roll it back.

Just work in a branch and you can merge all commits if you want at the end.