Claude 3.7 Sonnet and Claude Code

Claude 3.7 Sonnet scored 60.4% on the aider polyglot leaderboard [0], WITHOUT USING THINKING.

Tied for 3rd place with o3-mini-high. Sonnet 3.7 has the highest non-thinking score, taking that title from Sonnet 3.5.

Aider 0.75.0 is out with support for 3.7 Sonnet [1].

Thinking support and thinking benchmark results coming soon.

[0] https://aider.chat/docs/leaderboards/

[1] https://aider.chat/HISTORY.html#aider-v0750

Interesting that the "correct diff format" score went from 99.6% with Claude 3.5 to 93.3% for Claude 3.7. My experience with using claude-code was that it consistently required several tries to get the right diff. Hopefully all that will improve as they get things ironed out.

That's a file context problem because you use cursor or cline or some other crap context maker. Try Clood.

Unless "anthropic high usage" which I just watch the incident reports I one shot features regularly.

At a high skill level. Not front end. Back end c# in a small but great framework that has poor documentation. Not just endpoints but full on task queues.

So really, it's a context problem. You're just not laser focusing your context.

Try this:

Set up a context with the exact files needed. Sure ai "should" do that but it doesn't. Especially not cursor or cline. Then try.

Hell try it with clood after I update with 3.7. I bet you, if you clood file it, then you get one shots.

I have a long history of clood being a commit in my projects and it's a clood one shot.