Gemini 2.5 Pro vs. Claude 3.7 Sonnet: Coding Comparison

(composio.dev)

467 points mraniki | 1 comments | 31 Mar 25 12:09 UTC | HN request time: 0.739s | source

Show context

phkahler ◴[31 Mar 25 13:30 UTC] No.43534852[source]▶

Here is a real coding problem that I might be willing to make a cash-prize contest for. We'd need to nail down some rules. I'd be shocked if any LLM can do this:

https://github.com/solvespace/solvespace/issues/1414

Make a GTK 4 version of Solvespace. We have a single C++ file for each platform - Windows, Mac, and Linux-GTK3. There is also a QT version on an unmerged branch for reference. The GTK3 file is under 2KLOC. You do not need to create a new version, just rewrite the GTK3 Linux version to GTK4. You may either ask it to port what's there or create the new one from scratch.

If you want to do this for free to prove how great the AI is, please document the entire session. Heck make a YouTube video of it. The final test is weather I accept the PR or not - and I WANT this ticket done.

I'm not going to hold my breath.

replies(15): >>43534866 #>>43534869 #>>43535026 #>>43535180 #>>43535208 #>>43535218 #>>43535261 #>>43535424 #>>43535811 #>>43535986 #>>43536115 #>>43536743 #>>43536797 #>>43536869 #>>43542998 #

stickfigure ◴[31 Mar 25 16:23 UTC] No.43536797[source]▶

>>43534852 #

My coding challenges are all variations on "start with this 1.5M line Spring project, full of multi-thousand-line files..."

replies(2): >>43539001 #>>43546700 #

1. phkahler ◴[01 Apr 25 13:43 UTC] No.43546700[source]▶

>>43536797 #

To do the challenge one would just need to understand the platform abstraction layer which is pretty small, and write 1K to 2K LOC. We don't even use much of the GUI toolkit functionality. I certainly don't need to understand the majority of a codebase to make meaningful contributions in specific areas.

↑