←back to thread

Gemini 2.5 Pro vs. Claude 3.7 Sonnet: Coding Comparison

(composio.dev)
483 points mraniki | 8 comments | 31 Mar 25 12:09 UTC | HN request time: 0.001s | source | bottom
Show context
phkahler ◴[31 Mar 25 13:30 UTC] No.43534852[source]▶
Here is a real coding problem that I might be willing to make a cash-prize contest for. We'd need to nail down some rules. I'd be shocked if any LLM can do this:

https://github.com/solvespace/solvespace/issues/1414

Make a GTK 4 version of Solvespace. We have a single C++ file for each platform - Windows, Mac, and Linux-GTK3. There is also a QT version on an unmerged branch for reference. The GTK3 file is under 2KLOC. You do not need to create a new version, just rewrite the GTK3 Linux version to GTK4. You may either ask it to port what's there or create the new one from scratch.

If you want to do this for free to prove how great the AI is, please document the entire session. Heck make a YouTube video of it. The final test is weather I accept the PR or not - and I WANT this ticket done.

I'm not going to hold my breath.

replies(15): >>43534866 #>>43534869 #>>43535026 #>>43535180 #>>43535208 #>>43535218 #>>43535261 #>>43535424 #>>43535811 #>>43535986 #>>43536115 #>>43536743 #>>43536797 #>>43536869 #>>43542998 #
1. kordlessagain ◴[31 Mar 25 15:00 UTC] No.43535811[source]▶
What’s the point of a one-to-one GTK3 → GTK4 rewrite when the user experience doesn’t improve at all?

Why not modularize the backend and build a better UI with tech that’s actually relevant in 2025?

replies(3): >>43536005 #>>43536262 #>>43538674 #
2. georgemcbay ◴[31 Mar 25 15:16 UTC] No.43536005[source]▶
I'm not the person you are asking but the point of this whole thing seems to be as a test for how possible it is for an LLM to 'vibe code' a port of this nature and not really because they care that much about a port existing.

The fact that they haven't done the port in the normal way suggests they basically agree with what you said here (not worth the ROI), but hey if you can get the latest AI code editor to spit out a perfectly working port in minutes, why not?

FWIW, my assessment of LLMs is the same as theirs. The hype is far greater than the practical usefulness, and I say this as someone who is using LLMs pretty regularly now.

They aren't useless, but the idea that they will be writing 90% of our code soon is just completely at odds with my day to day experience getting them to do actual specific tasks rather than telling them to "write Tetris for XYZ" and blog about how great they are because it produced something roughly what I asked for without much specificity.

3. aleph_minus_one ◴[31 Mar 25 15:36 UTC] No.43536262[source]▶
> Why not modularize the backend and build a better UI with tech that’s actually relevant in 2025?

Doing the second part is to my understanding actually the purpose of the stated task.

replies(1): >>43536545 #
4. pdntspa ◴[31 Mar 25 16:03 UTC] No.43536545[source]▶
Why are you calling GTK4 irrelevant? Large swaths of Linux run on it and GTK3
replies(2): >>43536959 #>>43538622 #
5. aleph_minus_one ◴[31 Mar 25 16:37 UTC] No.43536959{3}[source]▶
> Why are you calling GTK4 irrelevant?

Quite the opposite: Gtk4 is relevant, and porting Solvespace to this relevant toolkit is the central part of the stated task.

replies(1): >>43538751 #
6. written-beyond ◴[31 Mar 25 19:12 UTC] No.43538622{3}[source]▶
Might be someone implying that electron is a superior (modern) solution. Which, if so, I whole heartedly disagree with.
7. phkahler ◴[31 Mar 25 19:17 UTC] No.43538674[source]▶
>> What’s the point of a one-to-one GTK3 → GTK4 rewrite when the user experience doesn’t improve at all?

I'd like to use the same UI on all platforms so that we can do some things better (like localization in the text window and resizable text) and my preference for that is GTK. I tried doing it myself, got frustrated, and stopped because there are more important things to work on.

8. pdntspa ◴[31 Mar 25 19:23 UTC] No.43538751{4}[source]▶
I guess I pinned my response to the wrong thread.