←back to thread

Claude Sonnet will ship in Xcode

(developer.apple.com)
485 points zora_goron | 1 comments | 29 Aug 25 00:44 UTC | HN request time: 0s | source
Show context
not_your_vase ◴[29 Aug 25 05:23 UTC] No.45060519[source]▶
3 days ago I saw another Claude praising submission on HN, and finally I signed up for it, to compare it with copilot.

I asked 2 things.

1. Create a boilerplate Zephyr project skeleton, for Pi Pico with st7789 spi display drivers configured. It generated garbage devicetree which didn't even compile. When I pointed it out, it apologized and generated another one that didn't compile. It configured also non-existent drivers, and for some reason it enabled monkey test support (but not test support).

2. I asked it to create 7x10 monochromatic pixelmaps, as C integer arrays, for numeric characters, 0-9. I also gave an example. It generated them, but number eight looked like zero. (There was no cross in ether 0 nor 8, so it wasn't that. Both were just a ring)

What am I doing wrong? Or is this really the state of the art?

replies(34): >>45060525 #>>45060544 #>>45060555 #>>45060577 #>>45060624 #>>45060626 #>>45060633 #>>45060639 #>>45060698 #>>45060709 #>>45060755 #>>45060762 #>>45060775 #>>45060786 #>>45060791 #>>45060838 #>>45060880 #>>45060887 #>>45060965 #>>45061012 #>>45061017 #>>45061122 #>>45061192 #>>45061240 #>>45061304 #>>45061524 #>>45061531 #>>45061711 #>>45061803 #>>45061865 #>>45062688 #>>45065504 #>>45066597 #>>45067821 #
OtherShrezzing ◴[29 Aug 25 06:15 UTC] No.45060786[source]▶
It’s good at doing stuff like “host this all in Docker. Make a Postgres database with a Users table. Make a FastAPI CRUD endpoint for Users. Make a React site with a homepage, login page, and user dashboard”.

It’ll successfully produce _something_ like that, because there’s millions of examples of those technologies online. If you do anything remotely niche, you need to hold its hand far more.

The more complicated your requirements are, the closer you are to having “spicy autocomplete”. If you’re just making a crud react app, you can talk in high level natural language.

replies(5): >>45061001 #>>45061333 #>>45061389 #>>45061547 #>>45063353 #
fx0x309 ◴[29 Aug 25 06:50 UTC] No.45061001[source]▶
In other words, the vibe coders of this world are just redundant noobs who don't really belong on the marketplace. They've written the same bullshit CRUD app every month for the past couple of years and now they've turned to AI to speed things up
replies(2): >>45061225 #>>45061233 #
stpedgwdgfhgdd ◴[29 Aug 25 07:28 UTC] No.45061225[source]▶
Last week I asked Claude to improve a piece of code that downloads all AWS RDS certificates to just the ones needed for that AWS region. It figured out several ways to determine the correct region, made a nice tradeoff and suggested the most reliable way. It rewrote the logic to download the right set, did some research to figure out the right endpoint in between. It only made one mistake, it fallback mechanism was picking EU, which was not correct. Maybe 1 hour of work. On my own it would have taken me close to a working day to figure it all out.
replies(2): >>45061576 #>>45066926 #
1. dns_snek ◴[29 Aug 25 17:25 UTC] No.45066926[source]▶
> Maybe 1 hour of work. On my own it would have taken me close to a working day to figure it all out.

1. Find out how to access metadata about the node running my code (assumption: some kind of an environment variable) [1-10 minutes depending on familiarity with AWS]

2. Google "RDS certificates" and find the bundle URL after skimming the page [1] for important info [1-5 minutes]

3. Write code to download the certificate bundle, fallback being "global-bundle.pem" if step 1 failed for some reason? [5-20 minutes depending on all the bells and whistles you need]

Did I miss anything or completely misunderstand the task?

[1] https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/Using...

edit: I asked Claude Sonnet 4 to write robust code for a Node.JS application that downloads RDS CA bundle for the AWS region that the code is currently running in and saves it at the supplied filesystem path.

0. It generated about 250 lines of code

1. Fallback was us-east (not global)

2. The download URLs for each region were hardcoded as KV pairs instead of being constructed dynamically

3. Half of the regions were missing

4. It wrote a function that verifies whether the certificate bundle looks valid (i.e. includes a PEM header)... but only calls it on the next application startup, instead of doing so before saving a potentially invalid certificate bundle to disk and proceeding with the application startup.

5. When I complained that half of my instances are downloading global bundles instead of regional ones (because they're not present in the hardcoded list), it:

- incorrectly concluded that not all regions have CA bundles available and hardcoded a duplicate list in 2 places containing regions that are known to offer CA bundles (which is all of them). These lists were even shorter than the last ones.

- wrote a completely unnecessary function that checks whether a regional CA bundle exists with a HEAD request before actually downloading it with a GET request, adding another 50 lines of code

Now I'm having to scrutinize 300 lines of code to make sure it's nothing doing something even more unexpected.