←back to thread

Claude Sonnet will ship in Xcode

(developer.apple.com)
485 points zora_goron | 1 comments | 29 Aug 25 00:44 UTC | HN request time: 0.212s | source
Show context
not_your_vase ◴[29 Aug 25 05:23 UTC] No.45060519[source]▶
3 days ago I saw another Claude praising submission on HN, and finally I signed up for it, to compare it with copilot.

I asked 2 things.

1. Create a boilerplate Zephyr project skeleton, for Pi Pico with st7789 spi display drivers configured. It generated garbage devicetree which didn't even compile. When I pointed it out, it apologized and generated another one that didn't compile. It configured also non-existent drivers, and for some reason it enabled monkey test support (but not test support).

2. I asked it to create 7x10 monochromatic pixelmaps, as C integer arrays, for numeric characters, 0-9. I also gave an example. It generated them, but number eight looked like zero. (There was no cross in ether 0 nor 8, so it wasn't that. Both were just a ring)

What am I doing wrong? Or is this really the state of the art?

replies(34): >>45060525 #>>45060544 #>>45060555 #>>45060577 #>>45060624 #>>45060626 #>>45060633 #>>45060639 #>>45060698 #>>45060709 #>>45060755 #>>45060762 #>>45060775 #>>45060786 #>>45060791 #>>45060838 #>>45060880 #>>45060887 #>>45060965 #>>45061012 #>>45061017 #>>45061122 #>>45061192 #>>45061240 #>>45061304 #>>45061524 #>>45061531 #>>45061711 #>>45061803 #>>45061865 #>>45062688 #>>45065504 #>>45066597 #>>45067821 #
VMG ◴[29 Aug 25 07:42 UTC] No.45061304[source]▶
> It configured also non-existent drivers, and for some reason it enabled monkey test support (but not test support).

If it doesn't have the underlying base data, it tends to hallucinates. (It's getting a bit difficult to tell when it has underlying data, because some models autonomously search the web). The models are good at transforming data however, so give it access to whatever data it needs.

Also let it work in a feedback loop: tell it to compile and fix the compile errors. You have to monitor it because it will sometimes just silence warnings and use invalid casts.

> What am I doing wrong? Or is this really the state of the art?

It may sound silly, but it's simply not good at 2D

replies(1): >>45061597 #
1. throwawayffffas ◴[29 Aug 25 08:28 UTC] No.45061597[source]▶
> It may sound silly, but it's simply not good at can2D.

It's not silly at all, it's not very good at layouts either, it can generally make layouts but there is a high chance for subtle errors, element overlaps, text overflows, etc.

Mostly because it's a language model, i.e it doesn't generally see what it makes, you can send screenshots apparently and it will use it's embedded vision model, but I have not tried that.