←back to thread

Claude Sonnet will ship in Xcode

(developer.apple.com)
485 points zora_goron | 1 comments | | HN request time: 0.221s | source
Show context
not_your_vase ◴[] No.45060519[source]
3 days ago I saw another Claude praising submission on HN, and finally I signed up for it, to compare it with copilot.

I asked 2 things.

1. Create a boilerplate Zephyr project skeleton, for Pi Pico with st7789 spi display drivers configured. It generated garbage devicetree which didn't even compile. When I pointed it out, it apologized and generated another one that didn't compile. It configured also non-existent drivers, and for some reason it enabled monkey test support (but not test support).

2. I asked it to create 7x10 monochromatic pixelmaps, as C integer arrays, for numeric characters, 0-9. I also gave an example. It generated them, but number eight looked like zero. (There was no cross in ether 0 nor 8, so it wasn't that. Both were just a ring)

What am I doing wrong? Or is this really the state of the art?

replies(34): >>45060525 #>>45060544 #>>45060555 #>>45060577 #>>45060624 #>>45060626 #>>45060633 #>>45060639 #>>45060698 #>>45060709 #>>45060755 #>>45060762 #>>45060775 #>>45060786 #>>45060791 #>>45060838 #>>45060880 #>>45060887 #>>45060965 #>>45061012 #>>45061017 #>>45061122 #>>45061192 #>>45061240 #>>45061304 #>>45061524 #>>45061531 #>>45061711 #>>45061803 #>>45061865 #>>45062688 #>>45065504 #>>45066597 #>>45067821 #
OtherShrezzing ◴[] No.45060786[source]
It’s good at doing stuff like “host this all in Docker. Make a Postgres database with a Users table. Make a FastAPI CRUD endpoint for Users. Make a React site with a homepage, login page, and user dashboard”.

It’ll successfully produce _something_ like that, because there’s millions of examples of those technologies online. If you do anything remotely niche, you need to hold its hand far more.

The more complicated your requirements are, the closer you are to having “spicy autocomplete”. If you’re just making a crud react app, you can talk in high level natural language.

replies(5): >>45061001 #>>45061333 #>>45061389 #>>45061547 #>>45063353 #
1. fauigerzigerk ◴[] No.45061333[source]
I agree, but I think there's an important distinction to be made.

In some cases, it just doesn't have the necessary information because the problem is too niche.

In other cases, it does have all the necessary information but fails to connect the dots, i.e. reasoning fails.

It is the latter issue that is affecting all LLMs to such a degree that I'm really becoming very sceptical of the current generation of LLMs for tasks that require reasoning.

They are still incredibly useful of course, but those reasoning claims are just false. There are no reasoning models.