Show HN: An LLM chat app using Apple's FoundationModels

(apps.apple.com)
3 points alariccole | 5 comments | 16 Sep 25 19:32 UTC | HN request time: 0.741s | source

Despite Apple’s fairly clear warnings that their 3B 4K model is not for use as a chat app, I had to try anyway. There’s definitely plenty of work to do but it’s starting to become useful.

Happy to answer any questions about limitations, what it’s good at, and how to coax it. The safety guardrails and forced disneyfication make this especially challenging.

1. ndgold ◴[16 Sep 25 20:09 UTC] No.45267322[source]▶
Thanks for your work, tried it, it works, it is mostly not useful for me, but I love where this is going and the experience is super streamlined
replies(1): >>45267398 #
2. alariccole ◴[16 Sep 25 20:16 UTC] No.45267398[source]▶
Thanks for checking it out. Thinking to do a more file/notes focused version esp on mac because it’s blazing fast there.
3. bchris4 ◴[16 Sep 25 20:29 UTC] No.45267560[source]▶
Interesting to get a vibe check on the Apple model via chat.

Any plans for RAG across Notes/Email/Calendar?

replies(1): >>45267633 #
4. alariccole ◴[16 Sep 25 20:34 UTC] No.45267633[source]▶
Yeah, when I started I actually had no intention of doing a chat app, but it was a good way to learn how it works. Eventual goal with this is a sort of hybrid notes app. Not an llm bolted into Notes, either, but kind of a mix. Find myself using the llm app as a knowledge repo and it’s just not built for that. I’ll post a TestFlight link later if you want to try it out.