←back to thread

Show HN: An LLM chat app using Apple's FoundationModels

(apps.apple.com)
3 points alariccole | 1 comments | 16 Sep 25 19:32 UTC | HN request time: 0.001s | source

Despite Apple’s fairly clear warnings that their 3B 4K model is not for use as a chat app, I had to try anyway. There’s definitely plenty of work to do but it’s starting to become useful.

Happy to answer any questions about limitations, what it’s good at, and how to coax it. The safety guardrails and forced disneyfication make this especially challenging.

Show context
bchris4 ◴[16 Sep 25 20:29 UTC] No.45267560[source]▶
Interesting to get a vibe check on the Apple model via chat.

Any plans for RAG across Notes/Email/Calendar?

replies(1): >>45267633 #
1. alariccole ◴[16 Sep 25 20:34 UTC] No.45267633[source]▶
Yeah, when I started I actually had no intention of doing a chat app, but it was a good way to learn how it works. Eventual goal with this is a sort of hybrid notes app. Not an llm bolted into Notes, either, but kind of a mix. Find myself using the llm app as a knowledge repo and it’s just not built for that. I’ll post a TestFlight link later if you want to try it out.