←back to thread

Show HN: Clippy – 90s UI for local LLMs

(felixrieseberg.github.io)
1122 points felixrieseberg | 2 comments | 06 May 25 15:02 UTC | HN request time: 0.685s | source
Show context
rafram ◴[06 May 25 15:56 UTC] No.43906574[source]▶
This is cool, but does no one even look at what libraries they're shipping anymore? I mean, why does this Clippy-style LLM interface bundle:

- A JavaScript implementation of the Jinja templating language

- A full GitHub API client

- A library that takes a string and tells you if it's a valid npm package name

- A useless shim for the JavaScript Math module

And 119 other libraries? This thing would have taken up 10% of the maximum disk space available on a Windows 95 FAT16 volume.

replies(6): >>43906612 #>>43906753 #>>43906837 #>>43906870 #>>43906877 #>>43906903 #
1. NitpickLawyer ◴[06 May 25 16:18 UTC] No.43906837[source]▶
> A JavaScript implementation of the Jinja templating language

A guess without looking into the code: Jinja templating is used to define how to prompt the model (i.e. system first, then this specific character / token, then user, then if it's a tool prepend this and append that, etc.)

replies(1): >>43907787 #
2. xyc ◴[06 May 25 17:47 UTC] No.43907787[source]▶
It seems that this is possibly not necessary, since LLaMA.cpp already integrates Jinja with CPP implementation (through minja)