←back to thread

Show HN: Clippy – 90s UI for local LLMs

(felixrieseberg.github.io)
1122 points felixrieseberg | 1 comments | 06 May 25 15:02 UTC | HN request time: 0s | source
Show context
rafram ◴[06 May 25 15:56 UTC] No.43906574[source]▶
This is cool, but does no one even look at what libraries they're shipping anymore? I mean, why does this Clippy-style LLM interface bundle:

- A JavaScript implementation of the Jinja templating language

- A full GitHub API client

- A library that takes a string and tells you if it's a valid npm package name

- A useless shim for the JavaScript Math module

And 119 other libraries? This thing would have taken up 10% of the maximum disk space available on a Windows 95 FAT16 volume.

replies(6): >>43906612 #>>43906753 #>>43906837 #>>43906870 #>>43906877 #>>43906903 #
1. felixrieseberg ◴[06 May 25 16:22 UTC] No.43906877[source]▶
The real answer is that some of us (the Electron maintainers) have been playing with local LLMs in desktop apps and right now, node-llama-cpp is by far the easiest way to experiment - but it's also not meant for desktop apps and hence has _a lot_ of dependencies.

In general, pruning libraries in Electron isn't as easy as it should be - it's probably something for us to work on.