←back to thread

577 points simonw | 2 comments | | HN request time: 0.4s | source
1. Aurornis ◴[] No.44724879[source]
This is very cool. The blog had to run it from the main branch of the mlx-lm library and a custom script. Can someone up to date on the local LLM tools let us know which mainstream tools we should be watching for an easier way to run this on MLX? The space moves so fast that it's hard to keep up.
replies(1): >>44724891 #
2. simonw ◴[] No.44724891[source]
I expect LM Studio will have this pretty soon - I imagine they are waiting on the next stable release of mlx-lm which will include the change I needed to get this to work.