←back to thread

Zamba2-7B

(www.zyphra.com)
282 points dataminer | 1 comments | 14 Oct 24 22:45 UTC | HN request time: 0s | source
Show context
jwitthuhn ◴[15 Oct 24 01:20 UTC] No.41843985[source]▶
For anyone else looking for the weights which as far as I can tell are not linked in the article:

Base model: https://huggingface.co/Zyphra/Zamba2-7B

Instruct tuned: https://huggingface.co/Zyphra/Zamba2-7B-Instruct

replies(1): >>41844057 #
keyle ◴[15 Oct 24 01:33 UTC] No.41844057[source]▶
I couldn't find any gguf files yet. Looking forward to trying it out when they're available.
replies(3): >>41844163 #>>41844635 #>>41847638 #
alchemist1e9 ◴[15 Oct 24 01:55 UTC] No.41844163[source]▶
What can be used to run it? I had imagined Mamba based models need a different interference code/software than the other models.
replies(3): >>41844520 #>>41844782 #>>41847696 #
hidelooktropic ◴[15 Oct 24 03:06 UTC] No.41844520[source]▶
To run gguf files? LM Studio for one. I think recurse on macos as well and probably some others.
replies(2): >>41847312 #>>41853147 #
1. x_may ◴[15 Oct 24 11:10 UTC] No.41847312[source]▶
As another commenter said, this has no GGUF because it’s partially mamba based which is unsupported in llama.cpp