←back to thread

Devstral

(mistral.ai)
701 points mfiguiere | 1 comments | 21 May 25 14:21 UTC | HN request time: 0s | source
Show context
abrowne2 ◴[21 May 25 16:31 UTC] No.44053211[source]▶
Curious to check this out, since they say it can run on a 4090 / Mac with >32 GB of RAM.
replies(3): >>44053250 #>>44056730 #>>44059683 #
1. yencabulator ◴[21 May 25 22:02 UTC] No.44056730[source]▶
"Can run" is pretty easy, it's pretty small and quantized. It runs at 3.7 tokens/second on pure CPU with AMD 8945HS.