(mistral.ai)

701 points mfiguiere | 4 comments | 21 May 25 14:21 UTC | HN request time: 0.699s | source

1. abrowne2 ◴[21 May 25 16:31 UTC] No.44053211[source]▶

Curious to check this out, since they say it can run on a 4090 / Mac with >32 GB of RAM.

2. ddtaylor ◴[21 May 25 16:34 UTC] No.44053250[source]▶

I can run it without issue on a 6800 XT with 64GB of RAM.

3. yencabulator ◴[21 May 25 22:02 UTC] No.44056730[source]▶

"Can run" is pretty easy, it's pretty small and quantized. It runs at 3.7 tokens/second on pure CPU with AMD 8945HS.

4. sneak ◴[22 May 25 07:43 UTC] No.44059683[source]▶

I just ran it on a 24GB M2 air. Slow, but functional.

Devstral