←back to thread

65 points fidotron | 1 comments | | HN request time: 0.269s | source
Show context
wincy ◴[] No.43574612[source]
I thought this was somehow BitTorrent related. I read this article and am not really sure if this is something to be excited about? Can I run Deepseek R1 with whatever this is?
replies(1): >>43574905 #
1. krasin ◴[] No.43574905[source]
DeepSeek R1 has 671B parameters. If you want to run at 8 bits/parameter (the native format for DeepSeek R1, in which it was trained, so the top performance possible for the model), one would need about 32 Blackhole p150a ([1]), which is around $42k and 10kW power consumption.

So, yes, you can run DeepSeek R1 on it, but there are cheaper options (if we only talk about inference).

1. https://tenstorrent.com/hardware/blackhole