←back to thread

Llama 3.1 405B now runs at 969 tokens/s on Cerebras Inference

(cerebras.ai)
426 points benchmarkist | 1 comments | 19 Nov 24 00:15 UTC | HN request time: 1.119s | source
1. kuprel ◴[19 Nov 24 03:54 UTC] No.42179970[source]▶
I wonder if Cerebras could generate video decent quality in real time