(cerebras.ai)

426 points benchmarkist | 1 comments | 19 Nov 24 00:15 UTC | HN request time: 0.214s | source

1. sumedh ◴[19 Nov 24 10:34 UTC] No.42181951[source]▶

They have a waitlist for trying their API. You have to be a but skeptical when a company makes claims but does not offer their services to buy.

Llama 3.1 405B now runs at 969 tokens/s on Cerebras Inference