←back to thread

Grok Code Fast 1

(x.ai)
504 points Terretta | 2 comments | 29 Aug 25 13:01 UTC | HN request time: 0.595s | source
Show context
boole1854 ◴[29 Aug 25 14:21 UTC] No.45064512[source]▶
It's interesting that the benchmark they are choosing to emphasize (in the one chart they show and even in the "fast" name of the model) is token output speed.

I would have thought it uncontroversial view among software engineers that token quality is much important than token output speed.

replies(14): >>45064582 #>>45064587 #>>45064594 #>>45064616 #>>45064622 #>>45064630 #>>45064757 #>>45064772 #>>45064950 #>>45065131 #>>45065280 #>>45065539 #>>45067136 #>>45077061 #
jsheard ◴[29 Aug 25 14:28 UTC] No.45064594[source]▶
That's far from the worst metric that xAI has come up with...

https://xcancel.com/elonmusk/status/1958854561579638960

replies(1): >>45066065 #
Rover222 ◴[29 Aug 25 16:20 UTC] No.45066065[source]▶
what's wrong with rapid updates to an app?
replies(5): >>45067028 #>>45067061 #>>45068102 #>>45069218 #>>45070365 #
1. cosmicgadget ◴[29 Aug 25 17:32 UTC] No.45067028[source]▶
They aren't a metric for showing you are better than the competition.
replies(1): >>45068209 #
2. Rover222 ◴[29 Aug 25 19:15 UTC] No.45068209[source]▶
It's a metric for showing you can move more quickly on product improvements. Anyone who has worked on a product team at a large tech company knows how much things get slowed down by process bloat.