←back to thread

Grok 3: Another win for the bitter lesson

(www.thealgorithmicbridge.com)
129 points kiyanwang | 1 comments | 20 Feb 25 07:15 UTC | HN request time: 0s | source
Show context
aqueueaqueue ◴[20 Feb 25 08:04 UTC] No.43112225[source]▶
How bitter is the bitter lesson when throwing more compute js costing billions. Maybe the bitter lesson is more about money now than the hardware. You are scaling up investments not just relying on moores law. But I think there is a path for the less power consuming models that people can run affordably without VC money.
replies(2): >>43112267 #>>43112403 #
1. az226 ◴[20 Feb 25 08:31 UTC] No.43112403[source]▶
The bitter lesson is all about more data/compute. Doesn’t matter if it costs more because it’s not as efficient, the scale is what matters at the end of the day. Sure you’d reach farther with both scale and optimization, but raw scale still takes the cake.