←back to thread

504 points Terretta | 1 comments | | HN request time: 0.203s | source
1. natch ◴[] No.45071048[source]
As a user, “fast” is almost the last thing I want from a model.

I suspect AI companies try to promote fast because it’s really a euphemism for “less inference compute” which is the real metric they would like to optimize.