←back to thread

181 points jxmorris12 | 1 comments | | HN request time: 0.217s | source
Show context
semiinfinitely ◴[] No.43111944[source]
i think that log-sum-exp should actually be the function that gets the name "softmax" because its actually a soft maximum over a set of values. And what we call "softmax" should be called "grad softmax" (since grad of logsumexp is softmax).
replies(1): >>43113383 #
1. GistNoesis ◴[] No.43113383[source]
softmax is badly named and should rather be called softargmax.