←back to thread

Differentiable Programming from Scratch

(thenumb.at)
108 points sksxihve | 2 comments | 17 Apr 25 04:30 UTC | HN request time: 0.419s | source
Show context
hwpythonner ◴[17 Apr 25 10:58 UTC] No.43715111[source]▶
I’m not deep into autodiff (just recall some calculus from university), but the syntax in this post reminds me a lot of ML (the programming language, not machine learning)

I know autodiff isn’t lambda calculus, but the expression-based structure and evaluation rules feel similar. Couldn’t this be implemented in something like ML or Clojure? Just wondering what the custom DSL adds that existing functional languages wouldn’t already support

replies(3): >>43716965 #>>43716974 #>>43717894 #
1. constantcrying ◴[17 Apr 25 14:59 UTC] No.43717894[source]▶
Automatic differentiation can be implemented in essentially any language. Some just make it look "nicer".
replies(1): >>43720122 #
2. kgwgk ◴[17 Apr 25 17:50 UTC] No.43720122[source]▶
For example, it looks nice in Common Lisp: https://people.eecs.berkeley.edu/~fateman/papers/overload-AD...