Backpropagation is a leaky abstraction (2016)

(karpathy.medium.com)

346 points swatson741 | 1 comments | 02 Nov 25 05:20 UTC | HN request time: 0.207s | source

1. raindear ◴[02 Nov 25 20:42 UTC] No.45793254[source]▶

Are dead ReLUs still a pronlem today? Why not?