←back to thread

NoProp: Training neural networks without back-propagation or forward-propagation

(arxiv.org)
161 points belleville | 2 comments | 14 Apr 25 00:03 UTC | HN request time: 0s | source
Show context
DrFalkyn ◴[14 Apr 25 05:27 UTC] No.43678328[source]▶
If we could ever figure out what wet brains actually do (continuous feedback, ? enzyme release ? ) this might be possible
replies(2): >>43679873 #>>43680009 #
friendzis ◴[14 Apr 25 11:04 UTC] No.43680009[source]▶
We know quite a lot. For example, we know that brains have various different nueromodulatory pathways. Take for example dopamine reward mechanism that is being talked about more openly these day. Dopamine is literally secreted by various different parts of the brain and affect different pathways.

I don't think it is anywhere feasible to emulate anything resembling this in a computational neural network with fixed input and output neurons.

replies(2): >>43680560 #>>43683371 #
1. dgfl ◴[14 Apr 25 16:58 UTC] No.43683371[source]▶
Dopamine is not permanent, though. We're talking about long-term synaptic plasticity, not short-term neurotransmitter modulation.
replies(1): >>43683983 #
2. scarmig ◴[14 Apr 25 17:41 UTC] No.43683983[source]▶
Dopamine modulates long term potentiation and depression, in some complicated way.