←back to thread

170 points judicious | 1 comments | | HN request time: 0.231s | source
Show context
Legend2440 ◴[] No.45406467[source]
Article doesn’t mention this, but I’d consider neural networks a form of branchless programming. It’s all a bunch of multiply and threshold operations.
replies(2): >>45406503 #>>45407289 #
1. david-gpu ◴[] No.45407289[source]
> It’s all a bunch of multiply and threshold operations.

Real-world high-performance matrix multiplication functions do contain branches internally, even on GPUs. If you are ever curious about what that looks like, NVidia maintains an open-source library called CUTLASS.