Microsoft BitNet: inference framework for 1-bit LLMs

(github.com)

167 points galeos | 1 comments | 18 Oct 24 09:10 UTC | HN request time: 0.205s | source

1. zamadatix ◴[18 Oct 24 13:57 UTC] No.41879524[source]▶

For anyone that hasn't read the previous papers before the "1.58-bit" part comes from using 3 values (-1, 0, 1) and log2[3]=1.58...