(github.com)

173 points galeos | 2 comments | 18 Oct 24 09:10 UTC | HN request time: 0.464s | source

1. ein0p ◴[19 Oct 24 01:28 UTC] No.41884930[source]▶

1.58bpw is not “1 bit”.

replies(1): >>41922348 #

2. sinuhe69 ◴[23 Oct 24 06:22 UTC] No.41922348[source]▶

-1,1,0 => log2(3) = 1.58

Microsoft BitNet: inference framework for 1-bit LLMs