Microsoft BitNet: inference framework for 1-bit LLMs

(github.com)

166 points galeos | 1 comments | 18 Oct 24 09:10 UTC | HN request time: 0.205s | source

1. ein0p ◴[19 Oct 24 01:28 UTC] No.41884930[source]▶

1.58bpw is not “1 bit”.