Microsoft BitNet: inference framework for 1-bit LLMs

(github.com)

167 points galeos | 1 comments | 18 Oct 24 09:10 UTC | HN request time: 0.205s | source

1. trebligdivad ◴[18 Oct 24 21:05 UTC] No.41883477[source]▶

Has some one made an FPGA or ASIC implementation yet? It feels like it should be easy (and people would snap up for inference).