Microsoft BitNet: inference framework for 1-bit LLMs

(github.com)

166 points galeos | 1 comments | 18 Oct 24 09:10 UTC | HN request time: 0.859s | source

1. delegate ◴[18 Oct 24 20:46 UTC] No.41883348[source]▶

I assume it is not as powerful at some tasks than full sized model, so what would one use this model for ?