Reason #1395292 that you should be using vLLM, but given the downvotes I get for pointing this out it appears that HN really hates lots of tok/s (yes, even with batch size of 1 on your low tier GPU this is true)
Why does anyone in the GenAI care about copyright, licenses, etc? (besides for being nice and getting the community to like you, which should matter for Ollama)
This whole field is built off piracy at a scale never before seen. Aaron Swartz blushes when he thinks about what Llama and other projects pulled off without anyone getting arrested. Why should I care when one piracy project messes with another?
The whole field is basically a celebration of copyright abolitionism and the creation of "dual power" ala 1917 Russia where copyright doesn't matter. Have some consistency and stop caring about this stuff.