←back to thread

602 points emrah | 2 comments | | HN request time: 0.428s | source
Show context
trebligdivad ◴[] No.43744014[source]
It seems pretty impressive - I'm running it on my CPU (16 core AMD 3950x) and it's very very impressive at translation, and the image description is very impressive as well. I'm getting about 2.3token/s on it (compared to under 1/s on the Calme-3.2 I was previously using). It does tend to be a bit chatty unless you tell it not to be; pretty much everything it'll give you a 'breakdown' unless you tell it not to - so for traslation my prompt is 'Translate the input to English, only output the translation' to stop it giving a breakdown of the input language.
replies(2): >>43744070 #>>43747653 #
simonw ◴[] No.43744070[source]
What are you using to run it? I haven't got image input working yet myself.
replies(2): >>43744122 #>>43744621 #
1. terhechte ◴[] No.43744621[source]
Image input has been working with LM Studio for quite some time
replies(1): >>43758714 #
2. tough ◴[] No.43758714[source]
need it here for cli usage!

https://github.com/agustif/llm-lmstudio