←back to thread

678 points georgemandis | 1 comments | | HN request time: 0.001s | source
Show context
tmaly ◴[] No.44379291[source]
The whisper model weights are free. You could save even more by just using them locally.
replies(1): >>44380262 #
1. pzo ◴[] No.44380262[source]
but this is still great trick if you want to reduce latency or inference speed even with local models e.g. in realtime chatbot