←back to thread

678 points georgemandis | 2 comments | | HN request time: 0.418s | source
1. tmaly ◴[] No.44379291[source]
The whisper model weights are free. You could save even more by just using them locally.
replies(1): >>44380262 #
2. pzo ◴[] No.44380262[source]
but this is still great trick if you want to reduce latency or inference speed even with local models e.g. in realtime chatbot