←back to thread

87 points davidbarker | 1 comments | | HN request time: 0.388s | source
1. space_boy ◴[] No.37744818[source]
Does the LLM also reside on the local machine? I presume there would need to be something to manage the transcription and address queries related to that transcription. It seems like the LLM would require a reasonably extensive context window to be functional. Wouldn’t this necessitate a relatively powerful computer? I am definitely not an expert on this so I could be completely off target on one of these assumptions.. genuinely curious though.