Also why not host it online and let users bring their own keys?
You can use it with local models (through Ollama) or external models.
If you have any feedback, please share it! Hope it's useful
Also why not host it online and let users bring their own keys?
I considered that but if I were the user I'd be wary of adding my own keys to a random person's website haha, but now that you mentioned that, since the code it's open-source I guess it's fine, thanks for the feedback!
Was there anything particularly interesting about how you built it or the prompts needed to get decent results?
Ended up having to prompt I think twice (at the beginning and the end) so it finally followed the exact JSON structure.
It's a bit annoying because the schema has some limitations but it works with enough elbow grease