←back to thread

Every Way to Get Structured Output from LLMs

(www.boundaryml.com)
169 points constantinum | 1 comments | 18 Jun 24 04:01 UTC | HN request time: 0s | source
Show context
thih9 ◴[18 Jun 24 07:10 UTC] No.40714918[source]▶
This is an article written by BAML that shows BAML as the best.

Also, BAML seems to be a commercial product with no clear pricing.

> Our paid capabilities only start if you use Boundary Studio, which focuses on Monitoring, Collecting Feedback, and Improving your AI pipelines. Contact us for pricing details at contact_boundaryml.com

replies(3): >>40714966 #>>40715039 #>>40715330 #
1. hellovai ◴[18 Jun 24 07:18 UTC] No.40714966[source]▶
our paid product is still in Beta actually as we're continuing to build it out, but BAML itself is and always will be open source (runs fully locally as well - no extra network calls).

in terms of parsing, I do think we're likely the best approach as of now. Most other libraries do reprompting or rely on constraining grammars which require owning the model. Reprompting = slow + $$, constraining grammars = require owning the model. we just tried a new approach: parse the output in a more clever way.