←back to thread

Ask HN: What are you working on (August 2024)?

634 points david927 | 1 comments | 24 Aug 24 22:00 UTC | HN request time: 0s | source

What are you working on? Any new ideas that you're thinking about?
Show context
cl42 ◴[25 Aug 24 01:43 UTC] No.41343613[source]▶
I've been passionate about superforecasting and AI for a long time, so decided to try and use LLMs to structure data about the world -- commodities, politics, etc. It's now a startup we're trying to get off the ground: https://emergingtrajectories.com/

Most of my days are spent reading the news and working on LLMs, which has been a blast. As an example, here's a dashboard that tracks major supply and demand shocks to various commodities around the world: https://emergingtrajectories.com/c/commodities

replies(1): >>41343631 #
sickblastoise ◴[25 Aug 24 01:46 UTC] No.41343631[source]▶
This is really neat, have you had any issues with hallucination?
replies(1): >>41343660 #
1. cl42 ◴[25 Aug 24 01:53 UTC] No.41343660[source]▶
Thanks for asking! Yes, but we're actively addressing them.

We do a few things under the hood to make hallucinations significantly less likely. First, we make sure every single statement made by the LLM has a fact ID associated with it... Then we've fine-tuned "verification" LLMs that review all statements to make sure that assertions being made are backed up by facts, and that the facts are actually aligned with the assertion.

It's still possible for the LLM to hallucinate in this process, but the likelihood is much lower.