Oh I wad hoping this would go back another step in the 5 whys and why use an LLM conversationally at all.
By the time you got a nice well established context with the right info... just give it to the user.
I like the idea of hallucination-free systems where the LLM merely classifies things at most.
Question -> classifier -> check with user action to take -> act using no AI