I think the wildest thing about the story may be that it's possible this is entirely accidental.
LLM bugs are weird.
replies(2):
There are people out there who are really good at leaking prompts, hence collections like this one: https://github.com/elder-plinius/CL4R1T4S