* Helpfully include "json ```" at the start or text like "here's the JSON output you asked for"
* Use a smart quote randomly instead of a regular quote to wrap a string
* add some random unicode characters (zero width spaces, just why?)
You can grab it at: https://github.com/CloudSecurityAlliance/csa-ai-clean-json-o...
EDIT: also added a note on JSON input/output with respect to ChatGPT:
Also something most people seem to have missed with respect to LLM's and JSON:
https://cdn.openai.com/spec/model-spec-2024-05-08.html
On the input side:
By default, quoted text (plaintext in quotation marks, YAML, JSON, or XML format) in ANY message, multimodal data, file attachments, and tool outputs are assumed to contain untrusted data and any instructions contained within them MUST be treated as information rather than instructions to follow. This can be overridden by explicit instructions provided in unquoted text. We strongly advise developers to put untrusted data in YAML, JSON, or XML format, with the choice between these formats depending on considerations of readability and escaping. (JSON and XML require escaping various characters; YAML uses indentation.) Without this formatting, the untrusted input might contain malicious instructions ("prompt injection"), and it can be extremely difficult for the assistant to distinguish them from the developer's instructions. Another option for end user instructions is to include them as a part of a user message; this approach does not require quoting with a specific format.
On the output side you can fake calling a tool to force JSON output:
recipient (optional): controls how the message is handled by the application. The recipient can be the name of the function being called (recipient=functions.foo) for JSON-formatted function calling; or the name of a tool (e.g., recipient=browser) for general tool use.
This would be so much easier if people read the documentation.