In before people post contradictory anecdotes.
It would be more helpful if people posted the prompt, and the entire context, or better yet the conversation, so we can all judge for ourselves.
replies(4):
It would be more helpful if people posted the prompt, and the entire context, or better yet the conversation, so we can all judge for ourselves.
They can be. The cloud-hosted LLMs add a gratuitous randomization step to make the output seem more human. (In vein with the moronic idea of selling LLM's as sci-fi human-like assistants.)
But you don't have to add those randomizations. Nothing much is lost if you don't. (Output from my self-hosted LLM's is deterministic.)