←back to thread

GPT-5.2

(openai.com)
1019 points atgctg | 9 comments | 11 Dec 25 18:04 UTC | HN request time: 1.184s | source | bottom
Show context
onraglanroad ◴[11 Dec 25 21:06 UTC] No.46237160[source]▶
I suppose this is as good a place as any to mention this. I've now met two different devs who complained about the weird responses from their LLM of choice, and it turned out they were using a single session for everything. From recipes for the night, presents for the wife and then into programming issues the next day.

Don't do that. The whole context is sent on queries to the LLM, so start a new chat for each topic. Or you'll start being told what your wife thinks about global variables and how to cook your Go.

I realise this sounds obvious to many people but it clearly wasn't to those guys so maybe it's not!

replies(14): >>46237301 #>>46237674 #>>46237722 #>>46237855 #>>46237911 #>>46238296 #>>46238727 #>>46239388 #>>46239806 #>>46239829 #>>46240070 #>>46240318 #>>46240785 #>>46241428 #
1. noname120 ◴[11 Dec 25 21:49 UTC] No.46237674[source]▶
Problem is that by default ChatGPT has the “Reference chat history” option enabled in the Memory options. This causes any previous conversation to leak into the current one. Just creating a new conversation is not enough, you also need to disable that option.
replies(3): >>46238018 #>>46238056 #>>46238504 #
2. onraglanroad ◴[11 Dec 25 22:17 UTC] No.46238018[source]▶
That seems like a terrible default. Unless they have a weighting system for different parts of context?
replies(1): >>46240078 #
3. redhed ◴[11 Dec 25 22:20 UTC] No.46238056[source]▶
This is also the default in Gemini pretty sure, at least I remember turning it off. Make's no sense to me why this is the default.
replies(2): >>46238580 #>>46239233 #
4. 0xdeafbeef ◴[11 Dec 25 22:57 UTC] No.46238504[source]▶
Only your questions are in it though
5. gordonhart ◴[11 Dec 25 23:04 UTC] No.46238580[source]▶
> Makes no sense to me why this is the default.

You’re probably pretty far from the average user, who thinks “AI is so dumb” because it doesn’t remember what you told it yesterday.

replies(1): >>46238651 #
6. redhed ◴[11 Dec 25 23:11 UTC] No.46238651{3}[source]▶
I was thinking more people would be annoyed by it bringing up unrelated conversations, thinking more I'd say you're probably right that more people are expecting it to remember everything they say.
replies(1): >>46239902 #
7. astrange ◴[12 Dec 25 00:09 UTC] No.46239233[source]▶
Mostly because they built the feature and so that implicitly means they think it's cool.

I recommend turning it off because it makes the models way more sycophantic and can drive them (or you) insane.

8. tiahura ◴[12 Dec 25 01:42 UTC] No.46239902{4}[source]▶
It’s not that it brings it up in unrelated conversations, it’s that it nudges related conversations in unwanted directions.
9. eru ◴[12 Dec 25 02:07 UTC] No.46240078[source]▶
They do (or at least they have something that behaves like weighting).