Most active commenters
  • zby(3)

←back to thread

881 points embedding-shape | 24 comments | | HN request time: 1.771s | source | bottom

As various LLMs become more and more popular, so does comments with "I asked Gemini, and Gemini said ....".

While the guidelines were written (and iterated on) during a different time, it seems like it might be time to have a discussion about if those sort of comments should be welcomed on HN or not.

Some examples:

- https://news.ycombinator.com/item?id=46164360

- https://news.ycombinator.com/item?id=46200460

- https://news.ycombinator.com/item?id=46080064

Personally, I'm on HN for the human conversation, and large LLM-generated texts just get in the way of reading real text from real humans (assumed, at least).

What do you think? Should responses that basically boil down to "I asked $LLM about $X, and here is what $LLM said:" be allowed on HN, and the guidelines updated to state that people shouldn't critique it (similar to other guidelines currently), or should a new guideline be added to ask people from refrain from copy-pasting large LLM responses into the comments, or something else completely?

Show context
gortok ◴[] No.46206694[source]
While we will never be able to get folks to stop using AI to “help” them shape their replies, it’s super annoying to have folks think that by using AI that they’re doing others a favor. If I wanted to know what an AI thinks I’ll ask it. I’m here because I want to know what other people think.

At this point, I make value judgments when folks use AI for their writing, and will continue to do so.

replies(19): >>46206849 #>>46206977 #>>46207007 #>>46207266 #>>46207964 #>>46207981 #>>46208275 #>>46208494 #>>46208639 #>>46208676 #>>46208750 #>>46208883 #>>46209129 #>>46209200 #>>46209329 #>>46209332 #>>46209416 #>>46211449 #>>46211831 #
1. hotsauceror ◴[] No.46207007[source]
I agree with this sentiment.

When I hear "ChatGPT says..." on some topic at work, I interpret that as "Let me google that for you, only I neither care nor respect you enough to bother confirming that that answer is correct."

replies(7): >>46207092 #>>46207476 #>>46209024 #>>46209098 #>>46209421 #>>46210608 #>>46210884 #
2. gardenhedge ◴[] No.46207092[source]
I disagree. It's not a potential avenue for further investigation. Imo ai should always be consulted
replies(2): >>46207341 #>>46208634 #
3. OptionOfT ◴[] No.46207341[source]
But I'm not interested in the AI's point of view. I have done that myself.

I want to hear your thoughts, based on your unique experience, not the AI's which is an average of the experience of the data it ingested. The things that are unique will not surface because they aren't seen enough times.

Your value is not in copy-pasting. It's in your experience.

replies(1): >>46208546 #
4. JeremyNT ◴[] No.46207476[source]
In a work context, for me at least, this class of reply can actually be pretty useful. It indicates somebody already minimally investigated a thing and may have at least some information about it, but they're hedging on certainty by letting me know "the robots say."

It's a huge asterisk to avoid stating something as a fact, but indicates something that could/should be explored further.

(This would be nonsense if they sent me an email or wrote an issue up this way or something, but in an ad-hoc conversation it makes sense to me)

I think this is different than on HN or other message boards, it's not really used by people to hedge here, if they don't actually personally believe something to be the case (or have a question to ask) why are they posting anyway? No value there.

replies(2): >>46208893 #>>46209959 #
5. zby ◴[] No.46208546{3}[source]
What if I agree with what AI wrote? Should I try to hide that it was generated?
replies(2): >>46208717 #>>46208929 #
6. JoshTriplett ◴[] No.46208634[source]
If I wanted to consult an AI, I'd consult an AI. "I consulted an AI and pasted in its answer" is worse than worthless. "I consulted an AI and carefully checked the result" might have value.
7. MarkusQ ◴[] No.46208717{4}[source]
Did you agree with it before the AI wrote it though (in which case, what was the point of involving the AI)?

If you agree with it after seeing it, but wouldn't have thought to write it yourself, what reason is there to believe you wouldn't have found some other, contradictory AI output just as agreeable? Since one of the big objections to AI output is that they uncritically agree with nonsense from the user, scycophancy-squared is even more objectionable. It's worth taking the effort to avoid falling into this trap.

replies(1): >>46209268 #
8. lanstin ◴[] No.46208893[source]
Yeah if the person doing it is smart I would trust they had the reasonable prompt and ruled out flagrant BS answers. Sometimes the key thing is just to know the name of the thing for the answer. It's equally as good/annoying as reporting what Google search gives for the answer. I guess I assume mostly people will do the AI query/search and then decide to share the answer based on how good or useful it seems.
9. subscribed ◴[] No.46208929{4}[source]
No, but this is different.

"I asked an $LLM and it said" is very different than "in my opinion".

Your opinion may be supported by any sources you want as long as it's a genuine opinion (yours), presumably something you can defend as it's your opinion.

replies(1): >>46209340 #
10. giancarlostoro ◴[] No.46209024[source]
You can have the same problem with Googling things, LLMs usually form conclusions I align with when I do the independent research. Google isn't anywhere near as good as it was 5 years ago. All the years of crippling their search ranking system and suppressing results has caught up to them to the point most LLMs are Google replacements.
11. ndsipa_pomu ◴[] No.46209098[source]
To my mind, it's like someone saying "I asked Fred down at the pub and he said...". It's someone stupidly repeating something that's likely stupid anyway.
12. zby ◴[] No.46209268{5}[source]
Well - the point of involving the AI is that very often it explains my intuitions way better than I can. It instantiates them and fills in all the details, sometimes showing new ways.

I find the second paragraphs contradictory - either you fear that I would agree with random stuff that the AI writes or you believe that the sycophant AI is writing what I believe. I like to think that I can recognise good arguments, but if I am wrong here - then why would you prefer my writing from an LLM generated one?

replies(2): >>46209552 #>>46209991 #
13. zby ◴[] No.46209340{5}[source]
I don't know - the linked examples were low quality - sure.
14. MetaWhirledPeas ◴[] No.46209421[source]
> When I hear "ChatGPT says..." on some topic at work, I interpret that as "Let me google that for you, only I neither care nor respect you enough to bother confirming that that answer is correct."

I have a less cynical take. These are casual replies, and being forthright about AI usage should be encouraged in such circumstances. It's a cue for you to take it with a grain of salt. By discouraging this you are encouraging the opposite: for people to mask their AI usage and pretend they are experts or did extensive research on their own.

If you wish to dismiss replies that admit AI usage you are free to do so. But you lose that freedom when people start to hide the origins of their information out of peer pressure or shame.

replies(1): >>46209708 #
15. MarkusQ ◴[] No.46209552{6}[source]
> why would you prefer my writing from an LLM generated one?

Because I'm interested in hearing your voice, your thoughts, as you express them, for the same reason I like eating real fruit, grown on a tree, to sucking high-fructose fruit goo squeezed fresh from a tube.

16. dogleash ◴[] No.46209708[source]
I am amused by the defeatism in your response that expecting anyone to actually try anymore is a lost cause.
replies(3): >>46209756 #>>46210293 #>>46210631 #
17. MetaWhirledPeas ◴[] No.46209756{3}[source]
> expecting anyone to actually try anymore is a lost cause

Well now you're putting words in my mouth.

If you make it against the rules to cite AI in your replies then you end up with people masking their AI usage, and you'll never again be able to encourage them to do the legwork themselves.

18. dogleash ◴[] No.46209959[source]
> can actually be pretty useful. It indicates somebody already minimally investigated a thing

Every time this happens to me at work one of two things happens:

1) I know a bit about the topic, and they're proudly regurgitating an LLM about an aspect of the topic we didn't discuss last time. They think they're telling me something I don't know, while in reality they're exposing how haphazard their LLM use was.

2) I don't know about the topic, so I have to judge the usefulness of what they say based on all the times that person did scenario Number 1.

19. swampangel ◴[] No.46209991{6}[source]
> Well - the point of involving the AI is that very often it explains my intuitions way better than I can. It instantiates them and fills in all the details

> I like to think that I can recognise good arguments, but if I am wrong here - then why would you prefer my writing from an LLM generated one?

Because the AI will happily argue either side of a debate, in both cases the meaningful/useful/reliable information in the post is constrained by the limits of _your_ knowledge. The LLM-based one will merely be longer.

Can you think of a time when you asked AI to support your point, and upon reviewing its argument, decided it was unconvincing after all and changed your mind?

replies(1): >>46211773 #
20. chatmasta ◴[] No.46210293{3}[source]
If someone is asking a technical question along the lines of “how does this work” or “can I do this,” then I’d expect them to Google it first. Nowadays I’d also expect them to ask ChatGPT. So I’d appreciate their preamble explaining that they already did that, and giving me the chance to say “yep, ChatGPT is basically right, but there’s some nuance about X, Y, and Z…”
21. mikkupikku ◴[] No.46210608[source]
These days, most people who try googling for answers end up reading an article which was generated by AI anyway. At least if you go right to the bot, you know what you're getting.
22. mikkupikku ◴[] No.46210631{3}[source]
Expecting people to stop asking casual questions to LLMs is definitely a lost cause. This tech isn't going anywhere, no matter how much you dislike it.
23. KaiserPro ◴[] No.46210884[source]
"lets ask the dipshit" is how my colleague phrases it
24. Kim_Bruning ◴[] No.46211773{7}[source]
You could instead ask Kimi K2 to demolish your point instead, and you may have to hold it back from insulting your mom in the ps.

Generally if your point holds up under polishing under Kimi pressure, by all means post it on HN, I'd say.

Other LLMs do tend to be more gentle with you, but if you ask them to be critical or to steelman the opposing view, they can be powerful tools for actually understanding where someone else is coming from.

Try this: Ask an LLM to read the view of the person you're answering to, and ask it steelman their arguments. Now think to see if your point is still defensible, or what kinds of sources or data you'd need to bolster it.