←back to thread

Adding a feature because ChatGPT incorrectly thinks it exists

(www.holovaty.com)
1246 points adrianh | 5 comments | 07 Jul 25 14:58 UTC | HN request time: 0.001s | source
Show context
felixarba ◴[07 Jul 25 16:25 UTC] No.44491943[source]▶
> ChatGPT was outright lying to people. And making us look bad in the process, setting false expectations about our service.

I find it interesting that any user would attribute this issue to Soundslice. As a user, I would be annoyed that GPT is lying and wouldn't think twice about Soundslice looking bad in the process

replies(3): >>44492117 #>>44492514 #>>44493393 #
romanhn ◴[07 Jul 25 16:40 UTC] No.44492117[source]▶
While AI hallucination problems are widely known to the technical crowd, that's not really the case with the general population. Perhaps that applies to the majority of the user base even. I've certainly known folks who place inordinate amount of trust in AI output, and I could see them misplacing the blame when a "promised" feature doesn't work right.
replies(1): >>44492486 #
carlosjobim ◴[07 Jul 25 17:14 UTC] No.44492486[source]▶
The thing is that it doesn't matter. If they're not customers it doesn't matter at all what they think. People get false ideas all the time of what kind of services a business might or might not offer.
replies(1): >>44493064 #
dontlikeyoueith ◴[07 Jul 25 18:05 UTC] No.44493064[source]▶
> If they're not customers it doesn't matter at all what they think

That kind of thinking is how you never get new customers and eventually fail as a business.

replies(1): >>44493510 #
carlosjobim ◴[07 Jul 25 18:53 UTC] No.44493510[source]▶
It is the kind of thinking that almost all businesses have. You have to focus on the actual products and services which you provide and do a good job at it, not chase after any and every person with an opinion.

Down voters here on HN seem to live in a egocentric fantasy world, where every human being in the outside world live to serve them. But the reality is that business owners and leaders spend their whole day thinking about how to please their customers and their potential customers. Not other random people who might be misinformed.

replies(2): >>44493845 #>>44496824 #
1. graeme ◴[07 Jul 25 19:32 UTC] No.44493845[source]▶
If people repeatedly have a misunderstanding about or expectation of your business you need to address it though. An llm hallucination is based on widespread norms in training data and it is at least worth asking "would this be a good idea?"
replies(2): >>44494390 #>>44495227 #
2. smaudet ◴[07 Jul 25 20:33 UTC] No.44494390[source]▶
I think the issue here would be that we don't really know just how widespread, nor the impact of the issue.

Ok, sure, maybe this feature was worth having?

But if some people start sending bad requests your way because they can't or only program poorly, it doesn't make sense to potentially degrade the service for your successful paying customers...

3. carlosjobim ◴[07 Jul 25 22:24 UTC] No.44495227[source]▶
An LLM will say that you sell your competitors products or that your farm sells freshly harvested strawberries in the middle of winter. There are no limits to what kind of lies an LLM will invent, and a business owner would be a fool to feel responsible for anything an LLM has told people about their business or products.

The best LLMs available right in this moment will lie without remorse about bus schedules and airplane departure times. How in the world are businesses supposed to take responsibility for that?

Likewise if I have a neighbour who is a notorious liar tell me I can find a piece of equipment in a certain hardware store, should I be mad at the store owner when I don't find it there, or should I maybe be mad at my neighbour – the notorious liar?

replies(1): >>44495346 #
4. graeme ◴[07 Jul 25 22:44 UTC] No.44495346[source]▶
>Likewise if I have a neighbour who is a notorious liar tell me I can find a piece of equipment in a certain hardware store, should I be mad at the store owner when I don't find it there, or should I maybe be mad at my neighbour – the notorious liar?

If you are a store own, AND

1. People repeatedly coming in to your shop asking to buy something, AND

2. It is similar to the kinds of things you sell, from the suppliers you usually get supplies from, AND

3. You don't sell it

Then it sounds like your neighbour the notorious liar is doing profitable marketing for your business and sending you leads which you could profitably sell to, if you sold the item.

If there's a single customer who arrives via hallucination, ignore it. If there's a stream of them, why would you not serve them if you can profit by doing so?

There are obviously instances you'd ignore and you seem to be focussing on those rather than what OP was obviously talking about, repeat instances of sensible ideas

replies(1): >>44499592 #
5. carlosjobim ◴[08 Jul 25 13:05 UTC] No.44499592{3}[source]▶
I guarantee that most businesses have nothing against stocking or offering items that people come in and ask them for - but it has to be possible also. If you're asking for a Polish sausage in a hardware store because your neighbour sent you, then they probably don't have the licenses to sell food items, and probably their profit margin is higher selling hardware than selling sausages so they have no reason to start offering them.

There's usually a good reason why a business might not offer something that people think they should offer. Usually it is that they can't be profitable enough at a price point which customers will accept.