←back to thread

645 points helloplanets | 1 comments | | HN request time: 0.314s | source
Show context
gtirloni ◴[] No.45005076[source]
Nobody could have predicted this /s

Joke aside, it's been pretty obvious since the beginning that security was an afterthought for most "AI" companies, with even MCP adding secure features after the initial release.

replies(1): >>45005124 #
brookst ◴[] No.45005124[source]
How does this compare to the way security was implemented by early websites, internet protocols, or telecom systems?
replies(5): >>45005206 #>>45005207 #>>45005488 #>>45007680 #>>45010326 #
SoftTalker ◴[] No.45005207[source]
Must we learn the same lessons over and over again? Why? Is our industry particularly stupid? Or just lazy?
replies(6): >>45005267 #>>45005312 #>>45005369 #>>45005463 #>>45005776 #>>45011042 #
evilduck ◴[] No.45005369[source]
Financially motivated to not prioritize security.

It's hard to sell what your product specifically can't do, while your competitors are spending their time building out what they can do. Beloved products can make a whole lot of serious mistakes before the public will actually turn on them.

replies(1): >>45005540 #
SoftTalker ◴[] No.45005540[source]
"Our bridges don't collapse" is a selling point for an engineering firm, on something that their products don't do.

We need to stop calling ourselves engineers when we act like garage tinkerers.

Or, we need to actually regulate software that can have devastating failure modes such as "emptying your bank account" so that companies selling software to the public (directly or indirectly) cannot externalize the costs of their software architecture decisions.

Simply prohibiting disclaimer of liability in commercial software licenses might be enough.

replies(2): >>45005847 #>>45006393 #
brookst ◴[] No.45005847[source]
Call yourself whatever you choose, but the garage tinkerers will always move faster and discover new markets before the Very Serious Engineers have completed the third review of the comprehensive threat model with all stakeholders.
replies(2): >>45006208 #>>45011930 #
1. dns_snek ◴[] No.45011930[source]
The only reason this works out the way it does is because certain governments have been corrupted by business interests to the point that businesses don't have to face any accountability for the harm that they cause.

If companies were fined serious amounts of money and the people responsible went to prison if they committed gross negligence and harmed millions of people, the attitude would quickly change. But as things stand, the system optimizes for carelessness, indifference towards harm, and sociopathy.