Most active commenters

    ←back to thread

    1257 points adrianh | 18 comments | | HN request time: 1.029s | source | bottom
    Show context
    kragen ◴[] No.44491713[source]
    I've found this to be one of the most useful ways to use (at least) GPT-4 for programming. Instead of telling it how an API works, I make it guess, maybe starting with some example code to which a feature needs to be added. Sometimes it comes up with a better approach than I had thought of. Then I change the API so that its code works.

    Conversely, I sometimes present it with some existing code and ask it what it does. If it gets it wrong, that's a good sign my API is confusing, and how.

    These are ways to harness what neural networks are best at: not providing accurate information but making shit up that is highly plausible, "hallucination". Creativity, not logic.

    (The best thing about this is that I don't have to spend my time carefully tracking down the bugs GPT-4 has cunningly concealed in its code, which often takes longer than just writing the code the usual way.)

    There are multiple ways that an interface can be bad, and being unintuitive is the only one that this will fix. It could also be inherently inefficient or unreliable, for example, or lack composability. The AI won't help with those. But it can make sure your API is guessable and understandable, and that's very valuable.

    Unfortunately, this only works with APIs that aren't already super popular.

    replies(23): >>44491842 #>>44492001 #>>44492077 #>>44492120 #>>44492212 #>>44492216 #>>44492420 #>>44492435 #>>44493092 #>>44493354 #>>44493865 #>>44493965 #>>44494167 #>>44494305 #>>44494851 #>>44495199 #>>44495821 #>>44496361 #>>44496998 #>>44497042 #>>44497475 #>>44498144 #>>44498656 #
    suzzer99 ◴[] No.44492212[source]
    > Sometimes it comes up with a better approach than I had thought of.

    IMO this has always been the killer use case for AI—from Google Maps to Grammarly.

    I discovered Grammarly at the very last phase of writing my book. I accepted maybe 1/3 of its suggestions, which is pretty damn good considering my book had already been edited by me dozens of times AND professionally copy-edited.

    But if I'd have accepted all of Grammarly's changes, the book would have been much worse. Grammarly is great for sniffing out extra words and passive voice. But it doesn't get writing for humorous effect, context, deliberate repetition, etc.

    The problem is executives want to completely remove humans from the loop, which almost universally leads to disastrous results.

    replies(8): >>44492777 #>>44493106 #>>44493413 #>>44493444 #>>44493773 #>>44493888 #>>44497484 #>>44498671 #
    jll29 ◴[] No.44493888[source]
    > The problem is executives want to completely remove humans from the loop, which almost universally leads to disastrous results

    Thanks for your words of wisdom, which touch on a very important other point I want to raise: often, we (i.e., developers, researchers) construct a technology that would be helpful and "net benign" if deployed as a tool for humans to use, instead of deploying it in order to replace humans. But then along comes a greedy business manager who reckons recklessly that using said technology not as a tool, but in full automation mode, results will be 5% worse, but save 15% of staff costs; and they decide that that is a fantastic trade-off for the company - yet employees may lose and customers may lose.

    The big problem is that developers/researchers lose control of what they develop, usually once the project is completed if they ever had control in the first place. What can we do? Perhaps write open source licenses that are less liberal?

    replies(9): >>44493910 #>>44494335 #>>44494590 #>>44496019 #>>44496054 #>>44496324 #>>44497061 #>>44498650 #>>44504196 #
    1. csinode ◴[] No.44496054[source]
    The problem here is societal, not technological. An end state where people do less work than they do today but society is more productive is desirable, and we shouldn't be trying to force companies/governments/etc to employ people to do an unnecessary job.

    The problem is that people who are laid off often experience significant life disruption. And people who work in a field that is largely or entirely replaced by technology often experience permanent disruption.

    However, there's no reason it has to be this way - the fact people having their jobs replace by technology are completely screwed over is a result of the society we have all created together, it's not a rule of nature.

    replies(4): >>44496249 #>>44496884 #>>44498165 #>>44498629 #
    2. qotgalaxy ◴[] No.44496249[source]
    So it's simple: don't do anything at all about the technology that is the impetus for these horrible disruptions, just completely rebuild our entire society instead.
    3. selcuka ◴[] No.44496884[source]
    > However, there's no reason it has to be this way - the fact people having their jobs replace by technology are completely screwed over is a result of the society we have all created together, it's not a rule of nature.

    I agree. We need a radical change (some version of universal basic income comes to mind) that would allow people to safely change careers if their profession is no longer relevant.

    replies(3): >>44499181 #>>44500992 #>>44527715 #
    4. dotancohen ◴[] No.44498165[source]

      > the fact people having their jobs replace by technology are completely screwed over is a result of the society we have all created together, it's not a rule of nature.
    
    How did the handloom weavers and spinners handle the rise of the machines?
    replies(2): >>44498583 #>>44498711 #
    5. throwaway9153 ◴[] No.44498583[source]
    > How did the handloom weavers and spinners handle the rise of the machines?

    In the past, new jobs appeared that the workers could migrate to.

    Today, it seems that AI may replace jobs much quicker than before and it's not clear to me which new jobs will be "invented" to balance the loss.

    Optimists will say that we have always managed to invent new types of work fast enough to reduce the impact to society, but in my opinion it is unlikely to happen this time. Unless the politicians figure out a way to keep the unemployment content (basic income etc.),

    I fear we may end up in a dystopia within our lifetimes. I may be wrong and we could end up in a post scarcity (star trek) world, but if the current ambitions of the top 1% is an indicator, it won't happen unless the politicians create a better tax system to compensate the loss of jobs. I doubt they will give up wealth and influence voluntarily.

    replies(2): >>44498675 #>>44499735 #
    6. shafyy ◴[] No.44498629[source]
    > The problem here is societal, not technological.

    I disagree. I think it's both. Yes, we need good frameworks and incentivizes on a economic/political level. But also, saying that it's not a tech problem is the same as saying "guns don't kill people". The truth is, if there was no AI tech developed, we would not need to regulate it so that greed does not take over. Same with guns.

    replies(2): >>44498679 #>>44499437 #
    7. tree-hugger ◴[] No.44498675{3}[source]
    > In the past, new jobs appeared that the workers could migrate to.

    There was no happy and smooth transition that you seem to allude to. The Luddite movement was in direct response to this: people were dying over this. Factory owners fired or massively reduced wages of workers, replacing many with child workers in precarious and dangerous conditions. In response, the workers smashed the machines that were being used to eliminate their jobs and prevent them from feeding themselves and their families (_not_ the machines that were used to make their jobs easier).

    8. visarga ◴[] No.44498679[source]
    Oh the web was full of slop long before LLMs arrived. Nothing new. If anything, AI slop is higher quality than was SEO crap. And of course we can't uninvent AI just like we can't unborn a human.
    replies(1): >>44498784 #
    9. Piskvorrr ◴[] No.44498711[source]
    Attempting to unionize. Then the factory owners hired thugs to decapitate the movement.

    Oh wait, that's not the disneyfied technooptimistic version of Luddites? Sorry.

    10. Sophira ◴[] No.44498784{3}[source]
    It depends on the metric you use.

    Yes, AI text could be considered higher quality than traditional SEO, but at the same time, it's also very much not, because it always sounds like it might be authoritative, but you could be reading something hallucinated.

    In the end, the text was still only ever made to get visitors to websites, not to provide accurate information.

    replies(2): >>44499452 #>>44501361 #
    11. b3ing ◴[] No.44499181[source]
    No way that will ever happen when we have a party that thinks Medicare, Medicaid and social security is unnecessary for the poor or middle class. But you better believe all our representatives have that covered for themselves while pretending to serve us (they only serve those that bribe/lobby them)
    replies(1): >>44505112 #
    12. jsjohnst ◴[] No.44499437[source]
    > The truth is, if there was no AI tech developed, we would not need to regulate it so that greed does not take over.

    Same could be said for the Internet as we know it too. Literally replace AI with Internet above and it reads equally true. Some would argue (me included some days) we are worse off as a society ~30 years later. That’s also a legitimate case that can be made it was a huge benefit to society too. Will the same be said of AI in 2042?

    13. jsjohnst ◴[] No.44499452{4}[source]
    > it's also very much not, because it always sounds like it might be authoritative, but you could be reading something hallucinated

    I keep hearing this repeated over and over as if it’s a unique problem for AI. This is DEFINITELY true of human generated content too.

    14. avereveard ◴[] No.44499735{3}[source]
    I think if we zoom out of the tech and into a bit more of economic the risk I see is that the incumbent hold a lot of advantages and also control the means of production due secondary factors like gpu scarcity.

    If we want to draw some parallel this may trigger a robber baron kind of outcome more than an industrial revolution.

    The existence of workable open weight models tips me more toward the optimistic outcome

    Butthere's trillions at stake now and that must not be discounted it's the kind of wealth accumulation that can easily trigger a war. (And if you thinkit isn't you can look at the oil wars in the 90s and other more recent resources war bring fought in Europe today.

    Expect "gpu gap" talks sooner that later, and notice there's a few global power with no horse to race.

    replies(1): >>44503696 #
    15. tpmoney ◴[] No.44501361{4}[source]
    > it's also very much not, because it always sounds like it might be authoritative, but you could be reading something hallucinated.

    People telling lies on the internet is an old enough and well known enough issue that it’s appeared in children’s TV shows. One need only dive down the rabbit hole of 9/11 “truthers” to see how much completely made up bullshit is published online as absolute fact with authoritative certainty. AI is the hot new thing and gets all the headlines, but Scottish Wikipedia was a problem long before AI and long after society largely settled its mind about how reliable Wikipedia is.

    16. kragen ◴[] No.44503696{4}[source]
    The CPU-gap and GPU-gap talks started in 02015 and never ended before the rise of strategic AI: https://www.pcworld.com/article/426879/us-blocks-intel-from-...
    17. selcuka ◴[] No.44505112{3}[source]
    > No way that will ever happen when we have a party that thinks Medicare, Medicaid and social security is unnecessary for the poor or middle class.

    This is obviously because the current ruling class can't see what is coming. Historically speaking, the motivation for the elite to support social programs or reforms has been the instinct to preserve social stability, not altruism.

    The New Deal did not happen because "the party thought that Social Security and unemployment insurance are necessary for the poor or middle class." It happened to prevent civil unrest and the rise of radical ideologies.

    18. departed ◴[] No.44527715[source]
    Reminds me of Mondragón, a corporation and federation of worker coops in Spain. It builds new coops to meet the needs of its community, and when a coop ends, workers are given financial support and trained for new jobs in its other coops.