Between the Booms: AI in Winter – Communications of the ACM

every other article these days on this site is about AI. And it's incredibly tedious and annoying.

Isn't it enough that clueless marketers who get their Tech knowledge from businessinsider and bloomberg are constantly harping on about AI.

Seems we as a community have resigned or given up in this battle against common sense. Maybe long ago. Still there should be some form of moderation penalizing these shill posts that only glorify AI as being the future, ... the same way that not everything about crypto or the blockchain ended up on the FP. Seems with AI we're looking the other way and are OK with it?

Or maybe it's me.

Nah, it’s not just you.

AI is really neat. I don’t understand how a business model that makes money pops out on the other end.

At least crypto cashed out on NFTs for a while.

> I don’t understand how a business model that makes money pops out on the other end

Tractors and farming.

By turning what is traditionally a labour intensive product into a capital intensive one.

For now, the farmers who own tractors will beat the farmers who need to hire, house and retain workers (or half a dozen children).

This goes well for quite some time, where you can have 3 people handle acres & acres.

I'll be around explaining how coffee beans can't be picked by a tractor or how vanilla can't be pollinated with it.

Crypto is coming back for another heist. Will probably die a bit once Trump finishes his term

It's a CACM article. Without having read this one, I'd say CACM articles on HN are absolutely appropriate.

> Artificial life fizzled as a meta discipline

I've wondered for a while if Artificial Life is in its own winter, waiting for someone to apply the lessons of scale we learned from neural nets.

good point about the business model. probably AI has more even the ones reaping the rewards are only 4 or 5 big corps.

It seems with crypto the business "benefits" were mostly adversarial (winners were those doing crimes on the darknet, or to allow ransomware operators to get paid). The underlying blockchain Tech itself though failed to replace transactions in a database.

The main value for AI today seems to be generative Tech to improve the quality of Deepfakes or to help everyone in Business write their communication with an even more "neutral" non-human like voice, free of any emotion, almost psychopathic. Like the dudes who are writing about their achievements on LinkedIn in 3rd person, ... Only now it's psychopathy enabled by the machine.

Also I've seen people who, without AI are barely literate, are now sending emails that look like they've been penned by a post-doc in English literature. The result is it's becoming a lot harder to separate the morons, and knuckle-draggers from those who are worth reaching out and talking to.

yes old man yelling at cloud.

It's you.

The AI discussions can indeed be repetitive and tiresome here, especially for regulars, but they already seem to be downweighted and clear off the front page quite fast.

But it's a major focus of the industry right now, involving a genuinely novel and promising new class of tools, so the posts belong here and the high engagement that props them up seems expected.

And I'll be around explaining why it's a bad idea to stockpile $X00,000,000 worth of Equipment in Columbia, where coffee grows readily.

Capital intensive industries require low crime and geopolitical stability. Strongman politics means that investors who buy such equipment will simply be robbed at literal gunpoint by local gangs.

I agree with you. I just don't see the AI "summer" happening.

that's not really a justification in my view. The entire education industry is complicit in this circus. It's not just engineers hoping to get a payday it's academics too that are hoping to get funding and tenure.

CACM was totally complicit in spreading the blockchain hype: https://cacm.acm.org/?s=blockchain

That said, I'm not hating the player, people gotta eat. But I totally lack appreciation for the game.

I may be mistaken, but I was under the impression that, largely, farmers do not own their equipment. They lease it, and it costs a lot.

Edit: Also, 3 people can handle 100 acres of land, given the crop. That happens today.

The 1980s AI "boom" was tiny.

In the 1980s, AI was a few people at Stanford, a few people at CMU, a few people at MIT, and a scattering of people elsewhere. There were maybe a half dozen startups and none of them got very big.

> It's you.

Not just him.

> But it's a major focus of the industry right now, involving a genuinely novel and promising new class of tools, so the posts belong here and the high engagement that props them up seems expected.

In your opinion (and admittedly others), but that doesn't make the overhype any less tiresome. Yes it is novel technology, but there's alway novel technology, and it isn't all in one area, but you wouldn't know it by what hits the front page these days.

Anyway, it's useless to shake fists at the clouds. This hype will pass, just like all the others before it, and the discussion can again be proportional to the relevance of the topic.

We're seeing artificial life come back as non-player characters in video games.

Quite incorrect, even smaller colleges like in Greeley Colorado had Symbolics machines and there are threads of Expert Systems all throughout the industry.

The industry as a whole was smaller though.

The word sense disambiguation problem did kill a lot of it pretty quickly though.

Threads, yes. We had one Symbolics 3600, the infamous refrigerator-sized personal computer, at the aerospace company. But it wasn't worth the trouble. Real work was done with Franz LISP on a VAX and then on Sun workstations.

There were a lot of places that tried a bit of '80s "AI", but didn't accomplish much.

I don't know about the professional professionals, but as a science professor, I have to wear a lot of hats, which has required me to gain skills in a multitude of areas outside my area of deep expertise.

I use Claude and Chatgpt EVERY DAY.

Those services help me run out scripts for data munging, etc etc very quickly. I don't use it for high expertise writing, as I find it takes more than I get back, but I do use it to put words on a page for more general things. If your deep expertise is programming, you may not use it much either for that. But man oh man has it magnified my output on the constellation of things I need to get done.

What other innovation in the last decade has been this disruptive? Two years ago, I didn't use this. Now I do as part of my regular routine, and I am more valuable for it. So yes, there is hype, but man oh man, is the hype deserved. Even if AI winter started right now, the productivity boom from Claude level LLMs is nothing short of huge.

depends on the crop. Strawberries? No. Wheat, yes.

2/3 of the fortune 100 companies used Expert Systems in their daily operations and knowledge bases survived.

I don't know how that can be dismissed as nothing.

> I don’t understand how a business model that makes money pops out on the other end.

What issues do you see?

I pay for ChatGPT and for cursor and to me that's money very well spent.

I imagine tools like cursor will become common for other text intensive industries, like law, soon.

Agreed that the hype can be over the top, but these are valuable productivity tools, so I have some trouble understanding where you're coming from.

I feel like the raw numbers kind of indicate that the amount of money spent on training, salary, and overhead doesn't add up. "We'll beat them in volume" keeps jumping out at me.

Sure does. I agree. Crop-type wasn't specified.

Edit: Crop-type was specified, I was incorrect.

What you're paying for ChatGPT is not likely covering their expenses, let alone making up their massive R&D investment. People paid for Sprig and Munchery too, but those companies went out of business. Obviously what they developed wasn't nearly as significant as what OpenAI has developed, but the question is: where will their pricing land once they need to turn a profit? It may well end up in a place where it's not worth paying ChatGPT to do most of the things it would be transformative for at its current price.

[1]: https://www.fooddive.com/news/sprig-is-the-latest-meal-deliv...

[2]:https://techcrunch.com/2019/01/21/munchery-shuts-down/?gucco...

Personal anecdotes on the benefits of using LLMs don't address complaints about tedious articles over-marketing AI tech. That LLMs provide benefits is well known at this point, it doesn't mean we can't recognize the latest hype cycle for what it is. There's a long list of previous technologies that were going to "change everything".

I've worked in the analytics space for over ten years building what today is called "AI" as a service or product. The hype seems more like pent up release for the valid stuff, and block chain for the tech marketer type stuff.

> It's you.

I disagree.

Question is whether these companies are profitable off the services they're providing, or still being propped up by all the VC money pouring in.

surely it's not hype if it works?

> I use Claude and Chatgpt EVERY DAY.

We use several tools derived from "AI research" every single day in our lives.

They are tools and, at every cycle, we gain new tools. They hype is the issue.

Yes, of course, but they almost always did too. Internet. Mobile Phones.

I think the issue is whether you think that HN posts on AI are basically marketing, or about sharing new advances with a community that needs to be kept on top of new advances. Some posts are from a small startup trying something, or from a person sharing a tool. I think these are generally valuable. I might benefit from a RAG, but won't build one from scratch. In terms of this crowd, I can't think of advances that in other areas that are as impactful as machine learning lately. Its not like crypto. Crypto was an interesting innovation, but one in which mostly sought a market instead of the a market seeking an innovation. There is no solid "just use a database" analogical response here like was the well used refrain to attempt at practical uses of cryptocurrency tech. Sure, AI companies built on selling something silly like "the perfect algorithm to find you a perfect date!" is pure hackery, but even at the current level of llm, I don't think we are any where near understanding its full potential/application. So even if we are on the brink of an AI winter, its in the Bahamas.

Also, looking at the most popular stories with AI in the title over the last month show quite a varied array of topics. https://hn.algolia.com/?dateRange=pastMonth&page=0&prefix=fa...

If HN readers feel that AI-related articles are showing up too much, then I'd say it would be on them to find articles on topics that interest them and post them to HN.

My problem is the abuse of the term AI to a point where it has lost all meaning. I'd be all for a ban on the term in favour of the specific method driving the 'intelligence' as I would rule out some of qualifying simple because they are not capable of making intelligent decisions, even if they can make complex ones (looking at you random forest).

How does any of that apply to this particular article? Isn't a broader historical perspective exactly what's needed if you want to be free from the immediate hype cycle?

One of my biggest irritations with HN comment sections is how frequently people seem to want to ignore the specific interesting thing an article is about and just express uninteresting and repetitive generic opinions about the general topic area instead.

Nitpick: s/Columbia/Colombia/

+1. The other concern is that AI is potentially removing junior level jobs that are often a way for people to gain experience before stepping up into positions with more agency and autonomy. Which means in future we will be dealing with the next generation of "AI told me to do this", but "I have no experience to know whether this is good or not", so "let's do it".

I paid money to Amazon for most of a decade before they had a profitable year.

Well AI probably is the future. Might not necessarily be LLMs (I personally don't rate LLMs) but enough people are interested in it nowadays that it's almost certain AGI will happen in our lifetimes.

You realize they had razor thing margins on purpose, right?

Honestly I'm intrigued on why you don't rate LLM. Arguably the main reason AI got out from its winter is the emergence of LLM.

Because I can't see current techniques for creating LLMs fixing the pre-training problem. Right now big tech companies are training LLMs on, well, pretty much all human knowledge ever assembled, and they're still pretty dumb. They're wrong far too often and they don't have the capacity to learn and figure out things with a limited amount of data as humans do. Also, it's pretty clear that LLMs are flatlining.

Now, they are good text interfaces. They're good for parsing and creating text. There even seems to be very, very basic thought and maybe even creativity (at a very, very basic level). At this point though, I can't see them improving much more without a major change in technology, techniques, something. The first time I saw them I thought they were just regression analysis on steroids, and not going to lie, they still have that vibe considering tech companies have clusters up to 350k H100s and LLMs still are dumber than the average person for most tasks.

I'm currently creating an app that uses an LLM as an interface and it's definitely interesting, but most of the heavy lifting of the app will be the functions it calls and a knowledge database since it needs to have more concrete and current knowledge. But hey, it's nicer than implementing search from scratch I guess.

Looking at history, anything in its first few iterations costs insane and stay as luxury or is sold at massive loss. Once the research goes on for several years, the costs keep coming down first very slowly and then in avalanche . The question always remains to which one can continue “selling at a loss” long enough to last the point until the costs continue going down while people are used to paying standard price(see smartphones), or the product is so market dominant that competition does not have resources to compete and cost can be raised(see Netflix).

On the contrary, Junior positions will be more and growing because now you do not have the fear of Juniors being liability for a while as with very little guidance they can get stuff done while Seniors keep an eye on bigger things and have free time not being spammed by n00b queries.

Also, given the saturation of STEM graduates now, you have proven group of juniors who can learn themselves over expensive lottery of bootcampers who might bail out the moment it is no longer the surface level React anymore.

With AI, more tiny businesses can launch into market and hire juniors and part time expertise to guide the product slowly without the massive VC money requirement.

It's been a common problem with HN. I remember when NodeJS came out, it was exactly the same, and then with all the crypto-craze.

> I use Claude and Chatgpt EVERY DAY […] What other innovation in the last decade has been this disruptive?

I use some sort of IDE everyday. Previously at my early days, I was a “true-hacker” and using Vim in console to type out massive code bases, we had waterfall development practices, I would fumble through source codes of various poorly documented features of the language or libraries for hours to figure out about needed function/method/attribute and how anything really worked and the quirks of strange error messages needing to call up the vendor or buy a book on the topic and hope it had answers… and of course, I practiced typing every weekend to speed up my typing speed.

Now, I just type something and the IDE reads my mind and shows appropriate suggestions and also helpfully imports the packages for me while also constantly formatting my codebase on save and raising red/yellow squigglies to suggest my mistakes. I copy paste any quirky errors in a search engine and immediately find other human beings reporting the problem and solutions, I can happily continue developing on the same codebase and parallel features while other teams can continue with their features and we’ll know soon if we have stepped on each others’ toes shortly in CI pipeline. What took me weeks now takes like few hours and if someone told me to do the same in Vim, I’d be blankly looking at them because that is arcane. Of course my IDE misguesses sometimes and I can correct it, but I am insanely productive now compared to decades back. What other innovation has made this kind of gains?

Also I could take a horse and go to a duty travel in another continent for a several month or even year journey, but now I can take a flight and be there in hour and I am saving insane amount of time.

The examples can go on, we have new novelties which are ground breaking, but AI is too much hype, and it is not well deserved. All the hype comes because the VC money burning on it and needs the prep the market for massive return. Too much of hype can turn sour if that topic had been seen to rise and die a fee times, hence it is natural that a lot of HN audience do not feel great to look at this anymore.