Most active commenters
  • _heimdall(5)
  • slashdev(5)
  • DenisM(5)
  • delis-thumbs-7e(4)
  • api(3)

←back to thread

387 points reaperducer | 75 comments | | HN request time: 0.868s | source | bottom
1. jacquesm ◴[] No.45772081[source]
These kinds of deals were very much a la mode just prior to the .com crash. Companies would buy advertising, then the websites and ad agencies would buy their services and they'd spend it again on advertising. The end result is immense revenues without profits.
replies(6): >>45772090 #>>45772213 #>>45772293 #>>45772318 #>>45772433 #>>45774073 #
2. CPLX ◴[] No.45772090[source]
Exactly, everything old is new again. This was one of the drivers of the original dot-com bubble.
3. TZubiri ◴[] No.45772213[source]
I'd gander a guess that there's nothing tech specific here and that fraudulent schemes are well defined for the SEC and commercial courts to take action if something is not kosher
replies(1): >>45772250 #
4. datadrivenangel ◴[] No.45772250[source]
It's usually not actually fraud. It's the amazon reinvesting back into growth, except the unit economics don't work if everyone cashes out at the same time, and if anyone starts cashing out the growth stops and everyone cashes out before it's too late.
5. forgetfulness ◴[] No.45772293[source]
Circular investments were also a compounding factor in the Japanese asset price bubble.

The practice was known as “zaitech”

> zaitech - financial engineering

> In 1984, Japan’s Ministry of Finance permitted companies to operate special accounts for their shareholdings, known as tokkin accounts. These accounts allowed companies to trade securities without paying capital gains tax on their profits.

> At the same time, Japanese companies were allowed to access the Eurobond market in London. Companies issued warrant bonds, a combination of traditional corporate bonds with an option (the “warrant") to purchase shares in the company at a specified price before expiry. Since Japanese shares were rising, the warrants became more valuable, allowing companies to issue bonds with low-interest payments.

> The companies, in turn, placed the money they raised into their tokkin accounts that invested in the stock market. Note the circularity: companies raised money by selling warrants that relied on increasing stock prices, which was used to buy more shares, thus increasing their gains from investing in the stock market.

https://www.capitalmind.in/insights/lost-decades-japan-1980s...

replies(1): >>45775169 #
6. zemvpferreira ◴[] No.45772318[source]
There’s one key difference in my opinion: pre-.com deals were buying revenue with equity and nothing else. It was growth for growth’s sake. All that scale delivered mostly nothing.

OpenAI applies the same strategy, but they’re using their equity to buy compute that is critical to improving their core technology. It’s circular, but more like a flywheel and less like a merry-go-round. I have some faith it could go another way.

replies(13): >>45772378 #>>45772392 #>>45772490 #>>45772554 #>>45772661 #>>45772731 #>>45772738 #>>45772759 #>>45773088 #>>45773089 #>>45773096 #>>45773105 #>>45774229 #
7. Arkhaine_kupo ◴[] No.45772378[source]
> they’re using their equity to buy compute that is critical to improving their core technology

But we know that growth in the models is not exponential, its much closer to logarithmic. So they spend =equity to get >results.

The ad spend was a merry go round, this is a flywheel where the turning grinds its gears until its a smooth burr. The math of the rising stock prices only begins to make sense if there is a possible breakthrough that changes the flywheel into a rocket, but as it stands its running a lemonade stand where you reinvest profits into lemons that give out less juice

replies(4): >>45772556 #>>45772953 #>>45773865 #>>45775942 #
8. ignoramous ◴[] No.45772392[source]
> There’s one key difference in my opinion

The other difference (besides Sam's deal making ability) is, willing investors: Nvidia's stock rally leaves it with a LOT of room to fund big bets right now. While in Oracle's case, they probably see GenAI as a way to go big in the Enterprise Cloud business.

replies(1): >>45772423 #
9. afavour ◴[] No.45772423{3}[source]
> Nvidia's stock rally leaves it with a LOT of room to fund big bets right now

And then what happens if the stock collapses?

replies(1): >>45773001 #
10. orochimaaru ◴[] No.45772433[source]
Gita Gopinath (imf’s economist) sounded the alarm on the scale of this - https://www.afr.com/wealth/investing/the-crash-that-could-to...
replies(2): >>45773502 #>>45773513 #
11. moralestapia ◴[] No.45772490[source]
>they’re using their equity to buy compute that is critical to improving their core technology

That's only like 1/8th of the flywheel, though.

12. api ◴[] No.45772554[source]
The assumption is that they have a large moat.

If they don't then they're spending a ton of money to level up models and tech now, but others will eventually catch up and their margins will vanish.

This will be true if (as I believe) AI will plateau as we run out of training data. As this happens, CPU process improvements and increased competition in the AI chip / GPU space will make it progressively cheaper to train and run large models. Eventually the cost of making models equivalent in power to OpenAI's models drops geometrically to the point that many organizations can do it... maybe even eventually groups of individuals with crowdfunding.

OpenAI's current big spending is helping bootstrap this by creating huge demand for silicon, and that is deflationary in terms of the cost of compute. The more money gets dumped into making faster cheaper AI chips the cheaper it gets for someone else to train GPT-5+ competitors.

The question is whether there is a network effect moat similar to the strong network effect moats around OSes, social media, and platforms. I'm not convinced this will be the case with AI because AI is good at dealing with imprecision. Switching out OpenAI for Anthropic or Mistral or Google or an open model hosted on commodity cloud is potentially quite easy because you can just prompt the other model to behave the same way... assuming it's similar in power.

replies(2): >>45772632 #>>45772671 #
13. J_McQuade ◴[] No.45772556{3}[source]
There is something about an argument made almost entirely out of metaphors that amuses me to the point of not being able to take it seriously, even if I actually agree with it.
replies(1): >>45772683 #
14. simgt ◴[] No.45772632{3}[source]
> This will be true if (as I believe) AI will plateau as we run out of training data.

Why would they run out of training data? They needed external data to bootstrap, now it's going directly to them through chatgpt or codex.

replies(1): >>45772769 #
15. _heimdall ◴[] No.45772661[source]
I think that, at best, that description boils down to Nvidia, Oracle, etc inventing fake wealth to build something and OpenAI building their own fake wealth by getting to use that new compute effectively for free.

There are physical products involved, but the situation otherwise feels very similar to ads prior to dotcom.

replies(1): >>45772724 #
16. delis-thumbs-7e ◴[] No.45772671{3}[source]
Apple new M5 can run models over 10B parametres and if they give their new Studio next year enough juice, it can run maybe 30B local model. How long is it that you can run a full GPT-5 on your laptop or homeserver with few grands worth of hardware? What is going to happen to all these GPU farms, since as I understood they are fairly useless for anything else?
replies(2): >>45773442 #>>45773729 #
17. powerhouse007 ◴[] No.45772683{4}[source]
As much as I dislike metaphors, this sounded reasonable to me. Just don't go poking holes in the metaphor instead of the real argument.
replies(1): >>45773054 #
18. slashdev ◴[] No.45772724{3}[source]
The same way the stock market invents a trillion dollars of fake wealth on a strong up day?

That's capital markets working as intended. It's not necessarily doomed to end in a fiery crash, although corrections along the way are a natural part of the process.

It seems very bubbly to me, but not dotcom level bubbly. Not yet anyway. Maybe we're in 1998 right now.

replies(4): >>45772870 #>>45772910 #>>45773371 #>>45773746 #
19. brazukadev ◴[] No.45772731[source]
Yes, this time is different, trust big bro sama.
20. ◴[] No.45772738[source]
21. bayarearefugee ◴[] No.45772759[source]
> critical to improving their core technology

It is at the very least highly debatable how much their core technology is improving from generation to generation despite the ballooning costs.

22. delis-thumbs-7e ◴[] No.45772769{4}[source]
As much ChatGPT says I’m basically a genius for asking it a good Vegan cake recipes, I don’t think that is providing it any data it doesn’t already have that makes it anyway better. Also at this point the massive increases in data and computing power seem to bring ever decreasing improvements (and sometimes just decline), so it seems we are simply hitting a limit this kind of architecture can achieve no matter what you throw at it.
replies(1): >>45773117 #
23. staticautomatic ◴[] No.45772870{4}[source]
I sell you a cat for $1B and you sell me a dog for $1B and now we’re both billionaires! Whether the capital markets “want” that or not it’s still silly.
replies(1): >>45773549 #
24. rapind ◴[] No.45772910{4}[source]
I think it's worse. The US market feels like a casino to me right now and grift is at an all time high. We're not getting good economic data, it's super unpredictable, and private equity is a disaster waiting to happen IMO. For sure there are smart people able to make money on the gamble, but it's not my jam.

I don't tend to benefit from my predictions as things always take longer to unfold than I think they will, but I'm beyond bearish at present. I'd rather play blackjack.

replies(1): >>45773618 #
25. DenisM ◴[] No.45772953{3}[source]
OpenAI invests heavily into integration with other products. If model development stalls they just need to be not worse than other stalled models while taking advantage of brand recognition and momentum to stay ahead in other areas.

In that sense it makes sense to keep spending billions even f model development is nearing diminishing return - it forces competition to do the same and in that game victory belongs to the guy with deeper pockets.

Investors know that, too. A lot of startup business is a popularity contents - number one is more attractive for the sheer fact of being number one. If you’re a very rational investor and don’t believe in the product you still have to play this game because others are playing it, making it true. The vortex will not stop unless limited partners start pushing back.

replies(2): >>45773037 #>>45773189 #
26. mulmen ◴[] No.45773001{4}[source]
Hence the emphasis on right now.
27. otherjason ◴[] No.45773037{4}[source]
But, if model development stalls, and everyone else is stalled as well, then what happens to turn the current wildly-unprofitable industry into something that "it makes sense to keep spending billions" on?
replies(3): >>45773432 #>>45773992 #>>45774565 #
28. gilleain ◴[] No.45773054{5}[source]
Indeed, poking holes in the metaphor is like putting a pin in a balloon, rather than knocking it out of the park by addressing the real argument.
29. 0xbadcafebee ◴[] No.45773088[source]
Eventually when ChatGPT replaces Google Search, they will run ads, and so have that whole revenue stream. Still isn't enough money to buy the trillions worth of infrastructure they want, but it might be enough to keep the lights on.
replies(2): >>45773428 #>>45778513 #
30. SecretDreams ◴[] No.45773089[source]
> I have some faith it could go another way.

I wonder how they felt during the .com era.

31. bgwalter ◴[] No.45773096[source]
Dotcom scams included "vendor financing", where telecom equipment providers invested in their customers who built infrastructure:

https://time.com/archive/6931645/how-the-once-luminous-lucen...

The customers bought real equipment that was claimed to be required for the "exponential growth" of the Internet. It is very much like building data centers.

32. runarberg ◴[] No.45773105[source]
Wasn’t there also a bunch of telecom infrastructure created in the dot-com bubble, tangible products created, etc? Things like servers, telephone wires, underwater internet cables, tech-storefronts, internet satellites, etc.
replies(1): >>45773218 #
33. DenisM ◴[] No.45773117{5}[source]
ChatGPT chat logs contain massive amount of data teased out of people’s brains. But much of it is lore, biases, misconceptions, memes. There are nuggets of gold in there but it’s not at all clear if there’s a good way to extract them, and until then chat logs will make things worse, not better.

I’m thinking they eventually figure out who is the source of good data for a given domain, maybe.

Even if that is solved, models are terrible at long tail.

replies(3): >>45773766 #>>45777609 #>>45781499 #
34. chii ◴[] No.45773189{4}[source]
The bigger threat is if their models "stall", while a new up-start discovers an even better model/training method.

What _could_ prevent this from happening is the lack of available data today - everybody and their dog is trying to keep crawlers off, or make sure their data is no longer "safe"/"easy" to be used to train with.

replies(1): >>45774313 #
35. spogbiper ◴[] No.45773218{3}[source]
so much fiber was run that in the US over 90% of it wasn't even used
36. teiferer ◴[] No.45773371{4}[source]
> It seems very bubbly to me, but not dotcom level bubbly.

Not? Money is thrown after people without really looking at the details, just trying to get in on the hype train? That's exactly how the dotcom bubble felt like.

replies(1): >>45773583 #
37. schmidtleonard ◴[] No.45773428{3}[source]
That's an insightful point! Making insightful points like that one is taxing on the brain, you should consider an electolyte drink like Brawndo™ (it's got what plants crave) to keep yourself sharp!

Ugh I hate it so much, but you're right, it's coming.

replies(1): >>45774764 #
38. accrual ◴[] No.45773432{5}[source]
I suspect if model development stalls we may start to see more incremental releases to models, perhaps with specific fixes or improvements, updates to a certain cutoff date, etc. So less fanfare, but still some progress. Worth spending billions on? Probably not, but the next best avenue would be to continue developing deeper and deeper LLM integrations to stay relevant and in the news.

The new OpenAI browser integration would be an example. Mostly the same model, but with a whole new channel of potential customers and lock in.

39. treis ◴[] No.45773442{4}[source]
Very few people own top of the line Macs and most interactions are on phones these days. We are many generations of phones away from running GPT-5 on a phone without murdering your battery.

Even if that weren't true having your software be cheaper to run is not a bad thing. It makes the software more valuable in the long run.

40. whimsicalism ◴[] No.45773502[source]
Stopped clock…

2020: https://www.youtube.com/watch?v=rpiZ0DkHeGE 2019: https://www.cadtm.org/spip.php?page=imprimer&id_article=1732...

41. slashdev ◴[] No.45773549{5}[source]
If we’re both willing to pay that in a free market economy, then we both leave the deal happy.

Things are worth what people are willing to pay for them. And that can change over time.

Sentiment matters more than fundamental value in the short term.

Long term, on a timescale of a decade or more, it’s different.

replies(3): >>45774137 #>>45774236 #>>45777870 #
42. slashdev ◴[] No.45773583{5}[source]
Nvidia has a trailing PE of 50. Cisco was 200 At the height of the dotcom bubble.

Nowhere near that level. There’s real demand and real revenue this time.

It won’t grow as fast as investors expect, which makes it a bubble if I’m right about that. But not comparable to the dotcom bubble. Not yet anyway.

replies(1): >>45773780 #
43. slashdev ◴[] No.45773618{5}[source]
More money is lost by bears fighting a bull market, than in actual bear market crashes.

I’ve made that mistake already.

I’m nervous about the economic data and the sky high valuations, but I’ll invest with the trend until the trend changes.

44. api ◴[] No.45773729{4}[source]
Quantized, a top-end Mac can run models up to about 200B (with 128GiB of unified RAM). They'll run a little slow but they're usable.

This is a pricey machine though. But 5-10 years from now I can imagine a mid-range machine running 200-400B models at a usable speed.

replies(1): >>45781528 #
45. _heimdall ◴[] No.45773746{4}[source]
The stock market isn't inventing money. Those investing in the stock market might be, those buying on leverage for example.

Capital markets weren't intended for round trip schemes. If a company on paper hands 100B to another company who gives it back to the first company, that money never existed and that is capital markets being defrauded rather than working as expected.

46. api ◴[] No.45773766{6}[source]
When I say models will plateau I don't mean there will be no progress. I mean progress will slow down since we'll be scraping the bottom of the barrel for training data. We might never quite run out but once we've sampled every novel, web site, scientific paper, chat log, broadcast transcript, and so on, we've exhausted the rich sources for easy gains.
replies(1): >>45774292 #
47. _heimdall ◴[] No.45773780{6}[source]
We shouldn't judge whether an indicator is stable or okay only by looking to see if its the highest historical value.

PE ratios of 50 make no sense, there is no justification for such a ratio. At best we can ignore the ratio and say PE ratios are only useful in certain situations and this isn't one of them.

Imagine if we applied similar logic to other potential concerns. Is a genocide of 500,000 people okay because others have done drastically more?

replies(1): >>45773887 #
48. brokencode ◴[] No.45773865{3}[source]
Yeah, except you can keep on squeezing these lemons for a long time before they run out of juice.

Even if the model training part becomes less worthwhile, you can still use the data centers for serving API calls from customers.

The models are already useful for many applications, and they are being integrated into more business and consumer products every day.

Adoption is what will turn the flywheel into a rocket.

replies(1): >>45774862 #
49. slashdev ◴[] No.45773887{7}[source]
I’m not asking if it makes sense, I’m simply pointing out that by that measure this is much less extreme than 2000. As I stated, I think we’re in a bubble, so valuations won’t make much sense.

If you have a better measure, share it. I trust data more than your or my feelings on the matter.

replies(1): >>45774755 #
50. camdenreslink ◴[] No.45773992{5}[source]
If model development stalls, then the open weight free models will eventually totally catch up. The model itself will become a complete commodity.
replies(1): >>45774937 #
51. boringg ◴[] No.45774073[source]
The original "Tech" boom was an infrastructure boom by the telecoms funded by leveraged debt. It was an overbuild mismatch with the market timing. If you brought forward the timeline to when that infrastructure was used (late 2000s) you probably would never have had the crash.

This boom is a data center boom with AI being the software layer/driver. This one potentially has a lot longer to run even though everyone is freaking out now. If you believe the AI is rebuilding compute then this changes our compute paradigm in the future. As well as long as we don't get an over leveraged build out without revenue coming in the door. I think we are seeing a lot of revenue come in for certain applications.

The companies that are all smoke and mirrors built on chatGPT with little defensibility are probably the same as the ones you are referring to in the current era. Or the AI tooling companies.

To be clear circular deal flow is not a good look.

I can see the both sides of bull and bear at this moment.

replies(1): >>45776367 #
52. overfeed ◴[] No.45774137{6}[source]
> If we’re both willing to pay that in a free market economy

The thing is: you've paid nothing - all you did was trade pets and played an accounting trick to make them seem more valuable than they are.

53. some_guy_nobel ◴[] No.45774229[source]
> OpenAI applies the same strategy, but they’re using their equity to buy compute that is critical to improving their core technology. It’s circular, but more like a flywheel and less like a merry-go-round. I have some faith it could go another way.

I'm commenting here in case a large crash occurs, to have a nice relic of the zeitgeist of the time.

replies(1): >>45774307 #
54. fireflash38 ◴[] No.45774236{6}[source]
Is that not fraud?
replies(1): >>45777873 #
55. DenisM ◴[] No.45774292{7}[source]
Chat logs don’t run out. We may run out of novelty in those logs, at which point we may have ran out of human knowledge.

Or not - there still knowledge in people heads that is not bleeding into ai chat.

One implication here is that chats will morph to elicit more conversation to keep mining that mine. Which may lead to the need to enrage users to keep engagement.

56. zemvpferreira ◴[] No.45774307{3}[source]
Happy to have provided. I’m not an AI bull and not in any way invested in the U.S. economy besides a little money in funds, but I do try to think about the war of today vs the war of yesterday. Hopefully that’s always en vogue.
57. DenisM ◴[] No.45774313{5}[source]
They can also buy out the startup or match the development by hiring more people. Their comp packages are very competitive.
58. vineyardmike ◴[] No.45774565{5}[source]
Because they’re not that wildly unprofitable. Yes, obviously the companies spend a ton of money on training, but several have said that each model is independently “profitable” - the income from selling access to the model has overcome the costs of training it. It’s just that revenues haven’t overcome the cost of training the next one, which gets bigger every time.
replies(1): >>45774864 #
59. teiferer ◴[] No.45774755{8}[source]
Unless you have evidence that this measure of yours is a reliable predictor of how big a bubble is, it's on par with my gut feeling.
60. upboundspiral ◴[] No.45774764{4}[source]
One thing I've been contemplating lately is that from a business perspective, when your competitors expand their revenue avenues (generally through ads) you have three options: copy them to catch up, do nothing and perish, and lobby the government for increased consumer protections.

I've started to wonder why we see so few companies do this. It's always "evil company lobbying to harm the its customers and the nation." Companies are made up of people, and for myself, if I was at a company I would be pushing to lobby on behalf of consumers to be able to keep a moral center and sleep at night. I am strongly for making money, but there are certain things I am not willing to do for it.

Targeted advertising is one of these things that I believe deserves to fully die. I have nothing against general analytics, nor gathering data about trends etc, but stalking every single person on the internet 24/7 is something people are put in jail for if they do it in person.

61. mentalgear ◴[] No.45774862{4}[source]
Well, the thing is that that kind of hardware chips quickly decrease in value. It's not like the billions spend in past bubbles like the 2000s where internet infrastructure was build (copper, fibre) or even during 1950s where transport infrastructure (roads) were build.
replies(1): >>45775940 #
62. alangibson ◴[] No.45774864{6}[source]
> the income from selling access to the model has overcome the costs of training it.

Citation needed. This is completely untrue AFAIK. They've claimed that inference is profitable, but not that they are making a profit when training costs are included.

replies(1): >>45777843 #
63. DenisM ◴[] No.45774937{6}[source]
It very well might. The ones with most smooth integrations and applications will win.

This can go either way. For databases open source integration tools prevailed, the commercial activity left hosting those tools.

But enterprise software integration that might end up mostly proprietary.

64. WOTERMEON ◴[] No.45775169[source]
And I guess no one of the people who were doing that paid but the community paid the price for this scam ?
65. brokencode ◴[] No.45775940{5}[source]
Data centers are massive infrastructural investments similar to roads and rails. They are not just a bunch of chips duct taped together, but large buildings with huge power and networking requirements.

Power companies are even constructing or recommissioning power plants specifically to meet the needs of these data centers.

All of these investments have significant benefits over a long period of time. You can keep on upgrading GPUs as needed once you have the data center built.

They are clearly quite profitable as well, even if the chips inside are quickly depreciating assets. AWS and Azure make massive profits for Amazon and Microsoft.

66. sidewndr46 ◴[] No.45775942{3}[source]
There's at least one contributor here on HN that believes growth in models is strictly exponential: https://www.julian.ac/blog/2025/09/27/failing-to-understand-...
67. cman1444 ◴[] No.45776367[source]
One interesting aspect of this is that, with the exception of OpenAI, all of the companies leading this boom generate massive amounts of income from other arms of their buinesses. I think this is one reason for the potentially longer run, since they can subsidize AI CapEx with these cash flows for quite a while.
68. alonmower ◴[] No.45777609{6}[source]
The necessity of higher quality data from vetted experts is why Mercor just raised at 10B
69. JohnnyMarcone ◴[] No.45777843{7}[source]
I've also seen Open AI and Anthropic say it's pretty close at least. I'll try to follow up with a source.
70. _heimdall ◴[] No.45777870{6}[source]
Both parties would need the $1B prior to the transaction for it to even potentially be meaningful, and still they just traded a cat for a dog and only paid each other on paper.

That ultimately wouldn't be a big deal if the paper valuation from the trade didn't matter. As it stands, though, both parties could log it as both revenue and expenses, and being public companies their valuation, and debt they can borrow against it, is based in part on revenue numbers. If the number was meaningless who cares, but the numbers aren't meaningless and at such a scale they can impact the entire economy.

71. _heimdall ◴[] No.45777873{7}[source]
Yes, it is fraud round tripping is fraud, whether the government is willing to prosecute it or not.
72. yosame ◴[] No.45778513{3}[source]
Why would ChatGPT replace google search when search also has AI? At best they'd steal some of Google's market share, which I'd imagine would decline with embedded ads.
replies(1): >>45779332 #
73. 0xbadcafebee ◴[] No.45779332{4}[source]
Two reasons:

1) Google Search is now 99% crap that nobody wants, and even the AI answers are largely crap,

2) I believe somebody is going to eventually realize that search engines are stupid and improve on them. The whole idea of a single text box where you type some words and the search engine reads your mind to figure out the one thing you wanted, and then gives you one generic answer, is crap. We've just been blind to this because we don't see any other answer to realize we've been getting crap.

If I type in "when did MMS come out", Google will tell me when the candy product M&M's came out. But I wanted to know when the Multimedia Messaging Service was released. At some point somebody is going to realize that you can't actually tell what the hell the person wants from these simple queries alone. The computer needs to ask you questions to narrow down the field. That's sometimes what happens in ChatGPT, but it can be greatly improved with simple buttons/drop-downs/filters/etc. I think it'll also be improved by more dynamic and continuous voice input for context. (I notice Google Search now has audio input; I wonder if that came in after ChatGPT? Wayback Machine shows it starting in mid-2024) When they eventually implement all this, and people realize it's a million times better than what Google has, then Google will be playing catch-up.

74. delis-thumbs-7e ◴[] No.45781499{6}[source]
I’mafraid I don’t share your optimism. I think we are more or less seeing the limitations of the transformer architecture.
75. delis-thumbs-7e ◴[] No.45781528{5}[source]
They are pretty cheap compared to _actual_ costs of GPU farms, or buying A100 though. Of course not everybody will buy these machines, but everybody don’t really need high powered LLM’s either. Prob 13B Mistral can be trained to do your homework and pretend to he your girlfriend.