←back to thread

Are OpenAI and Anthropic losing money on inference?

(martinalderson.com)
507 points martinald | 1 comments | 28 Aug 25 10:15 UTC | HN request time: 0.21s | source
Show context
_sword ◴[28 Aug 25 17:53 UTC] No.45055003[source]▶
I've done the modeling on this a few times and I always get to a place where inference can run at 50%+ gross margins, depending mostly on GPU depreciation and how good the host is at optimizing utilization. The challenge for the margins is whether or not you consider model training costs as part of the calculation. If model training isn't capitalized + amortized, margins are great. If they are amortized and need to be considered... yikes
replies(7): >>45055030 #>>45055275 #>>45055536 #>>45055820 #>>45055835 #>>45056242 #>>45056523 #
lawlessone ◴[28 Aug 25 17:56 UTC] No.45055030[source]▶
Does that include legal fights and potential payouts to artists and writers whose work was used without permission?

Can anyone explain why it's not allowed to compensate the creators of the data?

replies(3): >>45055042 #>>45055062 #>>45055241 #
1. Night_Thastus ◴[28 Aug 25 17:58 UTC] No.45055062[source]▶
It's already questionable if anyone can make it profitable once you account for all the costs. Why do you think they try to squash the legal concerns so hard? If they move fast and stick their fingers in their ears, they can just steal whatever the want.