←back to thread

321 points jhunter1016 | 1 comments | | HN request time: 0s | source
Show context
Roark66 ◴[] No.41878594[source]
>OpenAI plans to loose $5 billion this year

Let that sink in for anyone that has incorporated Chatgpt in their work routines to the point their normal skills start to atrophy. Imagine in 2 years time OpenAI goes bust and MS gets all the IP. Now you can't really do your work without ChatGPT, but it cost has been brought up to how much it really costs to run. Maybe $2k per month per person? And you get about 1h of use per day for the money too...

I've been saying for ages, being a luditite and abstaining from using AI is not the answer (no one is tiling the fields with oxen anymore either). But it is crucial to at the very least retain 50% of capability hosted models like Chatgpt offer locally.

replies(20): >>41878631 #>>41878635 #>>41878683 #>>41878699 #>>41878717 #>>41878719 #>>41878725 #>>41878727 #>>41878813 #>>41878824 #>>41878984 #>>41880860 #>>41880934 #>>41881556 #>>41881938 #>>41882059 #>>41883046 #>>41883088 #>>41883171 #>>41885425 #
sebzim4500 ◴[] No.41878719[source]
The marginal cost of inference per token is lower than what OpenAI charges you (IIRC about 2x cheaper), they make a loss because of the enormous costs of R&D and training new models.
replies(4): >>41878823 #>>41878875 #>>41878927 #>>41879029 #
ignoramous ◴[] No.41878875[source]
> The marginal cost of inference per token is lower than what OpenAI charges you

Unlike most Gen AI shops, OpenAI also incurs a heavy cost for traning base models gunning for SoTA, which involves drawing power from a literal nuclear reactor inside data centers.

replies(2): >>41878936 #>>41878996 #
fransje26 ◴[] No.41878936[source]
> from a literal nuclear reactor inside data centers.

No.

replies(1): >>41880823 #
Tostino ◴[] No.41880823[source]
Their username is fitting though.
replies(1): >>41881514 #
ignoramous ◴[] No.41881514[source]
Bully.

I wrote "inside" to mean that those mini reactors (300MW+) are meant to be used solely for the DCs.

(noun: https://www.collinsdictionary.com/dictionary/english-thesaur... / https://en.wikipedia.org/wiki/Heterosemy)

Replace it with nearby if that's makes you feel good about anyone's username.

replies(1): >>41882539 #
1. Tostino ◴[] No.41882539[source]
You are right, that wasn't a charitable reading of your comment. Should have kept it to myself.

Sorry for being rude.