←back to thread

152 points isoprophlex | 2 comments | | HN request time: 0.419s | source
Show context
daft_pink ◴[] No.45645040[source]
I think this is a minor speed bump and VC’s believe that cost of inference will decrease over time and this is a gold rush to grab market share while cost of inference declines.

I don’t think they got it right and the market share and usage grew faster than inference dropped, but inference costs will clearly drop and these companies will eventually be very profitable.

Reality is that startups like this assume moore’s law will drop the cost over time and arrange their business around where they expect costs to be and not where costs currently are.

replies(6): >>45645108 #>>45645191 #>>45645220 #>>45645347 #>>45645403 #>>45645748 #
1. xnx ◴[] No.45645191[source]
> inference costs will clearly drop and these companies will eventually be very profitable.

Inference costs for old models will drop, but inference costs may stay the same if models continue to improve.

No guarantee that any wrapper for inference will be able to hold on to customers when they stop selling $1.00 for $0.50.

replies(1): >>45645719 #
2. ◴[] No.45645719[source]