(inference.net)

6 points ycombyourhair | 1 comments | 28 Aug 25 18:59 UTC | HN request time: 0.203s | source

1. nick779 ◴[28 Aug 25 19:09 UTC] No.45055831[source]▶

frontier labs are still making crazy margins. OSS models are impossible to host serverlessly at a profit even if you're Together

Arbitraging Down LLM Inference to the Cost of Electricity