←back to thread

468 points speckx | 1 comments | | HN request time: 0.376s | source
Show context
lumost ◴[] No.45302284[source]
I don’t really get why anyone would be buying ai compute unless A) to your goal is to rent out the compute B) no vendor can rent you enough compute when you need it C) you have an exotic funding arrangement that makes compute capex cheap and opex expensive.

Unless you can keep your compute at 70% average utilization for 5 years - you will never save money purchasing your hardware compared to renting it.

replies(6): >>45302322 #>>45302360 #>>45302364 #>>45302606 #>>45302685 #>>45302745 #
1. causal ◴[] No.45302606[source]
1) Data proximity (if you have a lot of data, egress fees add up)

2) Hardware optimization (the exact GPU you want may not always be available for some providers)

3) Not subject to price changes

4) Not subject to sudden Terms of Use changes

5) Know exactly who is responsible if something isn't working.

6) Sense of pride and accomplishment + Heating in the winter