←back to thread

577 points simonw | 1 comments | | HN request time: 0s | source
Show context
joelthelion ◴[] No.44724227[source]
Apart from using a Mac, what can you use for inference with reasonable performance? Is a Mac the only realistic option at the moment?
replies(6): >>44724398 #>>44724419 #>>44724553 #>>44724563 #>>44724959 #>>44727049 #
whimsicalism ◴[] No.44724959[source]
you are almost certainly better off renting GPUs, but i understand self-hosting is an HN touchstone
replies(2): >>44725021 #>>44725699 #
qingcharles ◴[] No.44725021[source]
This. Especially if you just want to try a bunch of different things out. Renting is insanely cheap -- to the point where I don't understand how the renters are making their money back unless they stole the hardware and power.

It can really help you figure a ton of things out before you blow the cash on your own hardware.

replies(1): >>44725157 #
4b11b4 ◴[] No.44725157[source]
Recommended sites to rent from
replies(2): >>44725244 #>>44725337 #
1. doormatt ◴[] No.44725244{3}[source]
runpod.io