←back to thread

MCP in LM Studio

(lmstudio.ai)
225 points yags | 4 comments | 25 Jun 25 17:27 UTC | HN request time: 0.89s | source
Show context
chisleu ◴[25 Jun 25 17:58 UTC] No.44380098[source]▶
Just ordered a $12k mac studio w/ 512GB of integrated RAM.

Can't wait for it to arrive and crank up LM Studio. It's literally the first install. I'm going to download it with safari.

LM Studio is newish, and it's not a perfect interface yet, but it's fantastic at what it does which is bring local LLMs to the masses w/o them having to know much.

There is another project that people should be aware of: https://github.com/exo-explore/exo

Exo is this radically cool tool that automatically clusters all hosts on your network running Exo and uses their combined GPUs for increased throughput.

Like HPC environments, you are going to need ultra fast interconnects, but it's just IP based.

replies(14): >>44380196 #>>44380217 #>>44380386 #>>44380596 #>>44380626 #>>44380956 #>>44381072 #>>44381075 #>>44381174 #>>44381177 #>>44381267 #>>44385069 #>>44386056 #>>44387384 #
1. storus ◴[26 Jun 25 10:42 UTC] No.44386056[source]▶
If the rumors about splitting CPU/GPU in new Macs are true, your MacStudio will be the last one capable of running DeepSeek R1 671B Q4. It looks like Apple had an accidental winner that will go away with the end of unified RAM.
replies(1): >>44387131 #
2. phren0logy ◴[26 Jun 25 13:15 UTC] No.44387131[source]▶
I have not heard this rumor. Source?
replies(1): >>44387443 #
3. prophesi ◴[26 Jun 25 13:54 UTC] No.44387443[source]▶
I believe they're talking about the rumors by an Apple supply chain analyst, Ming-Chi Kuo.

https://www.techspot.com/news/106159-apple-m5-silicon-rumore...

replies(1): >>44388382 #
4. diggan ◴[26 Jun 25 15:31 UTC] No.44388382{3}[source]▶
Seems Apple is waking up to the fact that if it's too easy to run weights locally, there really isn't much sense to having their own remote inference endpoints, so time to stop the party :)