←back to thread

577 points simonw | 3 comments | | HN request time: 0s | source
1. slimebot80 ◴[] No.44729252[source]
(novice question)

64gb is pure RAM? I thought Apple Silicon was efficient at paging SSD as memory storage - how important is RAM if you've got a fast SSD?

replies(2): >>44729399 #>>44730520 #
2. nicce ◴[] No.44729399[source]
Memory speed is the most important factor with LLMs and SSD is very slow when compared to RAM.
3. ethan_smith ◴[] No.44730520[source]
While Apple Silicon's memory compression and SSD swapping are efficient, RAM access is still ~100x faster than SSD, so sufficient physical RAM remains crucial for memory-intensive workloads like running large LLMs.