←back to thread

468 points speckx | 1 comments | | HN request time: 0.205s | source
1. bearjaws ◴[] No.45302808[source]
Am I the only one who looks at both the Pi Cluster and the Framework PC and wonders how they are both slower and less cost effective than a MacBook Pro M4 Max? 88 token/s on a 2.3b model is not exactly great, most likely you will want a 32 or 70b model.