261 points david927 | 1 comments | 23 Feb 25 23:00 UTC | HN request time: 0.335s | source

What are you working on? Any new ideas that you're thinking about?

Show context

AJRF ◴[24 Feb 25 07:46 UTC] No.43156818[source]▶

I recently made a little tool for people interested in running local LLMs to figure out if their hardware is able to run an LLM in GPU memory.

dockerd ◴[24 Feb 25 19:27 UTC] No.43163802[source]▶

Looks good.

Feature request - Have a leaderboard of LLM for x/y/z tasks or pull it from existing repo. Suggest the best model for given GPU for x/y/z task.

If there is better model which my GPU can run, why should I go for the lowest?

replies(1): >>43163820 #

1. dockerd ◴[24 Feb 25 19:29 UTC] No.43163820[source]▶

And maybe provide ollama/lm studio run command for given model/quantization

Ask HN: What are you working on? (February 2025)