←back to thread

261 points david927 | 2 comments | | HN request time: 0.41s | source

What are you working on? Any new ideas that you're thinking about?
Show context
AJRF ◴[] No.43156818[source]
I recently made a little tool for people interested in running local LLMs to figure out if their hardware is able to run an LLM in GPU memory.

https://canirunthisllm.com/

replies(10): >>43156837 #>>43156946 #>>43157271 #>>43157577 #>>43157623 #>>43157743 #>>43158600 #>>43159526 #>>43160623 #>>43163802 #
donohoe ◴[] No.43159526[source]
Feature Request: Looks like the React JS is 1.1MB out of the ~ 1.6MB the site takes to load all other assets. Do you really need React for this?

That aside, I think this is really cool and very helpful. Thank you.

replies(1): >>43161132 #
1. AJRF ◴[] No.43161132[source]
I am using Streamlit, and it is the thing that is adding React.

I appreciate that it's a heavy site, but just being honest with you - it doesn't seem worth the time optimising this by moving to another lighter framework at this stage of the project.

Sorry!

replies(1): >>43163129 #
2. donohoe ◴[] No.43163129[source]
No, its all good. And you are right. Its gets the job done.