RustGPT: A pure-Rust transformer LLM built from scratch

(github.com)

269 points amazonhut | 1 comments | 15 Sep 25 09:47 UTC | HN request time: 0.191s | source

Show context

untrimmed ◴[15 Sep 25 10:33 UTC] No.45248154[source]▶

As someone who has spent days wrestling with Python dependency hell just to get a model running, a simple cargo run feels like a dream. But I'm wondering, what was the most painful part of NOT having a framework? I'm betting my coffee money it was debugging the backpropagation logic.

replies(5): >>45248223 #>>45248315 #>>45248416 #>>45248640 #>>45248972 #

ricardobeat ◴[15 Sep 25 11:26 UTC] No.45248416[source]▶

>>45248154 #

Have you tried uv [1]? It has removed 90% of the pain of running python projects for me.

[1] https://github.com/astral-sh/uv

replies(4): >>45248587 #>>45248888 #>>45249600 #>>45250338 #

1. TheAceOfHearts ◴[15 Sep 25 12:31 UTC] No.45248888[source]▶

>>45248416 #

Switching to uv made my python experience drastically better.

If something doesn't work or I'm still encountering any kind of error with uv, LLMs have gotten good enough that I can just copy / paste the error and I'm very likely to zero-in on a working solution after a few iterations.

Sometimes it's a bit confusing figuring out how to run open source AI-related python projects, but the combination of uv and iterating on any errors with an LLM has so far been able to resolve all the issues I've experienced.

↑