(github.com)

186 points darkolorin | 1 comments | 15 Jul 25 11:29 UTC | HN request time: 0.333s | source

We wrote our inference engine on Rust, it is faster than llama cpp in all of the use cases. Your feedback is very welcomed. Written from scratch with idea that you can add support of any kernel and platform.

Show context

cwlcwlcwlingg ◴[15 Jul 25 15:06 UTC] No.44571918[source]▶

>>44570048 (OP) #

Wondering why use Rust other than C++

replies(5): >>44572202 #>>44573216 #>>44574364 #>>44574476 #>>44576525 #

1. giancarlostoro ◴[15 Jul 25 18:29 UTC] No.44574364[source]▶

>>44571918 #

...or D? or Go? or Java? C#? Zig? etc they chose what they were most comfortable with. Rust is fine, it's not for everyone clearly, but those who use it produce high quality software, I would argue similar with Go, without all the unnecessary mental overhead of C or C++

↑

Show HN: We made our own inference engine for Apple Silicon