←back to thread

Ask HN: What Are You Working On? (June 2025)

439 points david927 | 1 comments | 29 Jun 25 20:21 UTC | HN request time: 0.254s | source

What are you working on? Any new ideas which you're thinking about?
1. matthewolfe ◴[29 Jun 25 22:35 UTC] No.44417208[source]▶
I'm working on TokenDagger [0] a high performance implementation of OpenAI's Tiktoken. My benchmarks are showing 2-3x higher throughput, as well as ~4x faster tokenization for code samples on a single thread.

[0] https://github.com/M4THYOU/TokenDagger