←back to thread

Mercury: Ultra-fast language models based on diffusion

(arxiv.org)
568 points PaulHoule | 1 comments | 07 Jul 25 12:31 UTC | HN request time: 0.297s | source
Show context
convery ◴[08 Jul 25 09:33 UTC] No.44498468[source]▶
It certainly is fast, but I'm curious if LLMs ever will figure out how bitshifts work..

e.g. from the playground: `static const uint64_t MERSENNE_PRIME = (1ULL << 127) - 1;` which it insists is the correct way to store a 128-bit integer in followup questions.

replies(1): >>44498600 #
1. ethan_smith ◴[08 Jul 25 10:02 UTC] No.44498600[source]▶
For 128-bit values in C++, you'd need uint128_t (compiler extension) or a library like Boost.Multiprecision since 1ULL << 127 overflows the 64-bit type before subtraction occurs.