←back to thread

Full Unicode Search at 50× ICU Speed with AVX‑512

(ashvardanian.com)
197 points ashvardanian | 2 comments | 15 Dec 25 16:42 UTC | HN request time: 0.383s | source
Show context
andersa ◴[16 Dec 25 12:37 UTC] No.46287769[source]▶
From a German user perspective, ICU and your fancy library are incorrect, actually. Mass is not a different casing of Maß, they are different characters. Google likely changed this because it didn't do what users wanted.
replies(5): >>46287929 #>>46288240 #>>46288242 #>>46288366 #>>46288467 #
1. mxmlnkn ◴[16 Dec 25 13:50 UTC] No.46288467[source]▶
I never understood why the recommended replacement for ß is ss. It is a ligature of sz (similar to & being a ligature of et) and is even pronounced ess-zet. The only logical replacement would have been sz, and it would have avoided the clash of Masse (mass) and Maße (measurements). Then again, it only affects whether the vowel before it is pronounced short or long, and there are better ways to encode that in written language in the first place.
replies(1): >>46293516 #
2. adrian_b ◴[16 Dec 25 19:52 UTC] No.46293516[source]▶
I agree that writing it "sz" might have created less problems.

However, it is likely that it has never been pronounced "sz", but always "ss" and the habit of writing "sz" for the double consonant may have had the same reason as the writing of "ck" instead of the double "kk".