"They’re parsing JSON. A whopping 10 megabytes worth of JSON with some 63k item entries."
Ahh. Modern software rocks.
replies(3):
Ahh. Modern software rocks.
Down a little in the article and you'll see one of the real issues:
> But before it’s stored? It checks the entire array, one by one, comparing the hash of the item to see if it’s in the list or not. With ~63k entries that’s (n^2+n)/2 = (63000^2+63000)/2 = 1984531500 checks if my math is right. Most of them useless.
More than 3 GB/s are possible. Like you said 10 MB of JSON is a breeze.