←back to thread

504 points Terretta | 3 comments | | HN request time: 0.001s | source
Show context
esafak ◴[] No.45064606[source]
"On the full subset of SWE-Bench-Verified, grok-code-fast-1 scored 70.8% using our own internal harness."

Let's see this harness, then, because third party reports rate it at 57.6%

https://www.vals.ai/models/grok_grok-code-fast-1

replies(2): >>45067265 #>>45069650 #
jiggawatts ◴[] No.45069650[source]
I know this sounds like a nitpick, but the first thing I noticed when opening the site is the use of gibberish date order where the day, month, and year parts are out of order.[1]

This doesn't just cause confusion, it's also hard to sort. To confirm my suspicion of sloppy coding, I tried to sort the date column and to my surprise I got this madness:

    1/31/2025
    2/29/2024
    2/29/2024
    4/28/2024
    3/27/2024
    9/27/2023
Which is sorting by the day column -- the bit in the middle -- instead of the year!

That's just... special.

[1] I hear some incredibly backwards places like Liberia that also haven't adopted metric insist on using it into the present day, but the rest of the civilised world has moved on.

replies(2): >>45069807 #>>45075053 #
whimsicalism ◴[] No.45069807[source]
not sure if the comment about liberia is tongue in cheek but this is by far the most common way of writing dates in the US
replies(1): >>45069887 #
jiggawatts ◴[] No.45069887[source]
Yes, of course this is tongue in cheek, but it’s the “ha-ha… but serious” type of humour.

Just look at this map: https://en.m.wikipedia.org/wiki/List_of_date_formats_by_coun...

You’re almost entirely alone in these backwards practices!

Well, not entirely alone, you also have Liberia following your “standards”! There’s two of you! Must be nice.

PS: If Trump actually wanted to make US exports competitive on the world market, step one would be to adopt world standards like metric.

replies(3): >>45069964 #>>45070144 #>>45076687 #
1. sebastiennight ◴[] No.45070144{3}[source]
Everytime Liberia is mentioned, I think of two things:

1. That Mickael Jackson song

2. The time that a US president asked the president of Liberia "where he learned English" because he spoke English so well

And now I'll add to my list a third item:

3. Being one of an elite set of countries to use freedom units

replies(1): >>45070486 #
2. croemer ◴[] No.45070486[source]
Liberia using freedom units is not at all a coincidence. Liberia was essentially a US colony where the colonialists were freed US slaves.

From Wikipedia:

> Liberia began in the early 19th century as a project of the American Colonization Society, which believed that black people would face better chances for freedom and prosperity in Africa than in the United States. Between 1822 and the outbreak of the American Civil War in 1861, more than 15,000 freed and free-born African Americans, along with 3,198 Afro-Caribbeans, relocated to Liberia. Gradually developing an Americo-Liberian identity, the settlers carried their culture and tradition with them while colonizing the indigenous population. Led by the Americo-Liberians, Liberia declared independence on July 26, 1847, which the U.S. did not recognize until February 5, 1862.

replies(1): >>45070860 #
3. IMTDb ◴[] No.45070860[source]
The name Libera also comes from "liber" which means freedom.

So it makes sense they would be using freedom units and freedom ways of writing dates; it's in the name.