Recent AI model progress feels mostly like bullshit

Not sure if its been fixed by now but a few weeks ago I was in the Golden Gate park and wondered if it was bigger than Central park. I asked ChatGPT voice, and although it reported the sizes of the parks correctly (with Golden gate park being the bigger size), it then went and said that Central Park was bigger. I was confused, so Googled and sure enough Golden gate park is bigger.

I asked Grok and others as well. I believe Perplexity was the only one correct.

Repeated it multiple times even with a friends account. It kept doing the same thing. It knew the sizes, but thought the smaller sized one was bigger...

Probably because it has read the facts but has no idea how numbers actually work.

I just tried. Claude did exactly what you said, and then figured it out:

Central Park in New York City is bigger than GoldenGate Park (which I think you might mean Golden Gate Park) in San Francisco.

Central Park covers approximately 843 acres (3.41 square kilometers), while Golden Gate Park spans about 1,017 acres (4.12 square kilometers). This means Golden Gate Park is actually about 20% larger than Central Park.

Both parks are iconic urban green spaces in major U.S. cities, but Golden Gate Park has the edge in terms of total area.