Something weird is happening with LLMs and chess

Lets be real though most people can't beat a grandmaster. It is impressive to see it last more rounds as it progressed.

"It lost every single game, even though Stockfish was on the lowest setting."

It's not playing against a GM, the prompt just phrases it this way. I couldn't pinpoint the exact ELO of "lowest" stockfish settings, but it should be roughly between 1000 and 1400, which is far from professional play.