←back to thread

Reasoning models reason well, until they don't

(arxiv.org)
215 points optimalsolver | 1 comments | 31 Oct 25 09:23 UTC | HN request time: 0.348s | source
Show context
hirako2000 ◴[31 Oct 25 11:29 UTC] No.45770845[source]▶
Has any one ever found an ML/AI paper that make claims that RLMs can reason?

When I prompt an RLM, I can see it spits out reasoning steps. But I don't find that evidence RLMs are capable of reasoning.

replies(3): >>45770918 #>>45770977 #>>45771339 #
Sharlin ◴[31 Oct 25 11:40 UTC] No.45770918[source]▶
Semantics schemantics.
replies(1): >>45771659 #
1. hirako2000 ◴[31 Oct 25 13:17 UTC] No.45771659[source]▶
It's a statistical imitation of a reasoning pattern, underlying mechanism is pattern matching. The ability to create a model that can determine two radically different words have strong similarity in meaning doesn't imply emergence of some generalizable, logical model that suddenly can Reason to solve novel problems.

Pattern matching is a component of reason. Not === reason.