Signs of introspection in large language models

If there truly was any introspection in these models, they wouldn’t hallucinate. All these cognitive processes are not just philosophical artifacts, but have distinct biological purposes. If you don’t find them serving any purpose in your model, then you’re just looking at noise, and your observations may not be above a statistically significant threshold to derive a conclusion (because they’re noise).

That doesn't follow. We have introspection and we hallucinate (confabulate, bullshit, lie, etc). You are just assuming they would never intentionally say something untrue or say something they don't know is true.