It makes me disproportionately sad to here this every time cassettes are talked about :( as I don't think it's a fair assessment.
Granted, nobody used metal tapes, but if you did, I'd challenge you to tell the difference under normal listening conditions with CD. I'm sure you'd be able to tell in a controlled environment, especially if you're looking out for it, but under normal circumstance metal tapes were HiFi.