I think the point is they're often doing it on things that aren't strictly vectors by definition, as in the physics sense, rather just some sack of stuff organised like they might be a vector and assuming its valid to compare angles because its just something numerically without much bias that does the job.
I think what you meant to say is that they aren’t strictly geometric or “interpretable”. But they absolutely are vectors in the linear algebraic sense.