One of the worst hires I ever worked with was excellent on paper, came with good credentials, had an impressive resume, and did objectively well on the interview questions.
However, everyone who interviewed him felt uneasy about him. He failed the vibe check, even though he checked all of the boxes and knew all the right things to say. At the time there was a big push for eliminating bias and being and as objective as possible in hiring, so we were lightly admonished for raising questions based on vibes.
When he was hired, it turned out our vibes were justified. He was someone who played games and manipulated his way through his career. He could say the right things and navigate his way through office politics unscathed while causing damage to everything he touched.
Since then I’ve observed a number of situations where decisions that seemed objectively good but came with weird vibes were later revealed to be bad. Some of the most skilled grifters I’ve encountered were brilliant at appearing objectively good but couldn’t pass vibe checks of experienced business people. Some of the most objectively good deals on paper that came with weird vibes later turned out to be hugely problematic.
I think the trap is thinking that vibes and feelings are wrong and should be ignored in favor of pre-selected objective measures. This is good practice when doing a scientific study, but it’s not a good practice when you’re entering a real world situation where an adversarial party can root out those criteria, fake them, and use your objectivity against you.
If you go with vibes too much you only ever accumulate data saying that vibes matter.