What does the low probability have to do with it?
If you had asked Galileo's contemporaries about the probability that he'd find moons orbiting Jupiter, they'd have put it at zero, and they turned out to be wrong.
Einstein's work was also in flagrant disregard of the established scientific sensibilities of the time.
I can't speak for everybody, but the excitement that I get when I look through a telescope, or a microscope, or commune with any machine that can see something that I can't... it comes from the possibility that I'll see something impossible, something that invalidates the theories which previously governed what I'm likely to see. It's why we keep building better telescopes and bigger particle colliders--because we want to prove ourselves wrong.
It's fine to be a rationalist with an appreciation for existing theory, but it's not irrationality when others attempt to invalidate what you're protecting--thats where progress comes from. We wouldn't know as much as we do without the people who look for things that shouldn't be there on the basis of viewpoints outside of accepted theory.