This is incredibly dumb. The three way handshake and initial key exchange is your certificate.
replies(2):
You as a normal client don't do that. Your computer can be fooled by very easy local spoofs.
And for what it's worth, taking over the IP would also let you get a DNS-based certificate, so those actually have more weak points.