Also, using persistent ssh connections makes a huge difference, esp. if you’ve got a heavy shell init on the local or remote side
Host *
ControlPath ~/.ssh/cm-%r@%h:%p
ControlMaster auto
ControlPersist 600
replies(3):