I don't know on your specific case, but on some Platforms, such as Cisco or Checkpoint, there are features that allow redundancy in a way that even on-going connection are not lost during failover.

Also you can take on a look on VRRP (Cisco proprietary) or HSRP - they are routing concepts.