Ask HN: How do I failover the load balancer

I'm trying to make sure the servers for my product are available as much as possible, one of the problems I couldn't figure out how to solve was how to fail-over the load balancer. How do you do it?