A Hybrid Data Pipeline load balancer deployment is the best option for deploying the service in a production environment. A load balancer deployment allows high availability and scalability. When initially deploying Hybrid Data Pipeline, you can limit installation of the server to a single node behind a load balancer. As the volume of requests to backend data stores increases, you can increase capacity by increasing the number of nodes running the service behind the load balancer. With proper load balancer configuration, requests will be distributed across the nodes of the Hybrid Data Pipeline cluster.

Note: If you are running a cloud load balancer such as the AWS Application Load Balancer or the Azure Application Gateway, you should consult your vendor documentation about managing compute capacity, in addition to reviewing the procedures provided in the following topic.