Our High Availability Sauce Connect Proxy Setup enables you to run tests using multiple Sauce Connect tunnels and run multiple tunnels grouped together as a tunnel pool, which will be treated as single tunnel. Pools are ideal for running 200 or more parallel tests (high concurrency) because tunnel capacity is limited by a single TCP Connection.
A major benefit to using the High Availability setup is load balancing; jobs will be distributed among your tunnels. If one of your tunnels goes down, any tests started after that will be routed through another tunnel. That said, if a tunnel instance on your side or a VM tunnel instance on the Sauce Labs side goes down once you've already started running tests, these tests in motion will be impacted.
A strongly recommend best practice is to apply and track tunnels with tunnel identifiers. Otherwise, test traffic initiated using your account will use an unnamed tunnel automatically.
See the following sections for more information:
What You'll Need
Before getting started with the High Availability setup, our recommendation is to first try the Basic Sauce Connect Proxy Setup to confirm that your system and network architecture is compatible with Sauce Connect.
Basic Sauce Connect Setup Leveraging High Availability
The below diagram shows the Basic Sauce Connect setup leveraging High Availability. On the Sauce Labs side, there are three major components: Sauce Test VM, Sauce Connect Tunnel VM, and Tunnel Pool. The logic flow is:
- Test framework makes a request for a new Sauce Test VM, which specifies the tunnel ID of the pool (or uses an unnamed, "default" pool).
- A service in Sauce Labs chooses a tunnel from the existing pool at random.
- The resulting tunnel from step #2 is assigned to the new test VM.
DIAGRAM: Basic Sauce Connect Setup Leveraging High Availability
Multiple Network Routes
In this diagram, we see a setup that allows for multiple network routes when reaching the site(s) under test. There are variations to this, of course. For example, some of the Sauce Connect instances could be in the same network infrastructure as the site(s) under test. You can also imagine leveraging different virtual routes inside the same physical network. What is gained by setting up tunnels in this manner is redundancy for Sauce Connect tests, should one network route fail.
DIAGRAM: Multiple Network Routes to Site Under Test (SUT)
High Availability Tunnel Settings and Commands
You can customize your High Availability tests using these options below. For a full list of High Availability commands and other Sauce Connect options, see Sauce Connect Proxy Command-Line Quick Reference Guide.
If you run a Sauce Connect test using one or more tunnels with the same tunnel identifier, these tunnels will be removed completely. This event is called colliding tunnels.
To prevent colliding tunnels and their subsequent removal, you'll need to add the command
--no-remove-colliding-tunnels to your capabilities. Tunnels will then remain active and tests will be distributed among them.
To run multiple sets of tunnel pools (e.g., one pool of three tunnels and another pool of six tunnels), you'll need to add --names & --no-collide flags.
Examples: Launching Sauce Connect Proxy with High Availability
Once you've confirmed that your network is configured to use High Availability, launch Sauce Connect using one of these commands below. You'll need to run this command on each machine where you want to have access to the tunnel pool.
Using Multiple Machines for Failover Functionality
If you're configuring your Sauce Connect Proxy High Availability Setup with multiple tunnels to provide failover functionality, we recommend setting up each tunnel to run on a separate machine. This way, if a port availability issue or machine failure arises, you will still have active tunnels.
If you're using the same machine for multiple tunnels, you should start Sauce Connect Proxy with unique ports for the Selenium listener and scproxy, and file for the log and pid.
In High Availability mode, it's best practice to restart Sauce Connect Proxy tunnels every 24 hours. The tunnel will stay open until all tests associated with it have completed. At the same time, once the shutdown command has been sent, the tunnel is marked inactive in the eyes of the pool, and no new jobs will use it.
- Windows users: Running Sauce Connect Proxy as a Microsoft Windows Service
- Linux users: Monitoring Sauce Connect Proxy with Service Management Tools