Traffic Distributor Guide
Cloud Platform: Traffic Distribution Guide
A common problem you can have have while working on your cloud development projects is the necessity to maintain multiple environments. When getting more and more clients or users, the capacity to serve all of the clients will become critical such as handling different app versions.
You can often face the problem of proper traffic distribution between such project copies, including number of aspects like setting proper method for requests routing, servers loading rates, etc. Solving all of these issues can become a challenge even for experienced developers.
To ease these problems’ resolution, UKHost4u offers a completely free and easy-to-use solution, based on the automatically configured load balancer. It is delivered as a special Traffic Distributor add-on, which is available for quick one-click installation through UKHost4u app marketplace and provides smart traffic routing based on your requirements.
With this solution you are able to set intelligent workloads balancing between pair of hosts and benefit on the following features and opportunities it provides:
- High availability and advanced failover: where the load is shared among two copies of your application, which could be located on different hardware to achieve better failure protection.
- Blue-Green application deploy (zero downtime): that will redirect all incoming requests to a single backend for the time another one is undergoing the maintenance.
- Ongoing A/B testing: route the incoming traffic between two different application versions and compare their performance and UX rates to choose the best one for production.
- Intuitive UI: configuration form allows to set all the main parameters of your traffic distributor either during its creation or consequent adjustment. You can choose among three different routing methods:
- Round Robin.
- Sticky Sessions.
- Health check: both backends are automatically checked for a normal response such as the returning 200 status code according to the configurable parameters:
- Flexibility & extensibility: You can also apply any required additional tuning like setting up caching, TCP mapping, SNI, etc. via NGINX configuration files manually. The best part? No limitations are applied.
Generally, compared to running a sole server, Traffic Distributor allows you to speed up processing of requests, decrease user’s response delay and, generally, to handle more simultaneous threads without failures.
With UKHost4u Traffic Distributor solution you are able to choose among three different routing methods in order to get the one, which will suit your needs the best. Each of the available options has its own specifics and usage purposes, that should be considered during the selection:
1. Round Robin
The most used and straightforward routing method. It allows you to distribute traffic among your environments equally, pointing each request to them in rotation thanks to the set backend priorities.
PLEASE NOTE: With this option, as the requested by users data is going to be loaded from both of them, you should provide the identical content on both of your backends.
2. Sticky Sessions
According to the set servers’ weights, this routing type is based on “sticking” each user to a specific backend, which will process all their requests until the corresponding user session, created on the first app visit, expires.
This kind of traffic routing allows you to set the backup copy of your primary server and keep it on a standby (or “in reserve”) until the first one’s failure. And if some issue occurs with the main backend, all of the requests will be automatically redirected to the working server, so that your users most likely won’t even notice any interruption in the application work.
To set up your own Traffic Distributor (TD), open the marketplace via the cloud dashboard:
Locate the Traffic Distributor solution within the “Dev & Admin Tools” tab and click install.
Then click “OK”.
- Yo will be invited to fill in your main parameters:
- Select the hosts to route the requests between.
- Select routing type, state traffic ratio, etc.
- Start the installation by clicking on the “Install” button.
- After being created, Traffic Distributor will represent a separate environment with NGINX load balancer server (with predefined amount of nodes) and a special add-on installed on top of it.
Herewith, during installation you also define an entry point for it. Set the requests for being processed either through the Shared Load Balancer or Public IP address(es), attached to each of the balancer nodes.
PLEASE NOTE: Traffic Distributor works by means of commonly used http and https protocols, but is also suitable for any other one, which works over them (including websockets). Herewith, the load balancing itself is performed only during http handshake operation, after which the persistent websockets connection to backend will be established.
In such a way, you can get an extremely flexible UKhost4u Traffic Distributor tool, intended to help you in accomplishing various goals:
- Starting with a simple routing to achieve even servers loading.
- Applying blue-green deployment to install app updates with zero downtime.
- Performing on-going A/B testing.
- Applying advanced failover protection.
You have a question? A doubt? Feel free to contact our super friendly team using our live chat or directly via our ticket system. We are available 24/7 and we’ll be glad to help you with your