The Brightbox Cloud Load Balancer service distributes traffic between a pool of your Cloud Servers, allowing you to scale your systems and have automatic fault tolerance. The balancer runs continuous health checks and removes any unresponsive servers from the pool until they recover.
The Load Balancers are highly available across a Region so can tolerate the loss of an entire Zone without disruption.
Each Load Balancer consists of one or more listeners which control the ports and protocols it responds to.
Listeners have four attributes:
in-portis the port that the Load Balancer listens on for incoming connections
out-portis the port the load balancer will connect to on your back end servers - this will usually be the same as
typeis the protocol the listener should use, can be
timeoutis the time (in milliseconds) after which inactive connections will be closed. It defaults to 50 seconds if not specified.
So, if your back-end servers have a web service running on port
you want the load balancer to serve requests on port
80, you would use a
listener with an
in port of
80 and an
out port of
There are currently five options for the listener type.
If the type is set to
tcp, the load balancer makes a straight
unmodified tcp connection to the back-end servers. Useful for load
balancing non-http services such as SMTP or SSH.
http types are HTTP listeners and the load balancer parses
the request and adds a
X-Forwarded-For header, so your back-end
servers can see the IP address of the client.
X-Forwarded-Proto header is explicitly removed from HTTP requests.
https type supports secure connections using SSLv3, TLS 1.0, 1.1
The ciphersuite is specified as per Mozilla’s own recommendations.
The load balancer adds a
X-Forwarded-Proto: https header to requests so that
backend servers can distinguish them as having been encrypted.
SSLv3 support is disabled by default and must be explicitly enabled. SSLv3 is no longer considered secure and it is recommended to disable it where possible. If you need to support older browsers and clients that don’t speak TLS, then you should enable SSLv3.
All HTTPS listeners on a load balancer will use the one same x509 certificate and private key.
There are two ways to specify certificates, manual and automatic. See the certificates section for more details.
https+wss listener types, Load Balancers can accept both
standard HTTP and
WebSocket connections over
the same port. The
timeout (either default or specified) is applied
to standard HTTP connections and WebSocket connections are given a
fixed timeout of 1 day.
When using the HTTP types, there is a size limit on the HTTP request
headers that can be controlled with the
Request buffer size option. The higher this setting, the more memory each connection requires on the load balancer, so the less concurrent connections can be supported.
It’s set to 4096 bytes by default which allows 20,000 concurrent connections and should support the majority of use cases.
Requests that exceed this limit will get a HTTP 400 (Bad Request) error.
60 bytes of the buffer are used by the
The timeout setting determines how long inactive connections remain
open before they are closed by the load balancer. The timeout is
specified in milliseconds and must be between
(one day). By default the timeout is
50000 milliseconds (50 seconds).
Automatic certificate management uses the Let’s Encrypt certificate authority to generate and renew free certificates for you without the need for you to create your own key or CSR.
Just provide a list of domain names and then a certificate will be generated for you automatically and kept renewed.
For the certificate to be generated successfully, each domain name you specify must resolve to a Cloud IP mapped to the Load Balancer.
If you specify domains on a Load Balancer with no Cloud IPs mapped, a certificate will not be generated until you map a Cloud IP to it. This allows you to seamlessly transition from a Cloud Server or another Load Balancer.
Each domain associated with a Load Balancer has a status.
pending status means the domain is awaiting a certificate; either the
generation request is in progress or the Load Balancer does not yet have a Cloud IP
valid status means that a certificate has been successfully created for the
invalid status means that there was an error creating the certificate for the
domain. It could mean the domain doesn’t resolve to a Cloud IP mapped to the
Load Balancer, or it may not resolve or exist at all.
Invalid domains are dropped from the certificate, leaving only the valid domains. If you rectify the problem with the domains, then re-add it to the Load Balancer and the certificate will be updated.
If a valid domain later becomes invalid, it will remain on the certificate until you update the domain list or until the automatic renewal time, which is currently every 90 days. You will receive a notification by email of the invalid domains before the renewal period, giving you time to rectify the problem.
If you don’t rectify an invalid domain before the renewal time, it will be dropped from the certificate leaving only the valid domains.
Certificate purchased elsewhere can also be manually provided in PEM format, along with the key. Any intermediate certificates should go after the main certificate in the certificate PEM file.
Each Load Balancer can have one health check. A health check defines how the Load Balancer detects problems with your back-end servers. The Load Balancer will not send requests to unhealthy back-end servers until they recover.
The health check has several options. The
port is the tcp port that the
Load Balancer will attempt to connect to on each back-end server.
timeout is how long in milliseconds the Load Balancer will wait for the
connection to complete before deciding the health check failed.
is how long in milliseconds between each health check.
The health checks are run for each listener, so if you specify a 20 second interval and have 2 listeners you will actually see checks every 10 seconds on the back end servers.
type option specifies whether the health check is a standard tcp
connect attempt or a more detailed HTTP check. It can be set to
type is set to
request option defines the path to be
used by the Load Balancer when making the HTTP health check request.
type is set to
request option is ignored.
There are two “thresholds” associated with the health check which are used to control when back-end servers are considered unhealthy.
threshold_down sets the number of consecutive health checks that must
fail for the server to be considered unhealthy. This can help prevent a
transient error with one of your servers causing it to immediately be
threshold_up sets the number of consecutive health checks that must
succeed for an unhealthy back-end server to be considered healthy again
and ready for new requests. This can help when a back-end server isn’t
completely unhealthy and some health checks are succeeding. In this case
you usually do not want the server to start receiving requests.
The Load Balancer policy defines how requests are distributed between servers.
policy is set to
round-robin, the Load Balancer simply passes
each new request to each back-end server in turn. So request 1 goes to
server A, request 2 to server B, request 3 to server C and request 4 to
server A again.
This policy is best when your requests tend to take about the same amount of time to complete.
policy is set to
least-connections, the Load Balancer passes
each new request to the back-end server with the least number of connections
currently open to it. This policy is good for when the amount of time your
requests take to complete varies a lot.
policy is set to
source-address, the Load Balancer tries to send
requests from the same source IP address to the same back-end server. This
provides a kind of best-effort session stickiness, which may help with
performance if you have some localised caching in your app.
Last updated: 23 Jul 2018 at 10:51 UTC