How to auto scale docker containers in a regular cloud server?

Question

To make a scale-able architecture with docker containers is a very attractive solutions to deal with scale-ability issue. We can auto scale docker containers in Amazon Elastic Beanstalk environment or in a vendor specific pass environments.

What is the best way to make your own scale-able docker architecture on commodity cloud servers such as Digital Ocean or Rackspace that will auto provisions containers based on loads.

Answer 1

The most known solution for managing scaling a docker-based infrastructure are:

• docker swarm
• Kubernetes
• for CoreOS, Fleet
• Apache Mesos

This article mentions:

In terms of scale, only Mesos has been proven to support large-scale systems of hundreds or thousands of nodes. However, when looking at small clusters of, say, less than a dozen nodes, Mesos may be an overly complex solution.

As mentioned here:

Almost everything we can do with Docker we can do with Swarm as well only on a much larger scale. There’s nothing new to do, no configurations to be duplicated and nothing new to learn.

So start with Docker Swarm first, and if particular needs arise, look for the other solutions.

See:

• "Deploy and Manage Any Cluster Manager with Docker Swarm"
• "Using Machine to provision Docker Swarm clusters"