Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

max concurrent connection to amazon load balancer

My testing shows that amazon load balancer rest connection with its instance when it has about 10k concurrent connections into it. Is that a limit of Amazon load balancer? If not, is there a setting for it? I need to support upto 1M concurrent connections for my testing.

Thanks,

Sean Nguyen

like image 696
Sean Nguyen Avatar asked Dec 08 '11 20:12

Sean Nguyen


People also ask

How many concurrent connections can a load balancer handle?

Load balancer will be forced to use different IP addresses thus allowing you to bypass 64k connection limitation and achieve 192k connections.

How much traffic can an AWS load balancer handle?

A: Yes. Network Load Balancer currently supports 200 targets per Availability Zone. For example, if you are in two AZs, you can have up to 400 targets registered with Network Load Balancer. If cross-zone load balancing is on, then the maximum targets reduce from 200 per AZ to 200 per load balancer.

How many concurrent users can AWS handle?

Advice : AWS Capacity Planning for 20,000 concurrent users.

How many concurrent connections can EC2 handle?

By default 1024 connection are aloowed in /etc/security/limits. conf , it can be increased upto 65535 connections max..


1 Answers

The ELB should scale way beyond that, but you need to be testing from multiple test clients that appear to come from unique source IPs. This will cause multiple ELB instances to spawn multiple instances behind the scenes (this can be detected by DNS lookups). This is explained in the whitepaper that Rightscale published: http://blog.rightscale.com/2010/04/01/benchmarking-load-balancers-in-the-cloud/

Note that it takes a little while for ELB resources to scale out, so tests need to run for 20 minutes or more.

You also need to be sure that you have enough resources behind the load balancer. EC2 instances (as shown in the white paper mentioned above) seem to hit a throughput limit of around 100k packets per second which limits the number of concurrent connections that can be served (bear in mind the overhead of TCP and HTTP). You will need a lot of instances to be able to cope with 1M concurrent connections, and I'm not sure at what point you will hit the limit of ELB; in RightScale's test they only hit 19k.

Also you need to be clear about exactly what you mean by 1M concurrent connections, do you mean total keep-alive connections (assuming keep-alive enabled), or do you mean 1M transactions per second?

like image 67
James Little Avatar answered Nov 15 '22 04:11

James Little