Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Is one large AWS instance better than several smaller instances for the scylladb

I have one scylla db cluster with 9 nodes and RF=3 using amazon AWS i3en.xlarge instance.

I'm curious if 3 i3en.3xlarge are much better than 9 i3en.xlarge.

like image 280
SilentCanon Avatar asked Aug 13 '19 18:08

SilentCanon


People also ask

Why do we need more than 1 instance?

So, multiple instances will allow you to scale each customer at different times and rates and will allow you to develop each solution without affecting each other.

Which instance type is best suited for accessing huge amounts of data?

As the name suggests, memory-optimized instances are used for memory-intensive workloads that are required to process large datasets at a fast speed. Examples of memory-intensive applications include Big Data analytics or those running on Hadoop or Apache Spark.

What is the best EC2 instance class for heavy CPU load?

The compute-optimized AWS EC2 instance type is intended for running computer-intensive tasks that require many CPU resources but don't have high memory and storage requirements. This EC2 instance type provides access to many virtual processors with high performance.

What is the maximum number of EC2 instances that you should launch to achieve optimum performance?

One thing to note is that your account EC2 instance limits should be set to more than 20 instances per region, otherwise you could end up being unable to launch new instances when you most need them.


1 Answers

Full disclosure - I work on the ScyllaDB project.

Theoretically, Scylla's shard-per-core architecture means that 16 4xlarges or 4 16xlarges should perform fundamentally the same. Each vCPU performs as in independent shared-nothing shard doing its own thing. So, how those shards are configured is irrelevant.

However, in the real world, there are good reasons for scaling up, rather than scaling out. For example:

  • Larger nodes have better network guarantees from AWS.
  • Larger nodes have fewer noisy neighbor problems.
  • Managing a few nodes is generally easier than managing many nodes.

Generally speaking, our users have had better experiences with larger nodes. But the choice is yours.

like image 115
Greg Avatar answered Oct 05 '22 18:10

Greg