Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

AWS Redshift vs Snowflake use cases

I was wondering if anyone has used both AWS Redshift and Snowflake and use cases where one is better . I have used Redshift but recently someone suggested Snowflake as a good alternative . My use case is basically retail marketing data that will be used by handful of analysts who are not terribly SQL savvy and will most likely have reporting tool on top

like image 674
ashu138 Avatar asked Jul 10 '17 21:07

ashu138


People also ask

How is Snowflake different from AWS Redshift?

Snowflake separates compute from storage, allowing for flexible pricing and configuration. Redshift allows for cost optimization through Reserved/Spot instance pricing. Snowflake implements instantaneous auto-scaling while Redshift requires addition/removal of nodes for scaling.

Which is faster Snowflake or Redshift?

Snowflake vs Redshift Performance: But the key difference is that Redshift generally takes a longer time for query optimization but as these queries are run repeatedly and on a daily basis, they tend to be faster. This isn't the case when it comes to Snowflake, it offers a much better performance with raw queries.

Why Snowflake is better than AWS?

Instead, AWS Snowflake uses a structured query language (SQL) database engine with an architecture specifically designed for the cloud. Compared to traditional data warehouses, Snowflake is incredibly fast, flexible, and user-friendly.

How is Snowflake distinct from AWS?

AWS Redshift uses the shared-nothing MPP architecture. The Snowflake architecture combines the traditional shared-disk with the shared-nothing database architectures. Azure Synapse uses a scale out architecture that separates compute from storage.


3 Answers

Redshift is a good product, but it is hard to think of a use case where it is better than Snowflake. Here are some reasons why Snowflake is better:

  • The admin console is brilliant, Redshift has none.
  • Scale-up/down happens in seconds to minutes, Redshift takes minutes to hours.
  • The documentation for both products is good, but Snowflake is better laid out and more accessible.
  • You need to know less "secret sauce" to make Snowflake work well. On Redshift you need to know and understand the performance impacts of things like distribution keys and sort keys, at a minimum.
  • The load processes for Snowflake are more elegant than Redshift. Redshift assumes that your data is in S3 already. Snowflake supports S3, but has extensions to JDBC, ODBC and dbAPI that really simplify and secure the ingestion process.
  • Snowflake has great support for in-database JSON, and is rapidly enhancing its XML. Redshift has a more complex approach to JSON, and recommends against it for all but smaller use cases, and does not support XML.

I can only think of two cases which Redshift wins hands-down. One is geographic availability, as Redshift is available in far more locations than Snowflake, which can make a difference in data transfer and statement submission times. The other is the ability to submit a batch of multiple statements. Snowflake can only accept one statement at a time, and that can slow down your batches if they comprise many statements, especially if you are on another continent to your server.

At Ajilius our developers use Redshift, Snowflake and Azure SQL Data Warehouse on a daily basis; and we have customers on all three platforms. Even with that choice, every developer prefers Snowflake as their go-to cloud DW.

like image 199
Ron Dunn Avatar answered Oct 06 '22 17:10

Ron Dunn


I evaluated both Redshift(Redshfit spectrum with S3) and SnowFlake.

In my poc, snowFlake is way way better than Redshift. SnowFlake integrates well with Relational/NOSQL data. No upfront index or partition key required. It works amazing without worrying about what way to access the day.

Redshift is very limited and no json support. Its hard to understand the partition. You have to do lot of work to get something done. No json support. You can use redshift specturm as a bandaid to access S3. Good luck with partioning upfront. Once you created partition in S3 bucket, you are done with that and no way to change until unless you redo process all data again to new structue. You will end up sending time to fix these issues instead of working on fixing real business problems.

Its like comparing Smartphone vs Morse code mechine. Redshift is like morse code kind of implementation and its not for mordern development

like image 6
chi stock Avatar answered Oct 06 '22 17:10

chi stock


We recently switched from Redshift to Snowflake for the following reasons:

  • Real-time data syncing
  • Handling of concurrent queries
  • Minimizing of database administration
  • Providing different amounts of computing power to different Looker users

A more in-depth writeup can be found on our data blog.

like image 5
Sami Yabroudi Avatar answered Oct 06 '22 15:10

Sami Yabroudi