Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

What's the use cases of Streams and Firehose?

Tags:

People also ask

Why use Kinesis data stream and Firehose?

Data Streams is a low latency streaming service in AWS Kinesis with the facility for ingesting at scale. On the other hand, Kinesis Firehose aims to serve as a data transfer service. The primary purpose of Kinesis Firehose focuses on loading streaming data to Amazon S3, Splunk, ElasticSearch, and RedShift.

What is firehose used for?

The typical 'fire hose' you see attached coiled on a fire truck and attached to a fire hydrant, they are used to carry water to fight fires in or outdoors. They are typically 100 feet long.

What are the main uses of Kinesis data streams?

Amazon Kinesis Data Streams is useful for rapidly moving data off data producers and then continuously processing the data, be it to transform the data before emitting to a data store, run real-time metrics and analytics, or derive more complex data streams for further processing.

What is streaming and what are the advantages of data streaming?

Also known as event stream processing, streaming data is the continuous flow of data generated by various sources. By using stream processing technology, data streams can be processed, stored, analyzed, and acted upon as it's generated in real-time.


I am working on an application that will read and analyze the logs of payment transactions. I know I will use Kinesis Analytics as per my requirements, which takes the input from the Data Streams and Firehose. But I am having trouble deciding which input method should I use for my system. My requirements are:

  1. It can tolerate latency, but Data shouldn't lose data.
  2. Must record all the errors in DynamoDB or S3 buckets.

Which input stream is suitable for my use case?