Stream Aurora MySQL data changes into Kinesis Streams

Question

I am trying to stream Aurora MySQL data changes to Kinesis streams. What could be the best possible way to do this considering the fact that each and every record should be streamed into kinesis.

Answer 1

There are possibly numerous ways to do this, one of the popular one would be as follows:

1. Enable binlogs in your cluster [1]
2. Have a client (possibly a lambda function or an ec2 instance) that reads your binlog stream
3. Create your Kinesis stream
4. Make the client from Step 2 publish to your Kinesis stream from #3.

You can read articles [2] and [3] for reference. What you need is split between the two docs. ([3] is for postgres, but has some explanation about using lambdas or ec2 clients).

[1] https://aws.amazon.com/premiumsupport/knowledge-center/enable-binary-logging-aurora/

[2] https://aws.amazon.com/blogs/database/streaming-changes-in-a-database-with-amazon-kinesis/

[3] https://aws.amazon.com/blogs/database/stream-changes-from-amazon-rds-for-postgresql-using-amazon-kinesis-data-streams-and-aws-lambda/