Dynamodb streams in python

Question

I would like to read data from a dynamodb stream in python and the alternatives that i have found so far are

1. Use dynamodb stream low level library functions (as described here): This solution however seems almost impossible to maintain in a production environment, with the application having to maintain the status of shards, etc.

2. Use KCL library designed for reading Kinesis streams: The python version of the library seems unable to read from a dynamodb stream.

What are the options to successfully process dynamodb streams in python? (links to possible examples would be super helpful)

PS: I have considered using lambda function to process the dynamodb but for this task, I would like to read the stream in an application as it has to interact with other components which cannot be done via a lamda function.

Answer 1

I would still suggest to use lambda. The setup is very easy as well as very robust (it's easy to manage retries,batching, downtimes...)

Then from your lambda invocation you could easily send your data in a convenient way to your existing program (including, but not limited to: SNS, SQS, a custom server webhook, sending the data to a custom pub/sub service you own...etc)