I need to build "tasks scheduler" with Amazon tools. Main problem that i need execute task once with huge delay (it may be a few hours or few weeks).
I try to research how to build it with CloudWatch and Lambda function. As i understand - i need to use separate rule for one timeout execution. But AWS allow me only 100 rules/account.
Probably i'm going wrong way and this tools not intended for my task.
Also i tried SQS, but it did't allow me to set timeout more than 15 minutes. The simplest way - use own mircoservice with crone, but i hope that it is possible to do it in cloud )
May be someone has the same issue and can share with me thoughts about the implementation of this?
CloudWatch rules should work and you can use a cron expression for the event schedule.
I would recommend you to use disque for delaying message/retry and apscheduler (python) for scheduling your tasks.
You can use disque as a cluster also.
You can put these two inside an ec2-machine depending on your use-case.
Let me know, if you need any help!
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With