Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Improving DynamoDB Write Operation

I am trying to call dynamodb write operation to write around 60k records.

I have tried to put 1000 write capacity unites for Provisioned Write capacity. But my write operation is still taking lot of time. Also when I check the metrics I can still see the consumed Write capacity units as around 10 per seconds.

My record size is definitely less than 1KB.

Is there a way we can speed up the write operation for dynamodb?

like image 233
Prasad Pande Avatar asked Oct 22 '25 04:10

Prasad Pande


1 Answers

So here is what I figured out.

I changed my call to use batchWrite and my consumed Write capacity units has increased significantly upto 286 write capacity units. Also the complete write operation finished within couple of minutes. As mentioned in all above answers using putItem to load large number of data has the latency issues and it affects your consumed capacities. It is always better to batchWrite.

like image 200
Prasad Pande Avatar answered Oct 23 '25 20:10

Prasad Pande