Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Issue with AWS DMS continuous replication

I am trying to create a DMS task to migrate data from RDS Postgres instance to S3 bucket. The full load works all fine, but the continuous replication is failing. Its giving this error:

"logical decoding requires wal_level >= logical"

When I checked the system settings from pg_settings, its showing that the setting "wal_level" has value "replica". So I tried to change the setting wal_level, but I am not able to find this setting in the Parameter Group in RDS. My RDS instance is using 9.6 version of parameters.

When I tried "ALTER SYSTEM SET wal_level TO 'logical'", it fails saying that "must be superuser to execute ALTER SYSTEM command", even though the user is under rds_superuser role.

Please suggest.

like image 611
Zinx Avatar asked Aug 10 '17 02:08

Zinx


People also ask

How does AWS DMS replication work?

AWS DMS uses a replication instance to connect to your source data store, read the source data, and format the data for consumption by the target data store. A replication instance also loads the data into the target data store. Most of this processing happens in memory.

Is AWS DMS reliable?

Reliable. The AWS Database Migration Service is highly resilient and self–healing. It continually monitors source and target databases, network connectivity, and the replication instance.

Does AWS DMS support CDC?

This process is called ongoing replication or change data capture (CDC). AWS DMS uses this process when replicating ongoing changes from a source data store. This process works by collecting changes to the database logs using the database engine's native API. You can migrate views using full-load tasks only.

How do I check DMS errors?

To identify the table that has an error, open the AWS DMS console. Choose Database migration tasks from the navigation pane. In the Tables errored column, the number of tables that have errors are listed. Choose the name of the task that has an error status.


1 Answers

The Parameter name in Parameter Group is "rds.logical_replication" which needs to be changed to 1. The default value was 0.

This property changed "wal_level" value to "Logical".

like image 128
Zinx Avatar answered Oct 06 '22 10:10

Zinx