youtube: https://youtu.be/73HSRWiBVsE?si=m73C7bj25Nweuvvc
1.Create DMS(Replication Instance) with specific SG then t3.micro type instance.
2.Create RDS with same SG of DMS & t3.micro rest all are same.
3.We have to create targets. Here my targets are S3 & DynamoDB
4.Create a Iam roles.
https://docs.aws.amazon.com/dms/latest/userguide/CHAP_Target.S3.html#CHAP_Target.S3.Prerequisites
5.To create IAM we can refer this link and copy paste and create custom IAM policy.
Here while creating S3 Role IAM we have to choose the DMS.
Then click on create a custom policy then copy paste the code from the above link then create role.
Creation of Target END-POINT:
In the DMS paze we can click on create end point, choose target end point & target identifier we can give any name & then choose the target engine as s3-bucket & we have to provide ARN of the bucket.
Then enter name of the bucket & then bucket folder we can give anything & we can leave end-point settings & use the same VPC what ever we used in the DMS replication & test the connection whether this endpoint is able to communicate with s3 or not & then create the end point.
Creation of Source END-POINT:
Click on DMS then choose endpoint then choose source endpoint then select the rds and choose the which rds we want to migrate.
Here we have to choose provide access information Manually.
We have to test the connection, then create the end point.
So finally we created 2 end points.
RDS:
Note down the DB end point.
IAM for Dynamo-Db To DMS:
Choose DMS then create custom policy then attach that policy and create role.
https://docs.aws.amazon.com/dms/latest/userguide/CHAP_Target.DynamoDB.html
Upload only these 3 settings which region & Account-ID & dynamodb Name ‘employee’
Endpoint For DyanamoDb:
Click on DMS click on end point choose target endpoint then Name of the target endpoint we can enter anything & target engine is DynamoDb and ARN of the role.
Test the connection then create the end-point.
So finally 3 end points are ther.
Create ec2 instance for connecting rds:
Create a ec2 instance with same vpc and SG(inbound-mysql) what ever we used while creating RDS.
If we used different SG while creating ec2 instance we can attach that Sg in the rds by modifying the rds
Add data into databases.
Here 1st we are creating one schema if not exist then we are creating databases.
Here we are creating the table and adding the data into table.
Create the parameter groups:
Ofter creating choose that and click on edit then modify the checksm & format like this.
Open rds then click on modify under parameter groups add this parameter what ever we created.
DB Migration Task:
We have enter name as anything then select the source and target of the DB
Here we have to select the only migration or ongoing migration.
In the database what ever we mention that schema and table
Same like that for dynamo db and s3 2 migration tasks should create.
We can check the data is migrated or not.
Her we have to choose ;Query with s3 Select’
Copy data into Dynamodb little fast compared to s3.-
How many times we do modification that many files will create in s3 in .csv file format.
Top comments (0)