AWS DMS操作示例

AWS DMS 操作示例

1.  概要

数据导入导出 AWS Database Migration Service

主页：https://aws.amazon.com/dms/

管理台：https://console.aws.amazon.com/dms/home

2.  主要的源、目标数据库产品

Source Database

Target Database on Amazon RDS

（be on-premises, or in Amazon RDS or EC2）

（be ineither Amazon RDS or EC2）

Microsoft SQL Server

Amazon Aurora, MySQL,PostgreSQL, MariaDB

MySQL and MariaDB

PostgreSQL

Oracle

Amazon Aurora, MySQL,PostgreSQL, MariaDB

PostgreSQL

Amazon Aurora, MySQL,MariaDB

Amazon Aurora

PostgreSQL

Oracle Data Warehouse

Amazon RedShift

Teradata

Amazon RedShift

Migration

SchemaConversion

Consolidation

Continuous DataReplication

Topics

Network Configurations

Sources

Targets

Schema Conversion

DataConversion - (Unsupported Data Types)

控制台主要任务

3. 步骤列表

Step 3.

高级选项

Step 4.

高级选项

表映射

Step 5.

状态变化：Creating → Ready → Starting → Load complete

执行

成功

以下log输出示例：

2016-10-19T07:43:46[TASK_MANAGER ]I: Task 'H45JHJOT42E2IDSBB6SZ43Z4RE' running full load only infresh start mode (replicationtask.c:805)

2016-10-19T07:43:46[TASK_MANAGER ]I: Creating threads for all components(replicationtask.c:1279)

2016-10-19T07:43:46[TASK_MANAGER ]I: All stream components were initialized(replicationtask.c:2110)

2016-10-19T07:43:46[TASK_MANAGER ]I: Starting subtask #1 (replicationtask_util.c:862)

2016-10-19T07:43:46[TASK_MANAGER ]I: Threads for all components were created(replicationtask.c:1425)

2016-10-19T07:43:46[TASK_MANAGER ]I: Task initialization completed successfully(replicationtask.c:2265)

2016-10-19T07:43:46[SOURCE_UNLOAD ]I: ODBC additional properties = '(null)'(mysql_endpoint_imp.c:605)

2016-10-19T07:43:46[SOURCE_UNLOAD ]I: Connecting to MySQL through ODBC connection string:DRIVER={MySQL ODBC 5.3 UnicodeDriver};SERVER=54.86.173.227;port=3306;UID=root;PWD=***;DB=;initstmt=SETtime_zone='+00:00';Option=74448900; (mysql_endpoint_imp.c:692)

2016-10-19T07:43:46[TARGET_LOAD ]I: Going to connect to ODBC connection string: DRIVER={MySQL ODBC5.3 Unicode Driver};SERVER=mydb-backup.cwsmnpiajkws.us-east-1.rds.amazonaws.com;PORT=3306;UID=root;(odbc_endpoint_imp.c:2094)

2016-10-19T07:43:46[TARGET_LOAD ]I: Target database time zone is UTC+0 hours(odbc_endpoint_imp.c:2660)

2016-10-19T07:43:46[TARGET_LOAD ]I: Transaction size is 10000. Array size is 1000.(odbc_endpoint_imp.c:823)

2016-10-19T07:43:46[TARGET_LOAD ]I: Loading tables in 1 parallel threads by default(odbc_endpoint_imp.c:1417)

2016-10-19T07:43:46[SOURCE_CAPTURE ]I: ODBC additional properties = '(null)'(mysql_endpoint_imp.c:605)

2016-10-19T07:43:46[SOURCE_CAPTURE ]I: Connecting to MySQL through ODBC connection string:DRIVER={MySQL ODBC 5.3 UnicodeDriver};SERVER=54.86.173.227;port=3306;UID=root;PWD=***;DB=;initstmt=SETtime_zone='+00:00';Option=74448900; (mysql_endpoint_imp.c:692)

2016-10-19T07:43:46[TASK_MANAGER ]I: Start loading table 'dms'.'test' (Id = 1) by subtask 1. Start load timestamp00053F32F81420DE (replicationtask_util.c:1028)

2016-10-19T07:43:46[SOURCE_UNLOAD ]I: Unload finished for table 'dms'.'test' (Id =1). 2 rows sent.(streamcomponent.c:2567)

2016-10-19T07:43:46[TARGET_LOAD ]I: Load finished for table 'dms'.'test' (Id =1). 2 rows received. 0 rows skipped. Volumetransfered 648 (streamcomponent.c:2787)

2016-10-19T07:43:46[TASK_MANAGER ]I: Table 'dms'.'test' (Id = 1) Loading finished by subtask1. 2 records transferred.(replicationtask.c:1639)

2016-10-19T07:43:46[TASK_MANAGER ]I: All tables are loaded. Full load only task is stopped(replicationtask.c:2522)

2016-10-19T07:43:51[TASK_MANAGER ]I: Subtask #1 ended (replicationtask_util.c:925)

2016-10-19T07:43:51[TASK_MANAGER ]I: Task management thread terminated(replicationtask.c:2679)

说明：

1. 以下测试的情况，针对的是MySQL的情况

2. “Extra connection attributes” 中输入 database 名字, 如”-D myDB” （不是必须）

3. 检查网络安全选项

4. 自定义 表映射 http://docs.aws.amazon.com/dms/latest/userguide/CHAP_Tasks.CustomizingTasks.TableMapping.html