RabbitMQ
| 功能 | 说明 |
|---|---|
增量实时同步 | 支持订阅源端 Topic 的消息，并转换为 INSERT、UPDATE、DELETE DML |
修改订阅 | 新增、删除、修改订阅 Topic，文档：修改订阅 |
重置位点 | 按 时间戳 回溯位点，重新消费过去一段时间的数据 |
高级功能
| 功能 | 说明 |
|---|---|
Message Format | The following message formats are supported. See Message Format.
|
Removal of Target Data before Full Data Migration | Remove the existing data in the Target before running the Full Data Migration, applicable for DataJobs reruning and scheduled Full Data migrations. |
Recreating Target Table | Recreate target tables before running the Full Data Migration, applicable for DataJobs reruning and scheduled Full Data migrations. |
Incremental Data Write Conflict Resolution Rule | IGNORE: Ignore primary key conflicts (skip writing), REPLACE: Replace the entire row in case of primary key conflicts. |
Handling of Zero Value for Time | Allow setting zero value for time to different data types to prevent errors when writing to the Target. |
限制和注意点
| 限制项 | 说明 |
|---|---|
Creating Tables in the Target in Advance | Only support automatic Queue creation for messages. |
Raw Message Format | Only support raw message replication from RabbitMQ to RabbitMQ, and Raw Message Format needs to be selected at both the Source and the Target. |
前置条件
| 条件 | 说明 |
|---|---|
Port Preparation | Allow the migration and sync node (Worker) to connect to the RabbitMQ ports. |
任务参数
| 参数名称 | 说明 |
|---|---|
schemaFormat | MQ message format. For more information, see Message Format. |
consumeParallel | Degree of consuming RabbitMQ topics in parallel. |
Tips: 通用参数配置请参考 通用参数及功能
前置条件
| 条件 | 说明 |
|---|---|
Permissions for Account | |
Port Preparation | Allow the migration and sync node (Worker) to connect to the MySQL/MariaDB port (e.g., 3306). |
任务参数
| 参数名称 | 说明 |
|---|---|
keyConflictStrategy | Strategy for handling primary key conflicts during write in Incremental DataTask:
|
dstWholeReplace | Convert INSERT and UPDATE operations into full row replacement in the Target. |
deCycle | Enable filtering in bidirectional sync to filter DML/DDL with specific markers. |
specialSqlMode | Set a specific SQL mode when initializing the connection between databases. |
defaultGisSRID | Set the SRID for GIS data types. |
dstTimeZone | Target time zone, e.g., +08:00, Asia/Shanghai, America/New_York, etc. |
increParallelApplyStrategy | Parallel write strategy for relational databases in the Target:
|
Tips: 通用参数配置请参考 通用参数及功能