带有 CDC 的 AWS DMS.更新记录只包括更新的字段.如何包括所有? [英] AWS DMS with CDC. The update records only include the updated field. How to include all?

问题描述

我们最近开始使用 AWS DMS 从 RDS 上的 Oracle 数据库到 S3 的持续迁移(初始加载 + CDC)过程.数据库正在使用 LogMiner.

We recently started the process of continuous migration (initial load + CDC) from an Oracle database on RDS to S3 using AWS DMS. The DB is using LogMiner.

我们检测到的问题是 Update 类型的 CDC 记录只包含被更新的数据，其余字段为空，因此简单地将具有最大时间戳值的记录视为有效的可能性丢失了.

the problem that we have detected is that the CDC records of type Update only contain the data that was updated, leaving the rest of the fields empty, so the possibility of simply taking as valid the record with the maximum timestamp value is lost.

有谁知道这是否可以更改或在 DMS 或 RDS 配置的哪个部分进行触摸，以便更新包含记录的所有字段的信息?

Does anyone know if this can be changed or in what part of the DMS or RDS configuration to touch so that the update contains the information of all the fields of the record?

提前致谢.

推荐答案

表级别的补充日志记录可能会增加记录的内容，但这也会增加为给定工作负载写入的日志数据总量.

Supplemental Logging at table level may increase what is logged, but that will also increase total volume of log data written for a given workload.

来自不同供应商的许多基于日志的数据复制产品需要在表级别进行额外的补充日志记录，以确保将更改前后数据更新的完整行数据写入数据库日志.

Many Log Based Data Replication products from various vendors require additional supplemental logging at the table level to ensure the full row data for updates with before and after change data is written to the database logs.

re:https://docs.oracle.com/database/121/SUTIL/GUID-D857AF96-AC24-4CA1-B620-8EA3DF30D72E.htm#SUTIL1582

通过 LogMiner 提取数据是可能的，但您需要评估它是否可以根据您需要的数据量进行扩展.

Pulling data through LogMiner may be possible, but you will need to evaluate if it will scale with the data volumes you need.

这篇关于带有 CDC 的 AWS DMS.更新记录只包括更新的字段.如何包括所有?的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！