Debezium series: when there are a large number of DML operations in the record source database, the debezium consumption data time lags behind the data generation time by several hours

One 、Debezium The consumption data lag behind the data generation time by several hours

As shown below ,debezium connector There is a high consumption delay ：

• debezium_metrics_MilliSecondsBehindSource{context=“streaming”,name=“debezium-prod-optics_prod_1h”,plugin=“mysql”,} 4454030.0

As shown below ： The remaining consumption capacity is 0：

• debezium_metrics_QueueRemainingCapacity{context=“streaming”,name=“debezium-prod-optics_prod_1h”,plugin=“mysql”,} 0

more debezium Of JMX metrics Indicators refer to the following two blogs of bloggers ：