Debezium series: optimize cluster parameters and support personalized settings of debezium connector

One 、 background

at present debezium There are a series of problems , The obvious problem is ：

• There are a large number of databases DML In operation , consumption binlog Files are slow , It may take a few minutes 、 Even a few hours of consumption DML data

To enhance debezium Consumption ability , You may need to adjust the parameters of the cluster , And debezium Consumption capacity is important jmx Parameters can refer to the blogger's following blog ：

• Debezium Series of ： Further reading Debezium Important jmx indicators

Optimize Debezium There are two ways to set cluster parameters ：

• Mode one ： Modify... In configuration file debezium Parameters , restart debezium The cluster makes the configuration effective , This is a global approach , Configure for each debezium connector All in force .
• Mode two ： Separate for each debezium connector Increase the configuration , This is a local way , Configuration is only for a single debezium connector take effect .

Two 、 Optimize cluster parameters

Please refer to the blog below for details ,