Detailed discussion on data synchronization tools ETL, ELT, reverse ETL

Talk about data synchronization tools in detail ETL、ELT, reverse ETL

What is a data synchronization tool ？

The function of data synchronization tool is to extract the data of business system 、 The process of loading the data warehouse after cleaning the transformation , The aim is to decentralize the business 、 Disorder 、 Standards are not unified data integration , Provide the analysis basis for the enterprise's decision . Data synchronization is an important part of big data projects .  

About ETL、ELT And the reverse ETL

What is the ETL？

Extract the data from the source side （extract）、 transformation （transform）、 load （load） The process to the end . 

ETL The concept of is mainly embodied in some data cleaning and transformation functions , For example, null value processing 、 Standardize data 、 Data substitution 、 Data validation and so on .

What is the ELT？

Extract the data from the source side （extract）、 load （load）、 transformation （transform） The process to the end .

In the data lake or data center, it is often used ELT To synchronize data .

ELT First, extract the data from the data source in an efficient way , Then the data conversion processing is carried out in the data warehouse . such ELT Compared to ETL There are great advantages , from ETL To ELT The change is mainly due to the popularity of the cloud , Lower storage costs , Thus making the tradition ETL This method segments data processing , The way in which only important result data is stored can be changed . At the same time, there are also innovative technical routes in China ： use ELT+Ａ（Active） The pattern of , To improve the efficiency of enterprises in using data value  .

What is reverse ETL？ 

reverse ETL It is an architecture for extracting cleaned and processed data . It will remove data from the data warehouse （ Or data lake / Market ） Copy to one or more operating systems . Data can be reintroduced, such as Salesforce And other applications , It can be used for business operation and prediction . By manipulating the extracted data source , Various users can use common tools to access data , And get relevant insights . As a component of modern data technology stack , reverse ETL Allow enterprises to carry out those than using business intelligence alone （BI） Tools , More complex analysis .

As a strategic new integration process , reverse ETL It can reduce the time that those fast-growing enterprises spend on data analysis . This process is more focused on synchronizing data with the operational tools of business users , To activate the data in the data warehouse . The user must define the data in advance , And map it to the appropriate column of the final destination / Field .

meanwhile , Due to the data storage of enterprises （ Such as , Data reference or relational database ） It has become a repository that not everyone can fully access , therefore , We need to reverse ETL, To provide basic data for different business roles .