Research and development practice of Kwai real-time warehouse guarantee system

The main contents include ：

1. Business features and pain points of real-time data warehouse guarantee

2. Kwai real-time data warehouse support system architecture

3. Real time guarantee practice of spring festival activities

4. The future planning

01 Business features and pain points of real-time data warehouse guarantee

• The biggest business feature of Kwai is Large amount of data . The daily inlet flow is trillions . For such a large flow inlet , Reasonable model design is needed , Prevent excessive consumption of repeated reads . In addition, in the process of data source reading and Standardization , The extreme pressing performance ensures the stable implementation of inlet flow .

• The second characteristic is Diversified demands . The requirements of Kwai business include the scenario of large active screen 、2B and 2C Business applications for 、 Internal core Kanban and real-time search support , Different scenarios have different requirements for support . If you do not do link classification , There will be confusion of high and low priority applications , It will have a great impact on the stability of the link . Besides , Because the core of the Kwai business scenario is to do content and creators IP, This requires us to build common dimensions and common models , Prevent repeated chimney construction , And quickly support application scenarios through common models .

• The third characteristic is Frequent activity scenes , And the activity itself has a high demand . The core demands are mainly in three aspects ： It can reflect the traction ability of the company's overall indicators 、 It can analyze the real-time participation and adjust the playing strategy after the activity starts , For example, through the real-time monitoring of red packet costs, we can quickly perceive the effect of activities . Activities usually have hundreds of indicators , But only 2-3 Weeks of development time , This requires high stability .