Enabling partners, major guarantee of Spring Festival "non-stop"

author ： Gaowenke

       2022 Spring Festival Eve , Get emergency help from your partner , The customer's rebroadcast business should be put on the cloud , It is necessary to urgently deploy the online commercial , The system will host the broadcast of the Spring Festival Gala , The Spring Festival Gala is a traditional Chinese festival , The system requires high network bandwidth and the number of concurrent links , But the actual business pressures are uncertain , In this context and time nodes , The task of this support is arduous 、 Great responsibility .
      Huawei cloud enabling partner , Cooperate with customers to provide service guarantee
      Quickly align business objectives and launch plans with customers on the project support kick-off meeting ： The core goal is to ensure the stable operation of the system . The key milestones are ： Business model evaluation , Deployment scheme output , Business deployment online , Business pressure test , Set up a support team , Risk identification and mitigation , Re insurance scheme and emergency plan , Ensure startup , A detailed routine guarantee operation mechanism and cooperative division of labor have been formulated , At the same time, the measures for partner empowerment are output .
Targeted deployment scheme ： Urgently organize relevant personnel to find out the business needs , Analyze the business model and key features , Output targeted resource satisfaction evaluation and deployment scheme , And consider uncertain risks and factors in advance , In the scheme, large redundancy is reserved for the bandwidth and the number of concurrent connections , Ensure the accuracy and rationality of the scheme ;
Conduct pressure test around the deployment scheme ： After three rounds of joint review, the deployment scheme coordinates with customers and the cloud
Can jointly conduct pressure measurement , It is mainly aimed at the pressure test and flow control of customer business systems and the pressure test of the cloud platform's affordability , Then the pressure measurement data are analyzed by multiple rounds and the matching degree is correlated , Provide quantitative input for monitoring thresholds .
      Huawei cloud is based on the data and business characteristics of the pressure test , Carry out risk identification of existing network and output risk identification of re insurance scheme
      · Business deployment scheme risk ： Share of business , Business disaster recovery switching , Service fusing and current limiting , Communicate with customers about specific measures in terms of business expansion and e-mail confirmation ;
      · Cloud platform risks ： Virtual machine anti affinity ,ELB The instance size is adjusted to the maximum , The security white list is tracked and landed on the cloud platform .

      Re insurance scheme ：
      · Support team ： Joint support team （ partner + Huawei ）;
      · Guarantee mode ： On site support + Remote office + On-line OnCall;
      · Inspection and monitoring ： Output core monitoring indicators and thresholds according to pressure measurement data , Judge the condition of indicators through monitoring , Make corresponding emergency and treatment measures ;
      Emergency plan ：
      Output of customer system emergency measures and cloud platform emergency measures , And conducted a pre drill , Control the operation to 5 Within minutes, ;
      The results of the on-site support arrangement and emergency drill , It has been recognized and supported by customers .
      Routine support and operation ：
      Daily inspection and index confirmation ： Monitor metrics and thresholds based on the platform , Regularly view platform indicators and analyze , Complete monitoring and patrol inspection , The joint partners analyze the data of the day （ Business peak , Threshold percentage , System risk ）, And report the guarantee information ;
      Partner empowerment ：
      · After the guarantee scheme and operation are clear , Three times of empowerment for partner related teams ：
      · Enabling the overall business plan ： Business models and features , Deployment plan , Key risks , matters needing attention ;
      · Support scheme and emergency empowerment ： Coordinative operation , Division interface , Emergency plan and joint WarRoom.
      · Routine monitoring enables : Monitoring methods and measures , Threshold setting and business risk judgment , Emergency response ;
      On site support ：
      The on-site support team overcame various difficulties in epidemic prevention and control , Arrive before the Spring Festival Gala X Municipal site , Fully communicated and urgently cooperated with the customer support team , And carried on 7*24 Hours on duty , Become a partner to support the site “ HUAWEI Legion ”, And the partner monitoring team was empowered on site .
      Guarantee the result ：
      Completed a major guarantee for the Spring Festival Gala , It ensures the stable operation of the system , No abnormality occurred , Finally, the major support task was successfully completed . 
      Overall support experience and summary ：
      1、 For time urgency , Arduous support task , Organize relevant personnel to have a full discussion before the guarantee 、 Brainstorming , Let all fields have “ major ” contribution .
      2、 Solutions in the process , details , Risk identification is comprehensive ： All points involved in the scheme shall be recorded, analyzed and discussed , Identify possible risk points , Give risk reduction measures and track the closed loop ; 
      3、 Safeguard measures and implementation ： Safeguard measures are fully implemented , Keep tracking during the process , Monitor completion , immediately / Do it now , And check the completion of measures ;
      4、 Partners are highly collaborative ： Form a joint support team with partners , And define the division of labor and operation support mechanism in the process , Fast empowerment , Make full use of partners to ensure team resources .