The Olympic Games are performing miracles of ice and snow every day , And capture the moment , Condensation is the most wonderful 、 The most moving sports humanistic picture , Give Way “ Ice dance ”、“ Snow dance ”、“ The beauty of speed ”、“ The beauty of flying ” Bloom like a feast , Give Way “ Gold medal moment ” And “ National style ” Become an eternal echo of time and space . All of this can be achieved , From Alibaba cloud video cloud AI The cloud intelligent production capacity provided by the editorial department ——AI Yunzhi scissors .
if ,2022 The opening ceremony of the Winter Olympics is a story that China tells the world , It's a Chinese romance , The beauty of the moment of the Winter Olympics , More like Qingchuan wooden slips recording history , What unfolds is the extraordinary summit of characters and stories .
The Beijing Winter Olympics is coming to an end , All events are comprehensive and unfolding , Ice and snow miracles are performed every day . The Winter Olympics , The Chinese delegation realized... For the first time 7 Big item 15 Items “ The whole project ”, among 35 Xiang is the first time to stand on the Winter Olympic stage , So much event content also provides rich materials for the video production of the Olympic Games .
In order to give consideration to practical results in short video content of Winter Olympic events 、 wonderful 、 The humanities 、 aesthetic , CCTV sports new media and the head office technical team jointly Alibaba cloud video cloud 、 Alibaba Damo hospital , introduce AI The intelligent production tool of the editorial department “AI Yunzhi scissors ”, Intelligent content understanding of multiple events can be completed in real time , Intelligently and automatically generate a large number of wonderful video materials in a very short time , Covering the field 、 Event content 、 Multiple description dimensions such as various shots , Generate a collection of materials for aesthetic themes .
Freestyle skiing women's platform , Men's ski jump board 、 In figure skating , Chinese player Su Yiming 、 Gu ailing 、 Jin Boyang 、 Sui Wenjing / Han Cong and others performed well , Whether it's a gold medal , Or a breakthrough in self , The Winter Olympic spirit it conveys is as inspiring as fire in this winter .
AI Yunzhi scissors made multi-dimensional analysis of the video content as soon as the competition was completed , Completed the generation of wonderful materials , At the same time, based on Cross video collection production capacity , Produce theme collection videos for the audience for the first time , So far, it has been processed automatically 200+ game , Production material fragment 3 More than 10000 paragraphs , A large number of thematic videos generated are instantly presented on CCTV sports new media , Spread quickly .
In the dissemination of Sports Events ,AI Yunzhi scissors can efficiently 、 Fast 、 Comprehensively provide strong productivity for the broadcasting of Winter Olympic events , Quickly seize the release opportunity , It also brings timely and high-quality sports sense to the global event audience , At the same time, it also deeply develops the value of sports media copyright content for the media industry , Create more possibilities .
For the content of Olympic events ,AI Yunzhi scissors has set rich aesthetic theme intelligent templates , For example, for ice hockey 、 Skating 、 speed skating 、 Short track speed skating, etc , Set the theme “ Ice dance ”, For snowboarding and freestyle , Create a theme “ Snow dance ”, meanwhile , From the special perspective of Speed Events , Spinning like a flower 、 Ice hockey goals, etc , present “ The beauty of speed ”, For skiing events with rich jumping movements , shape “ The beauty of flying ”, It can be said that through intelligent video cloud technology , Fully capture the aesthetic light and shadow of the event .
The new content of science and technology Winter Olympics is productivity
AI The application of and machine learning in the field of sports media video production is the general trend of the industry , With the rapid evolution of digital media and the continuous change of audience's consumption habits of media content , Fragmented short video content has become the mainstream in various content consumption fields , Sports media content is no exception .
This winter Olympics is based on science and technology ,AI In which the role is crucial , be based on AI Editorial Office , Its cloud intelligent production capacity “AI Yunzhi scissors ” It has played a great value in the production of event content , It has become the productivity of the new content of scientific and technological Winter Olympics .
Take the game itself as the core ,AI Yunzhi scissors defines the wonderful information of the event content 、 extract , From the game video 、 Commentary audio 、 Identify and analyze various dimensions such as character field notes , And using multi-modal fusion technology , From the realization of the feature collection effect under complex scenes .AI Yunzhi scissors can efficiently edit sports event videos AI content analysis , It can generate various types of highlights in real time , In addition to the wonderful action scenes 、 Other than the important segments in single events such as athlete collection , It also supports the United Nations to bring style 、 The beauty of flying 、 Collection video production of various types of complex themes such as young generals' expedition , Realize video content analysis 、 Multi type video material production 、 Multi level short video production capacity generated by Cross video complex theme video .
AI Yunzhijian relies on the powerful streaming media processing capability of Alibaba cloud video cloud , Can guarantee the wonderful collection of every game , stay 3-5 Generate... In minutes , Then quickly released by the platform , It has greatly improved the ability of the media to seize the opportunity and the public's sense of enjoyment of the Winter Olympic Games .
chart 1 AI Flow chart of Yunzhi scissors
As shown in the figure above ,AI The intelligent production process of Yunzhi scissors , It mainly consists of two steps ：
First of all ,AI The model needs to understand the event video , Based on AI Long term accumulation in the field ,AI Yunzhi scissors can carry out fine-grained behavior for a variety of sports events 、 Stadium Events 、 Human events 、 Deep understanding of lens types , At the same time, aesthetic evaluation of video clips 、 Action Excellence Evaluation 、 Diversity assessment , This is equivalent to the eyes and brain of the whole system , Only to see more 、 Watch carefully 、 Think all 、 Think fast , In the fierce winter Olympics , Present exquisite content for the audience as soon as possible . second , be based on AI Various types of fragments and multi index evaluation of model output , The material production module will select materials based on the compliance weight , Produce a large number of selected materials , At the same time, it also outputs a variety of theme collection materials .
meanwhile , In response to the theme of the green winter Olympics ,AI Yunzhi scissors adopts a single video understanding model for the first time , For many events 、 From multiple sources 、 Content analysis of various videos 、 Multi type video material production 、 Multi level short video production of complex theme video generation across videos .
The video understanding model has three outstanding content values ：
• You can ski across freestyle 、 Figure skating 、 Snowboarding 、 Hockey 、 quick-skating 、 Many fine-grained actions in many events such as short track speed skating are recognized , Capture moments ;
• It can recognize the non competitive actions in the event video , Feel the cheers of the audience 、 The mood of the players 、 Awards, gold medals and other critical moments ;
• Lens types can be distinguished , Carry out intelligent combination of multiple types of materials .
Put the burden of completing so many complex tasks into one model , This is also true. AI Cut by Yun Zhi AI The ability of model generalization brings great challenges .
The new algorithm behind the new content on the Winter Olympic cloud
adopt AI Yunzhi scissors presents new content , The cloud intelligent production of the Winter Olympics uses a new intelligent algorithm technology . In essence, logically ,AI Yunzhi scissors is based on intelligent algorithm model , Deconstruction of video events 、 analysis 、 score , Finally, based on diversity strategy , as well as AI Intelligent video material generation based on the diversity score output by the model .
It is relying on cutting-edge technology ,AI The model can be used with less computing resources , Realize multiple events 、 From multiple sources 、 Content analysis of various videos 、 Collection material production .
Collaborative Alibaba cloud video cloud technology output , The Algorithm Engineers of Alibaba Dharma Institute adopt the pre training model technology newly developed by Alibaba LOOK（ This technology has been recognized by the top conference in the field of artificial intelligence ICLR 2022 Employment ）. Compared with common training methods, it is required that the characteristics of all samples of the same category are close to one central feature ,LOOK In the process of model training, only similar samples that are close to each other are required to be closer , Keep more feature degrees of freedom .
It can be said that , This is from a “ Seek common ground and eliminate differences ” To “ Seek common ground while reserving differences ” Process improvement , Because more effective information is retained in the training process , It also makes the representation ability of model features more general , Finally, based on this basic model of general representation , Several lightweight multi branch task models are constructed , To accomplish multiple tasks .
Because they share the same basic representation model , In terms of computational consumption, the additional computational burden of multiple task branches compared with a single task branch is almost negligible , But it can achieve the same effect as using multiple models directly AI Ability .
It is based on this technology ,AI Yunzhi scissors can support the short video production task of the Winter Olympics faster, higher and stronger .
chart 2 Pre training model technology LOOK Sketch Map
In addition to using pre training model technology , Because the video data of the Winter Olympics is a model “ Never seen ” The data of , In order to ensure the robustness of the model and the stability of the calculation results , Alibaba's latest open set identification technology NGC（ Has been recognized by the computer vision Summit ICCV 2021 Employment is an oral report ） Also introduced .AI The model will use both the confidence of the model prediction and the geometry of the features , To jointly determine the final result , It also makes AI Although this is the first time for Yun Zhijian to appear in the Winter Olympics , But it's also quite “ steady ”.
chart 3 Open set recognition algorithm NGC Sketch Map
Besides , Alibaba Dharma academy has accumulated a lot of technology in the field of video understanding , Including basic model representation , Time series feature modeling 、 Self supervised representation, etc , Through Alibaba cloud video cloud AI The ability output of Yunzhi scissors , All show their heads and feet in this winter Olympic Games , It is also open source in EssentialMC2 Technical framework （https://github.com/alibaba/Es...） in , In this way, we are committed to promoting the technological development of the community in the field of video content understanding .
Create new audio-visual of top events for many times
As early as 2018 During the world cup , Alicloud video cloud AI The editorial department focuses on using “ video AI+ Cloud clip + Media management ” Technology , Real time production of highlights and star highlights , Full of football fans' need to review the game and pursue stars .
stay 2018 At the world cup , CCTV5 Alibaba cloud video cloud is adopted AI Video from the editorial department AI technology , Realize the detection of the first pass 、 Playback detection 、 Danger detection 、 Foul detection 、 Trajectory analysis and attack rhythm analysis, etc , use AI Technology replaces the huge and complex HD live production equipment , Efficient and real-time collection of events , Let's not miss it .
After four years of technical training and product polishing ,AI The editorial department has successively supported football 、 Basketball 、 Curling 、 Figure skating 、 Short track speed skating 、 Featured Collection and theme production of skiing and other events , Help users effectively improve video production efficiency , Make content faster 、 More wonderful , And more beautiful .
The Winter Olympics is coming to an end ,AI Video from the editorial department AI Technology has successfully landed in this Olympic Games , This is another milestone in the application of events , It's also a video AI A broad start for the sports industry and more . Experienced the technical support for such a large event as the Centennial Olympic Games , Alibaba cloud video cloud can be more mature 、 Stably deal with video analysis and processing in the event scene ,AI Technology will also penetrate into various industries , Help industry customers efficiently improve the productivity of new content , Let each event have a completely different new audio-visual experience , It also makes the humanistic beauty of the event bloom .
【AI Editorial Office 】
As an intelligent media production product of Alibaba cloud video cloud ,AI The editorial department is the infrastructure of the content production industry in the intelligent era , It is an end-to-end product that can be delivered locally .AI The editorial department delivers an intelligent content production line for new media , With the help of big data technology and artificial intelligence , Realize video manuscript 、 Automation of graphic manuscripts 、 Mass production 、 Intelligent production , So faster 、 Better 、 More widely serve to seize the new media market .
【AI Yunzhi scissors 】
As AI The editorial department's intelligent production capacity for the theme collection of Sports Events ,AI Yunzhi scissors can produce materials in real time during the live broadcast of the event , Provide high-quality and efficient short video content production technology for wonderful events .
Alibaba cloud video and cloud multimedia AI Experience Center
「 Video cloud technology 」 Your most noteworthy audio and video technology official account , Push practical technical articles from alicloud every week , Here to exchange views with first-class engineers in audio and video field . Official account back office reply 【 technology 】 You can join Alibaba cloud video cloud product technology exchange group , Discuss audio and video technology with big players in the industry , Get more up-to-date information about the industry .
![[harmonyos] [arkui] how can Hongmeng ETS call pa](/img/19/9d2c68be48417e0aaa0d27068a67ce.jpg)
