Open source and innovation

”

8 month 5 Japan -6 Japan ,LiveVideoStackCon 2022 Audio and Video Technology Conference Shanghai Station , Open the door to the future with you .

Open source and innovation

In the vast ecosystem of multimedia technology , There are a lot of open source technology tools 、 Frames and Libraries , For example, widely used FFmpeg, GStreamer, SRS, WebRTC, X264/X265, VLC etc. , These open source projects have laid the technical foundation of the multimedia industry , Also to break through industry barriers 、 Global optimization of business provides a broad space . meanwhile , We can see the continuous evolution and optimization of classic open source projects , You can also see the continuous burst of new open source projects , They work well with a variety of innovative scenarios （ Like the Internet of things , Meta universe , Cloud games ） combination , Make the multimedia industry full of vitality .

Lecturers and topics

At present, the low delay live broadcast products launched by major cloud manufacturers are mostly based on private signaling protocol and streaming media transmission protocol , As a result, various manufacturers cannot be interconnected , It limits the large-scale development of low delay live broadcast . Netease Yunxin is exploring a standardized low latency live broadcast scheme , Launch open source low latency player , Open signaling and media protocols , Make a set of low delay players SDK It can connect with multiple low delay live broadcast manufacturers , And can be customized freely , It aims to promote the development of the whole low delay live broadcasting industry .

This sharing mainly introduces how to base on WebRTC Build a low latency player , And Yunxin on the open source low latency player for WebRTC Do some optimization , Finally, look forward to the optimization direction of open source low delay player in the future .

Bitmovin 2021 Video developer report , Low latency live broadcasting is considered to be the biggest challenge in the current industry , Supporting low latency is VLC 4.0 A major update of . The realization of low delay live broadcast depends on the optimization of the whole link , Including code acquisition 、 Uplink transmission 、 Background processing 、 Downlink distribution 、 Playback control, etc . Introduce the difficulties faced by the whole link in the system 、 After some optimization work of industry solutions and Tencent video cloud , In depth analysis VLC How does the player achieve low latency playback .

Gstreamer As a popular open source multimedia framework , Its excellent architecture makes it highly modular and good scalability , And it has a wide application prospect . In a broad sense , Not just media streaming ,Gstreamer You can extend and handle any kind of data stream . stay AI Time , With, for example DeepStream, DLStreamer etc. AI The introduction of plug-ins , Gstreamer It will be more and more used in set encoding and decoding ,AI, Rendering is an integrated application scene .

This sharing will be roughly divided into three parts , First, we will introduce Gstreamer Framework and characteristics of , Then the modular video processing and hardware acceleration are studied , Some typical application examples are discussed , Finally, share some personal development experience and development trends and hotspots of the open source community .

AI The transcoding process of reasoning and graphics has attracted more and more attention in the data center , The industry has also deployed applications such as virtual anchors and cloud effects . At present, most of the schemes adopted in the industry will render and transform graphics AI Reasoning and transcoding separation , A task requires multiple pipelines of multiple teams to complete . In addition to reasoning and graphics , Many traditional image processing also lack transcoding oriented GPU programme .

FFmpeg As a transcoding platform widely used in the industry , It provides rich and efficient video processing capabilities , This sharing session will introduce how to FFmpeg Develop one that contains AI Reasoning + Integrity of graphics GPU Transcoding pipeline , Introduce the development experience to you with specific project examples , And discuss how to analyze the performance test data .

 

---

In the scan QR code Or click on Read the original

Learn more about the conference

If you like our content, just order “ Looking at ” Well ！

This article is from WeChat official account. - LiveVideoStack（livevideostack）.
If there is any infringement , Please contact the [email protected] Delete .
Participation of this paper “OSC Source creation plan ”, You are welcome to join us , share .