A solution for building live video based on open source real-time audio and video webrtc architecture

With the rapid development of mobile Internet technology ,5G The rise of the Internet , Mobile phones and other hardware configurations are getting higher and higher , Low delay network audio and video are also more and more close to people's lives , In Teaching 、 meeting 、 Online medicine 、 Recruitment 、 There is a growing demand for live videos such as making friends .

At present, the market is based on WebRTC The architecture of audio and video live broadcasting is not perfect , Such as ：

1） The delay in live technology is very large , From the audience's comments to the host's feedback, it usually takes more than ten seconds ; 2） All kinds of video APP Various , The interface is complex , Not suitable for access ; 3） The interoperability of live video broadcasting for all walks of life is poor , The compatibility of various protocols is not enough ; 4） Expandability of , The secondary development of integrated live broadcast system is difficult , Can't expand the extension function flexibly .

And live video is different according to the needs of the industry , There will be differences in requirements , for example ：

1） The anchor side of product live broadcast usually starts broadcasting on the web side , Because there are a lot of live rooms on the web 、 The screen is quite large 、 The video is clear 、 The ability to deal with it is quite strong , It's beyond the reach of other devices ; 2） The teacher side of online education is generally in PC On , If you want to install an application , Some teachers don't know much about computer technology , It's troublesome to configure it ; 3） And finally, video conferencing , If you've ever used a browser video conference in the company, you'll have an experience ,HR Send a link , At some point in time, you click this link , In addition, there are some explanations , What are you going to install , This will be more complicated .

So to meet the low delay 、 It's easy to install 、 High compatibility 、 The audio and video communication system with high industry interoperability is a problem that must be solved in the development of the live broadcast industry , At present, the research and development of Qingxi video is based on WebRTC Developed EasyRTC It has basically met the needs of the modern live broadcasting industry .

EasyRTC Have MCU and SFU Two structures , No need to install clients and plug-ins , pure H5 Online video conference system , Support wechat applet 、H5 page 、APP、PC Interworking between client and other access methods , It can quickly build real-time audio and video communication from scratch ; Support video calls from multiple to one million people , Meet voice and video social . Through this scheme, we can quickly build a real-time audio and video communication platform from scratch , Applied to online education and training 、 Video conferencing, telemedicine, etc .

1） The client uses mobile phones 、 Computers and other terminal devices , towards EasyRTC Push data streams ; 2）EasyRTC Video conferencing cloud services through noise reduction 、 increase 、 Echo cancellation and other means of processing received data stream , Then push it to users of other terminals ; 3） client （Windows、Android、iOS、H5） receive EasyRTC The data coming out , To complete a video call .

from EasyRTC The live broadcast scheme of audio and video conference system has the following advantages ：

1） No delay experience ： The traditional live broadcast of 3 second ~20 Second delay , Down to 800 Milliseconds up and down , Delay is almost imperceptible , Greatly optimized the live interactive experience . 2） High concurrency ：RTC The protocol has been skillfully applied to small class interaction 、 Video conference, etc , But there is not enough support for the large-scale live broadcast of high-speed parallel broadcasting , Leading to instability . and PRTC Perfect solution to this phenomenon . 3） High interoperability ： Relying on multiple integration CDN Strong coverage , Global access , Cross border, cross operator transmission , Provide global audio and video communication services , The industry is highly interconnected . 4） Anti weak network ： Access live through the nearest access point around the world 、 Based on HTTP DNS Self developed scheduling algorithm 、 Packet loss retransmission , Realize the weak network high quality communication ,70% Packet loss can still communicate normally . 5） Multiple modes of live broadcasting ： Support voice call , Support one-to-one 、 Multi party video call , Support a couple of Dorians . 6） Low cost ： application PRTC, Just need to pay more than ordinary RTC Half the cost , You can experience without delay 、 High concurrent interactive live broadcast , It's easier for businesses to bear .

be based on EasyRTC Real time audio and video live program , In the next upgrade point, we will focus on the protocol compatibility between different manufacturers 、 High definition image quality and low latency .