Here comes the CV overview of target detection, visual weakly supervised learning, brain multimodal imaging technology and so on! Image graphics development annual report review special issue!

preface

In recent years, the development momentum of image and graphics technology is strong , Theoretical innovation and technological innovation are emerging one after another , The application scope and field are becoming larger and larger , Is leading us into a more intelligent future . In order to better promote the development of image graphics , The Chinese society of image graphics has established a discipline development report system , Every year, it is written by relevant professional committees organized by the advisory and evaluation Working Committee of China graphics society 《 Annual report on the development of image graphics 》, The development status of each important research direction of image graphics is systematically analyzed 、 Frontier trends 、 Hot issues and development trends , Provide reference and consultation for government decision-making and project initiation , At the same time, it also provides scientific and technological workers in the field of image graphics with a quick understanding of the research progress in the field of image graphics . In order to further promote the development and application of image graphics technology in China 、 Better serve the scientific and technological workers in the field of image and graphics , take 2021 year 《 Annual report on the development of image graphics 》 After modification and simplification, it is available in 《 Chinese Journal of image graphics 》 Published in this special issue . 

2021 Annual 《 Annual report on the development of image graphics 》 The essay solicitation received a warm response from the professional committees of the society . Each professional committee actively organizes a strong team of experts , Carefully selected topics and wrote the annual report on the development of various important research directions of image graphics . Subject selection review 、 Report review, Journal Review and other strict peer review , this 《 Annual report on the development of image graphics 》 The special issue contains annual reports 15 piece , Include Annual report on visual understanding and computational imaging 8 piece , Annual report on data mining and information interaction 7 piece .

......

This special issue 15 This annual report covers a wide range of contents 、 The summary of the research status at home and abroad and the analysis of the development trend are in-depth and comprehensive 、 Writing specifications , It reflects the overlapping of the research team 、 The breadth of research topics and the cutting edge of research results . We look forward to readers and scientific and technological personnel passing this issue 《 Annual report on the development of image graphics 》 Special issue , Be able to have a broad and in-depth understanding of the latest technologies and cutting-edge application directions in the current image and graphics research field , In the future research work, we will grasp the international frontier more comprehensively , More clearly targeted , Make new contributions to the development of image and graphics technology in China .

President of the Chinese society of image graphics

Wang Yaonan academician

 

Visual understanding and computational imaging

01 Overview of visual target detection technology based on deep learning

This paper introduces the basic process of deep target detection in the process of training and testing , This paper systematically summarizes and analyzes the research progress of visual object detection methods based on monocular and binocular cameras at home and abroad , The development and evolution direction of visual object detection technology are prospected .

 

thank ： This paper is organized and written by the video image and Security Professional Committee of the Chinese society of image graphics , For more details of the special committee, please see the link ：

http://www.csig.org.cn/detail/2448.

Citation format ： Cao Jiale , Li Yali , Sun Hanqing , Xie Jin , Huang Kaiqi , Pang Yanwei . 2022. Overview of visual target detection technology based on deep learning . Chinese Journal of image graphics , 27(6): 1697-1722.

[DOI: 10.11834/jig.220069]

 

02 Human visual understanding technology for complex scenes

This paper focuses on the visual understanding of characters 、 Individual behavior analysis and group interaction understanding 、 Key technologies such as emotion recognition and synthesis , The research hotspots in the field of human visual understanding in complex scenes are summarized 、 Application scenarios and related research progress at home and abroad , It also looks forward to the frontier technology and development trend in this field .

thank ： This article is organized and written by the animation and Digital Entertainment Professional Committee of China Graphics Society , For more details of the special committee, please see the link ：

http://www.csig.org.cn/detail/2387.

 

Citation format ： Malizhuang , Wu Fei , Mao Qirong , Wangpengjie , Chenyulong . 2022. Human visual understanding technology for complex scenes . Chinese Journal of image graphics , 27(6): 1723-1742. 

[DOI: 10.11834/jig.220157]

 

03 Intelligent traffic oriented image processing and edge computing

This paper starts with the development of intelligent transportation system , Focus on image processing and edge computing technology for intelligent transportation , The research hotspots and frontier progress are described , Summarize and compare relevant academic and industrial achievements at home and abroad , The future development of image processing and edge computing technology in intelligent transportation system is summarized, analyzed and the trend is prospected .

thank ： This paper is organized and written by the image and video communication special committee of the Chinese society of image graphics , For more details of the special committee, please see the link ：

http://www.csig.org.cn/detail/2383.

 

Citation format ： Caoxingjian , Zhangzhitao , Sunyanzan , Wang Ping , Xu Shugong , Liu Fuqiang , Wang Chao , Peng Fei , Mushiyi , Liu Wenyu , Yang Yu . 2022. Intelligent traffic oriented image processing and edge computing . Chinese Journal of image graphics , 27(6): 1743-1767.

[DOI: 10.11834/jig.211266]

 

04 Research progress of visual weak supervised learning

This paper focuses on visual weak supervised learning , Detect with objects 、 Taking semantic and instance segmentation and action recognition as examples, this paper summarizes the research progress at home and abroad , The feasibility of various forms of weak supervision in practical application is discussed , And its development direction 、 The application prospects and challenges are analyzed .

thank ： This paper is organized and written by the machine vision special committee of the Chinese society of image graphics , For more details of the special committee, please see the link ：

http://www.csig.org.cn/detail/2386.

 

Citation format ： Ren Dongwei , Wang Qilong , Weiyunchao , Meng Deyu , Zuo Wangmeng . 2022. Research progress of visual weak supervised learning . Chinese Journal of image graphics , 27(6): 1768-1798.

[DOI: 10.11834/jig.220178]

 

05 Intelligent remote sensing ：AI Enabling remote sensing technology

This paper takes the whole observation of the observation object in the process of remote sensing data transformation 、 Analysis and interpretation and law mining are the main line , Through comprehensive domestic and foreign literature and relevant reports , This paper combs the application of remote sensing data precise processing in this field 、 Spatiotemporal processing and analysis of remote sensing data 、 Classification and recognition of remote sensing target elements 、 Research status and progress in remote sensing data association mining, remote sensing open source data sets and sharing platforms .

thank ： This paper is organized and written by the remote sensing image professional committee of the Chinese society of image graphics , For more details of the special committee, please see the link ：

http://www.csig.org.cn/detail/2446.

 

Citation format ： Sun Xian , Meng Yu , Diaowenhui , Huanglijia , Zhang Xin , Luojiancheng , Gaolianru , Wangpeijin , Yanzhiyuan , Gaolijing , Dong Wen , Fengyingchao , Lijihao , Fu Kun . 2022. Intelligent remote sensing ：AI Enabling remote sensing technology . Chinese Journal of image graphics , 27(6): 1799-1822.

[DOI: 10.11834/jig.220161]

 

06 Research progress of impulse vision

This paper starts from the biological basis and physical principle of visual information expressed by pulse vision model , The software simulator of pulse vision principle and the calculation process of simulating photon propagation in the real world are analyzed , The working mechanism and structure design of high sensitive photoelectric sensor and chip based on pulse vision principle are described 、 The principle of image reconstruction based on impulse vision and the algorithm and system of computing camera based on the fusion of impulse vision signal and ordinary image signal , The detection of ultra-high speed moving target based on pulse neural network is introduced 、 Tracking and identification , By comparing the relevant research contents and development status at home and abroad , The development and evolution of impulse vision are prospected .

thank ： This paper is organized and written by the Special Committee on brain vision of the Chinese society of image graphics , For more details of the special committee, please see the link ：

http://www.csig.org.cn/detail/3185.

 

Citation format ： Huang Tiejun , Yuzhaofei , Li Yuan , Shi Baixin , Xiongruiqin , Marley , Wang Wei . 2022. Research progress of impulse vision . Chinese Journal of image graphics , 27(6): 1823-1839. 

[DOI: 10.11834/jig.220175]

 

07 Advances in computational imaging frontier

This paper presents a new design method based on computational imaging 、 New algorithms and application scenarios are the main line , Joint design of end-to-end optical algorithms 、 High dynamic range imaging 、 Light field imaging 、 Spectral imaging 、 Lensless imaging 、 Low illumination imaging 、 Three dimensional imaging 、 Computational photography, etc , This paper focuses on the development of computational imaging 、 Frontier trends 、 Hot issues and trends .

thank ： This paper is organized and written by the three-dimensional vision Professional Committee of the Chinese society of image graphics , For more details of the special committee, please see the link ：

http://www.csig.org.cn/detail/2696.

 

Citation format ： Dunxiong , Fu Qiang , Li Haotian , Suntiancheng , Wang Jian , Sunqilin . 2022. Advances in computational imaging frontier . Chinese Journal of image graphics , 27(6): 1840-1876. 

[DOI: 10.11834/jig.220061]

 

08 A survey of mobile online real-time rendering technology

This paper takes on-line real-time rendering technology as the starting point , The application of this technology in mobile terminal is discussed 、Web End 、 Cloud 、 The development focus and research status of multi terminal collaboration under four types of platforms , And the implementation scheme of industrial online cloud platform is deeply expounded . In data mining and information interaction ：《 Research progress of table recognition technology 》 Area detection around the table 、 Table structure recognition and table content recognition are three table recognition subtasks , From the traditional method 、 Deep learning methods, etc , The development history and the latest progress in this field at home and abroad are summarized , At the same time, the future trends and technological development goals are prospected .

thank ： This paper is organized and written by the virtual reality Professional Committee of the Chinese society of image graphics , For more details of the special committee, please see the link ：

http://www.csig.org.cn/detail/2385.

 

Citation format ： Liu Chang , Huoyuchi , Zhang Yanci , Zhang Qian , Zhengjiaxiang , Tang Rui , Yu Geng , Wang Rui , Jia Jinyuan . 2022. A survey of mobile online real-time rendering technology . Chinese Journal of image graphics , 27(6): 1877-1897. 

[DOI: 10.11834/jig.220177]

 

Data mining and information interaction
09 Research progress of table recognition technology

This paper focuses on the region detection of tables 、 Table structure recognition and table content recognition are three table recognition subtasks , From the traditional method 、 Deep learning methods, etc , The development history and the latest progress in this field at home and abroad are summarized , At the same time, the future trends and technological development goals are prospected .

thank ： This paper is organized and written by the professional committee of document image analysis and recognition of China image graphics society , For more details of the special committee, please see the link ：

http://www.csig.org.cn/detail/2551.

 

Citation format ： High yangjae , Li Yibo , Turin , Zhang Xinpeng , Zhuziyi , Lu Ning , Jin Lianwen , Huangyongshuai , Tang Zhi . 2022. Research progress of table recognition technology . Chinese Journal of image graphics , 27(6): 1898-1917.

[DOI: 10.11834/jig.220152]

 

10 Advances in multimedia steganography

This paper focuses on steganography 、 Image steganography 、 Video steganography 、 Audio steganography 、 Five aspects of text steganography , The development of steganography at home and abroad is systematically described , The limitations of the existing steganography technologies and the challenges and trends in the future are summarized .

thank ： This paper is organized and written by the digital media forensics and Security Committee of the Chinese image graphics society , For more details of the special committee, please see the link ：

http://www.csig.org.cn/detail/2450.

 

Citation format ： Zhang Weiming , Wanghongxia , Li Bin , Renyanzhen , Yangzhongliang , Chenkejiang , Liweixiang , Zhang Xinpeng , Yunenghai . 2022. Advances in multimedia steganography . Chinese Journal of image graphics , 27(6): 1918-1943. 

[DOI: 10.11834/jig.211272]

 

11 Progress in quantitative research of brain multimodal imaging technology

This paper focuses on the establishment of quantitative model 、 Quantitative parameter measurement and imaging method 、 Influencing factors in measurement 、 And application cases of related technologies , This paper summarizes and discusses the development of quantitative imaging technology for the detection targets of human brain microstructure and physiological function indexes 、 The existing key technical problems and possible future development direction .

thank ： This paper is organized and written by the medical imaging professional committee of the Chinese society of image graphics , For more details of the special committee, please see the link ：

http://www.csig.org.cn/detail/2388.

 

Citation format ： Yehuihui , Hehongjian , Fang jingwan , Tong Qiqi , Zhou Zihan , Liuhuafeng . 2022. Progress in quantitative research of brain multimodal imaging technology . Chinese Journal of image graphics , 27(6): 1944-1955.

[DOI: 10.11834/jig.220153]

 

12 Overview of multimodal human-computer interaction

This paper systematically summarizes the development status and emerging direction of multimodal human-computer interaction , In depth combed the big data visual interaction 、 Interaction based on sound field perception 、 Mixed reality physical interaction 、 Research progress of Wearable Interaction and human-computer interaction at home and abroad .

thank ： This paper is organized and written by the human computer interaction Professional Committee of the Chinese society of image graphics , For more details of the special committee, please see the link ：

http://www.csig.org.cn/detail/2490.

 

Citation format ： Tao Jianhua , Wu Yingcai , Yu Chun , Weng Dongdong , Liguanjun , Hanteng , Wangyuntao , Liu Bin . 2022. Overview of multimodal human-computer interaction . Chinese Journal of image graphics , 27(6): 1956-1987. 

[DOI: 10.11834/jig.220151]

 

13 Research Progress on Key Technologies of cultural heritage activation

This paper is based on advanced intelligent computing 、 Digital media 、 Virtual reality / Augmented reality , Combined with the dissemination process of cultural heritage and artistic characteristics , This paper analyzes and summarizes the understanding of cultural heritage collection 、 Virtual reality combined with intelligent display interaction 、 Development status of activation key technologies such as intelligent platform construction 、 Frontier trends 、 Hot issues and development trends .

thank ： This paper is organized and written by the digital cultural heritage Professional Committee of the Chinese society of image graphics , For more details of the special committee, please see the link ：

http://www.csig.org.cn/detail/2987.

 

Citation format ： Geng Guohua , Hexuelei , Wang Meili , Li Kang , Hexiaowei . 2022. Research Progress on Key Technologies of cultural heritage activation . Chinese Journal of image graphics , 27(6): 1988-2007. 

[DOI: 10.11834/jig.220198]

 

14 An overview of the development of affective computing and understanding

This paper reviews the multimodal emotion recognition 、 Autism emotion recognition 、 The research progress of emotion image content analysis, facial expression recognition and other different emotion computing and understanding directions in the past few decades, and the development trend in the future .

thank ： This paper is organized and written by the professional committee of emotional computing and understanding of Chinese image graphics society , For more details of the special committee, please see the link ：

http://www.csig.org.cn/detail/3186.

 

Citation format ： Yao Hongxun , Deng Weihong , Liu Honghai , Hong Xiaopeng , Wangsujing , Yang Jufeng , Zhao Sicheng . 2022. An overview of the development of affective computing and understanding . Chinese Journal of image graphics , 27(6): 2008-2035. 

[DOI: 10.11834/jig.220085]

 

15 Progress in data fusion of cross modal brain atlas

This paper focuses on two representative cross modal brain atlas fusion technologies: brain image fusion and brain data fusion , This paper expounds and compares the research and development status at home and abroad 、 Existing key technical problems and future development trends .

thank ： This paper is organized and written by the brain atlas Professional Committee of the Chinese society of image graphics . For more details of the special committee, please see the link ：

http://www.csig.org.cn/detail/2847.

 

Citation format ： Lorna , Song Ming , Yang Zhengyi , Jiang tianzai . 2022. Progress in data fusion of cross modal brain atlas . Chinese Journal of image graphics , 27(6): 2036-2056. 

[DOI: 10.11834/jig.220036]