摘要
本文将视觉信息和听觉信息相互影响并共同作用于人的现象称为视听觉融合效应,并且针对该效应提出了以信息融合处理为核心的研究方法。首先,本文由日常生活中的普遍现象发现视听觉融合效应。其次,在研究和评判相关领域研究现状的基础上,本文明确了视听觉融合效应的研究对象及其基本概念。再次,以总体研究框架为依据,本文给出了研究视听觉融合效应的研究方法与技术路线,并对其可行性进行了论证。接着,本文分析了视听觉融合效应的研究重点与难点。最后,本文展望了视听觉融合效应及其信息融合处理的广阔的应用前景。
This paper calls the phenomenon,whichis visual information and auditory information interact and act on each other,visual and auditory fusion effect,and puts forward the method with a core idea of information fusion processing.Firstly,audio-visual fusion effect was found from common phenomena in daily life.Secondly,on the basis of studying and judging the researches of related fields,this paper clarified the research objects and basic concepts of audio-visual fusion effect.Thirdly,on the basis of the overall research framework,this paper presented the research method and technical route of audio-visual fusion effect,and demonstrated its feasibility.Then,this paper analyzed the focus and difficulties of the fusion effect.Finally,this paper looked forward to the broad application prospect of audio-visual fusion effect and its information fusion processing.
作者
蒋伟
王爽
蒋玉暕
刘京宇
JIANG Wei;WANG Shuang;JIANG Yu-jian;LIU Jing-yu(Key Laboratory of Acoustic Visual Technology and Intelligent Control System(Communication University of China),Ministry of Culture and Tourism;Beijing Key Laboratory of Modern Entertainment Technology(Communication University of China;School of Information and Communication Engineering,Communication University of China)
出处
《中国传媒大学学报（自然科学版）》
2019年第6期6-11,49,共7页
Journal of Communication University of China：Science and Technology
基金
文化和旅游部重点实验室项目(LB-ZDSYS-2019-06)
中央高校基本科研业务费专项规划项目(CUC19ZD005)
关键词
视听觉融合效应
信息融合处理
机器学习
主观评价实验
感知特征
audio-visual fusion effect
information fusion processing
machine learning
subjective evaluation experiment
perceptive feature
