摘要
近年来,随着全景内容获取和交互的软硬件技术的快速发展,全景图像视频的数量激增,如何对全景内容进行高质量地分析和处理越来越成为虚拟现实领域的研究热点。当前,全景内容分析和处理在理论和应用方面面临着巨大挑战,关于该领域的关键问题在已有文献中未见系统全面地总结和研究。为了更好地促进该领域的研究和应用推广,针对全景图像视频的场景分析与内容处理近期的主要工作进行综述。在全景场景分析方面,分析了全景图像视频的深度学习网络、深度恢复、重要性检测、目标检测的研究工作;在全景内容处理方面,分析了全景图像视频的交互式浏览、去抖和校正、内容编辑的研究工作。最后,对综述进行了总结,并展望了未来在立体视图下全景图像视频的场景分析与内容处理方面的研究趋势。
In recent years,the rapid development of software and hardware technologies for acquiring and interacting with panoramic content has led to a significant increase in the number of panoramic images and videos.Immersive media with 360-degree panoramic images and videos as the main content has been widely used in the field of virtual reality and enhancement implementation.Compared with traditional 2D images and videos,panoramic images and videos can provide users with a new immersive experience.With wearable devices,users can freely watch the content from all perspectives through head movement.At present,the number of panoramic images and videos has soared,but it is usually difficult to obtain satisfactory panoramic images and videos,due to the difficulty in obtaining panoramic content and the lack of effective editing tools.Therefore,analyzing and processing panoramic content with high quality has become an increasingly important research topic in the field of virtual reality.However,both in theory and application,the analysis and processing of panoramic content face significant challenges.Despite this,there is a lack of systematic and comprehensive summaries and research on the key issues in this field in existing literature.In order to better promote research and application in this area,a survey was provided on the recent works of scene analysis and content processing of panoramic images and videos.In terms of panoramic scene analysis,this survey reviewed the research on depth learning networks,depth recovery,importance detection,and target detection for panoramic images and videos.In terms of panoramic content processing,the survey analyzed the research on interactive browsing,stabilization and correction,and content editing of panoramic image video.Finally,the overview was summarized,with an outlook on future research trends in scene analysis and content processing of panoramic images and videos under the stereo view.
作者
谢红霞
胡毓宁
张赟
王亚奇
杜辉
秦爱红
XIE Hong-xia;HU Yu-ning;ZHANG Yun;WANG Ya-qi;DU Hui;QIN Ai-hong(School of Computer&Computing Science,Hangzhou City University,Hangzhou Zhejiang 310015,China;College of Media Engineering,Communication University of Zhejiang,Hangzhou Zhejiang 310018,China)
出处
《图学学报》
CSCD
北大核心
2023年第4期640-657,共18页
Journal of Graphics
基金
浙江省基础公益研究计划项目(LGG22F020009,LGF21F020002,LGF22F020015)
国家自然科学基金项目(62206242)
浙江省影视媒体技术研究重点实验室开放课题(2020E10015)
浙江传媒学院2021年第十六批教学改革项目(jgxm202131)。
关键词
虚拟现实
全景图像视频
场景分析
内容处理
立体视图
virtual reality
panoramic images and videos
scene analysis
content processing
stereoscopic views
