摘要
虽然高质量高分辨率的深度图能够显著地提高各种自然场景计算机视觉任务的性能,但是深度相机硬件的限制使得消费级深度相机拍摄到的深度图存在分辨率低、质量差和无效空洞等问题。深度图超分辨率重建(depth super-resolution reconstruction,DSR)是一种能有效提高深度图分辨率和质量的技术,并且DSR已经成为计算机视觉领域的研究热点。首先将介绍DSR的定义和近几年国内外DSR算法的研究进展,然后对深度学习DSR重建算法进行重点阐述与分析。接下来,将介绍深度图像质量评估准则。最后,对DSR的应用领域和未来所面对的挑战和机遇进行展望。
Although high-quality and high-resolution depth maps can significantly improve the performance of computer vision tasks in various natural scenes,the limitations of depth camera hardware make the depth maps captured by consumer-level depth cameras have problems such as low resolution,poor quality,invalid holes,etc.Depth super-resolution reconstruction(DSR)is a kind of technology that can effectively improve the resolution and quality of depth maps,and DSR has become a research hot-spot in the field of computer vision.Firstly,this paper introduced the definition of DSR and the research progress of DSR algorithm at home and abroad in recent years,and then mainly stated and analyzed deep learning DSR reconstruction algorithms.Next,it introduced the depth image quality evaluation criteria.Finally,this paper prospected the application fields of DSR and the challenges as well as the opportunities in the future.
作者
赵利军
王可
张晋京
张加龙
王安红
Zhao Lijun;Wang Ke;Zhang Jinjing;Zhang Jialong;Wang Anhong(College of Electronic Information Engineering,Taiyuan University of Science&Technology,Taiyuan 030024,China;College of Big Science&Technology,North University of China,Taiyuan 030051,China)
出处
《计算机应用研究》
CSCD
北大核心
2023年第6期1621-1628,1640,共9页
Application Research of Computers
基金
国家自然科学基金青年基金资助项目(62202323)
国家自然科学基金资助项目(62072325)
山西省基础研究计划资助项目(202103021223284)
太原科技大学博士科研启动基金资助项目(20192023)
来晋工作优秀博士奖励资金资助项目(20192055)。
关键词
超分辨率重建
深度学习
卷积神经网络
深度图
super-resolution reconstruction
deep learning
convolutional neural network
depth map
