摘要
近年来,红外成像系统在工业、安防、遥感等领域获得了广泛的应用,但由于制造工艺及成本制约,红外系统的分辨率仍然较低。基于深度神经网络的单帧图像超分辨率重建技术是提高红外图像分辨率的有效方法,获得了广泛研究,并在仿真图像上取得了显著进展,但应用于实际场景图像时容易出现伪影或图像模糊等现象。造成这种性能差异的主要原因是目前方法大多假定造成图像退化的模糊核是空间一致的,然而实际红外光学系统不可避免地存在像差、热离焦等,由此造成的图像模糊的模糊核并非空间一致的。针对这一问题,提出了一种非盲模糊核估计方法,通过采集特定的靶标图像,并设计模糊核估计网络,求解空间非一致模糊核;设计基于图像分块的超分辨率重建方法,将图像块和对应区域的模糊核一起输入非盲超分辨率重建网络进行子块图像重建,再通过子块合并和重叠区域图像融合,得到最终的高分辨率图像。实验结果表明,光学系统自身引起了模糊核随空间位置缓慢变化,在实验室条件下标定模糊核并基于图像分块进行超分辨率重建的方法可显著提高红外图像超分辨率重建的效果。
Objective In recent years,infrared imaging systems have been increasingly used in industry,security,and remote sensing.However,the resolution of infrared devices is still quite limited due to its cost and manufacturing technology restrictions.To increase image resolution,deep learning-based single image super-resolution(SISR)has gained much interest and made significant progress in simulated images.However,when applied to real-world images,most approaches suffer a performance drop,such as over-sharpening or over-smoothing.The main reason is that these methods assume that blur kernels are spatially invariant across the whole image.But such an assumption is rarely applicable for infrared images,whose blur kernels are usually spatially variant due to factors such as lens aberrations and thermal defocus.To address this issue,a blur kernel calibration method is proposed to estimate spatially-variant blur kernels,and a patch-based super-resolution(SR)algorithm is designed to reconstruct super-resolution images.Methods Parallel light tube and motorized rotating platform are used to establish target image acquisition environment,and then images of multi-circle target at different positions are gathered(Fig.1).Based on sub-pixel accurate circle center detection,the camera pose parameters are solved,and high-resolution target images are synthesized according to the parameters.High-resolution and low-resolution target image pairs are fed into the blur kernel estimation network to obtain accurate blur kernels(Fig.3).In addition,a patch-based super-resolution algorithm is designed,which decomposes the test image into overlapping patches,reconstructs each of them separately using estimated kernels,and finally merges them according to Euclidean distances(Fig.4).Results and Discussions The experimental results show that the blur caused by the optical system is not negligible and varies slowly with spatial position(Fig.6).The proposed method,which calibrates blur kernels in a laboratory setting,can obtain a more accurate blur ker
作者
曹军峰
丁庆海
罗海波
Cao Junfeng;Ding Qinghai;Luo Haibo(Key Laboratory of Opto-Electronic Information Processing,Chinese Academy of Sciences,Shenyang 110016,China;Shenyang Institute of Automation,Chinese Academy of Sciences,Shenyang 110016,China;Institutes for Robotics and Intelligent Manufacturing,Chinese Academy of Sciences,Shenyang 110169,China;University of Chinese Academy of Sciences,Beijing 100049,China;Space Star Technology Co.,Ltd.,Beijing 100086,China)
出处
《红外与激光工程》
EI
CSCD
北大核心
2024年第2期217-226,共10页
Infrared and Laser Engineering
关键词
超分辨率重建
空间非一致模糊
模糊核估计
红外图像
super-resolution reconstruction
spatially variant blur
blur kernel estimation
infrared image
