目的受成像距离、光照条件、动态模糊等因素影响,监控系统拍摄的车牌图像往往并不具备较高的可辨识度。为改善成像质量,提升对车牌的识别能力,提出一种基于亮度与梯度联合约束的车牌图像超分辨率重建方法。方法首先充分结合亮度约束和...目的受成像距离、光照条件、动态模糊等因素影响,监控系统拍摄的车牌图像往往并不具备较高的可辨识度。为改善成像质量,提升对车牌的识别能力,提出一种基于亮度与梯度联合约束的车牌图像超分辨率重建方法。方法首先充分结合亮度约束和梯度约束的优势,实现对运动位移和模糊函数的精确估计;为抑制重建图像中的噪声与伪影,基于车牌图像的文字化特征,进一步确定了亮度与梯度联合约束的图像先验模型。结果为验证该方法的有效性,利用监控系统获得4组车牌图像,分别进行模拟和真实的超分辨率重建实验。在模拟实验中将联合约束图像先验重建结果与拉普拉斯、Huber-Markov(HMRF)以及总变分(TV)先验的处理结果进行对比,联合约束先验对车牌纹理信息的恢复效果优于其他3种常见图像先验;同时,在模拟和真实实验中,将本文算法与双三次插值、传统最大后验概率、非线性扩散正则化和自适应范数正则化方法的超分辨率重建结果进行比较,模拟实验的结果表明,在不添加噪声情况下,该算法峰值信噪比(PSNR)和结构相似性(SSIM)指标分别为35.326 d B和0.958,优于其他4种算法;该算法在真实实验中,能够有效增强车牌图像纹理信息,获得较优的视觉效果,通过对重建车牌图像的字符识别精度比较,本文算法重建结果的识别精度远高于其他3种算法,平均字符差距为1.3。结论模拟和真实图像序列的实验结果证明,基于亮度—梯度联合约束的超分辨率重建方法,能够降低运动和模糊等参数的估计误差,有效减少图像中存在的模糊和噪声,提高车牌的识别精度。该算法广泛适用于因光照变化、相对运动等因素影响下的低质量车牌图像超分辨率重建。展开更多
Background For static scenes with multiple depth layers,existing defocused image deblurring methods have the problems of edge-ringing artifacts or insufficient deblurring owing to inaccurate estimation of the blur amo...Background For static scenes with multiple depth layers,existing defocused image deblurring methods have the problems of edge-ringing artifacts or insufficient deblurring owing to inaccurate estimation of the blur amount,and prior knowledge in nonblind deconvolution is not strong,which leads to image detail recovery challenges.Methods To this end,this study proposes a blur map estimation method for defocused images based on the gradient difference of the boundary neighborhood,which uses the gradient difference of the boundary neighborhood to accurately obtain the amount of blurring,thereby preventing boundary ringing artifacts.The obtained blur map is then used for blur detection to determine whether the image needs to be deblurred,thereby improving the efficiency of deblurring without manual intervention and judgment.Finally,a nonblind deconvolution algorithm was designed to achieve image deblurring based on the blur amount selection strategy and sparse prior.Results Experimental results showed that our method improves PSNR(Peak Signal-to-Noise Ratio)and SSIM(Structural Similarity Index)by an average of 4.6%and 7.3%,respectively,compared to existing methods.Conclusions Experimental results showed that the proposed method outperforms existing methods.Compared to existing methods,our method can better solve the problems of boundary ringing artifacts and detail information preservation in defocused image deblurring.展开更多
文摘目的受成像距离、光照条件、动态模糊等因素影响,监控系统拍摄的车牌图像往往并不具备较高的可辨识度。为改善成像质量,提升对车牌的识别能力,提出一种基于亮度与梯度联合约束的车牌图像超分辨率重建方法。方法首先充分结合亮度约束和梯度约束的优势,实现对运动位移和模糊函数的精确估计;为抑制重建图像中的噪声与伪影,基于车牌图像的文字化特征,进一步确定了亮度与梯度联合约束的图像先验模型。结果为验证该方法的有效性,利用监控系统获得4组车牌图像,分别进行模拟和真实的超分辨率重建实验。在模拟实验中将联合约束图像先验重建结果与拉普拉斯、Huber-Markov(HMRF)以及总变分(TV)先验的处理结果进行对比,联合约束先验对车牌纹理信息的恢复效果优于其他3种常见图像先验;同时,在模拟和真实实验中,将本文算法与双三次插值、传统最大后验概率、非线性扩散正则化和自适应范数正则化方法的超分辨率重建结果进行比较,模拟实验的结果表明,在不添加噪声情况下,该算法峰值信噪比(PSNR)和结构相似性(SSIM)指标分别为35.326 d B和0.958,优于其他4种算法;该算法在真实实验中,能够有效增强车牌图像纹理信息,获得较优的视觉效果,通过对重建车牌图像的字符识别精度比较,本文算法重建结果的识别精度远高于其他3种算法,平均字符差距为1.3。结论模拟和真实图像序列的实验结果证明,基于亮度—梯度联合约束的超分辨率重建方法,能够降低运动和模糊等参数的估计误差,有效减少图像中存在的模糊和噪声,提高车牌的识别精度。该算法广泛适用于因光照变化、相对运动等因素影响下的低质量车牌图像超分辨率重建。
基金Supported by the National Natural Science Foundation of China (62172190)the“Double Creation”Plan of Jiangsu Province (JSSCRC2021532)the“Taihu Talent-Innovative Leading Talent”Plan of Wuxi City (Certificate Date:202110)。
文摘Background For static scenes with multiple depth layers,existing defocused image deblurring methods have the problems of edge-ringing artifacts or insufficient deblurring owing to inaccurate estimation of the blur amount,and prior knowledge in nonblind deconvolution is not strong,which leads to image detail recovery challenges.Methods To this end,this study proposes a blur map estimation method for defocused images based on the gradient difference of the boundary neighborhood,which uses the gradient difference of the boundary neighborhood to accurately obtain the amount of blurring,thereby preventing boundary ringing artifacts.The obtained blur map is then used for blur detection to determine whether the image needs to be deblurred,thereby improving the efficiency of deblurring without manual intervention and judgment.Finally,a nonblind deconvolution algorithm was designed to achieve image deblurring based on the blur amount selection strategy and sparse prior.Results Experimental results showed that our method improves PSNR(Peak Signal-to-Noise Ratio)and SSIM(Structural Similarity Index)by an average of 4.6%and 7.3%,respectively,compared to existing methods.Conclusions Experimental results showed that the proposed method outperforms existing methods.Compared to existing methods,our method can better solve the problems of boundary ringing artifacts and detail information preservation in defocused image deblurring.