摘要
通过分析和研究视频内容特征、编解码失真特征和传输时延特征对视频质量评价的影响,结合人眼视觉特性及其数学模型,提出了一种综合考虑传输和编解码失真的基于内容感知的无参考视频质量评价方法,并构建其数学模型。在该方法中,首先采用视频帧图像纹理复杂性特征、图像的局部对比度、时域信息及其视觉感知来描述视频内容,构建其内容感知模型,并以此探讨视频内容及其视觉感知对视频质量的影响;然后,探讨比特率与视频质量之间的关系,构建其模型,研究视频比特率对其质量的影响;接着,结合视频传输时延特征,构建了由于传输时延失真而产生的视频质量下降的质量评价模型;最后,采用凸优化方法综合3个方面的模型,提出了一种综合考虑视频内容、编解码失真、传输时延失真和视觉特性的无参考视频质量评价模型。并采用多个建立的视频数据库和开源数据库中的数据和视频进行了测试验证,并与17种现有视频质量评价模型进行了性能对比;结果表明,所提模型的精度Pearson相关系数和Spearman秩序相关系数值最小分别能够达到0.8773和0.8336,最大可以实现0.9383和0.9438,表现出了较好的泛化性能,且复杂度比较低。综合模型精度、泛化性能、复杂性3个方面的性能参数表明,所提模型是一个性能比较优异的视频质量评价模型。
This paper proposes a Video Quality Assessment(VQA)method based on video-content perception by analyzing the influence of video content,transmission delay,and encoding and decoding distortion characteristics on the VQA,combined with human visual system characteristics and its mathematical model.In this method,the video contents are described by the texture complexity,local contrast,temporal information of video frame image,and their visual perception.Thus,the video contents perception model can be built,which allows for investigating the influence of the video content and their visual perception on VQA.The relationship between the bit rate and video quality is discussed,whose relationship models are built,to study the impact of the bit rate of video-on-video quality.Subsequently,the VQA model that video quality degradation caused by transmission delay distortion is designed by combining the characteristics of video transmission delay.Finally,the convex optimization method is used to synthesize the above three aspects of models,and a no-reference VQA model considering the video contents,encoding and decoding distortion,transmission delay distortion,and human visual system characteristics,is proposed.The proposed VQA model was tested and verified using the videos from several established video databases and open-source video databases,and its performance was compared with that of 17 existing VQA models.The results showed that the precision Pearson linear and Spearman rank order correlation coefficients of the proposed VQA model reached a minimum of 0.8773 and 0.8336 and a maximum of 0.9383 and 0.9438,respectively.This shows that the model has good generalization performance and low complexity.Analyzing the overall efficiency of performance in terms of model accuracy,generalization performance,and complexity,the results show that the proposed model is an excellent VQA model.
作者
姚军财
汤浩威
申静
YAO Juncai;TANG Haowei;SHEN Jing(School of Computer Engineering,Nanjing Institute of Technology,Nanjing 211167,China;School of Information and Communication Engineering,Xi’an Jiaotong University,Xi’an 710049,China)
出处
《光学精密工程》
EI
CAS
CSCD
北大核心
2022年第22期2923-2938,共16页
Optics and Precision Engineering
基金
国家自然科学基金资助项目(No.61301237)
江苏省自然科学基金面上项目资助(No.BK20201468)
江苏省高校“青蓝工程”中青年学术带头人资助项目(苏教师函[2022]29号)。
关键词
视频质量评价
人类视觉特性
视频内容
亮度和色度
传输时延
Video Quality Assessment(VQA)
human visual system characteristics
video contents
luminance and chrominance transmission delay
