摘要
针对一致性修复方法仅利用视频的颜色和运动特征来优化目标函数,导致无法准确预测未知区域像素值的问题,将视频的结构信息引入到目标函数中,提出结构约束的视频修复方法.首先计算破损视频的时空金字塔,在从上到下的第1层金字塔中先修复破损部分边界上的像素;然后采用加权平均方式完成破损像素的重建,对权值重新定义,再更新边界,修复新边界上的像素,完成第1层金字塔的修复;最后用相同方法依次修复各层金字塔,直到所有破损像素都被修复.采用不同方法对不同复杂场景视频进行修复并用峰值信噪比和结构相似度进行评价,实验结果表明该方法取得了更好的视觉效果,峰值信噪比平均提高1～3 dB.
To optimize the objective function by using only the color and motion features of video,the consistent completion method was unable to predict the pixel value of unknown region accurately.In this paper,the structure information of video is introduced into the objective function.Firstly,calculate the space-time pyramid of damaged video.In the first layer of the pyramid from top to bottom,repair the pixels on the boundary of the broken part.The broken pixel can be inpainted by a weighted average method,update the boundary and inpaint the pixels on the new boundary by redefining weight,complete the first pyramid.Finally,the same method is used to inpaint each layer pyramid in turn,until all damaged pixels are completed.The various methods are used to repair the videos of different complex scenes and evaluate them with peak signal to noise ratio and structural similarity.Experimental results show that the proposed method achieves better visual effect,and the peak signal to noise ratio(PSNR)increases by 1 to 3 dB on average.
作者
杨瑞
唐向宏
张越
Yang Rui;Tang Xianghong;Zhang Yue(School of Communication Engineering,Hangzhou Dianzi University,Hangzhou 310018)
出处
《计算机辅助设计与图形学学报》
EI
CSCD
北大核心
2019年第3期455-466,共12页
Journal of Computer-Aided Design & Computer Graphics
基金
浙江省杭电智慧城市研究中心课题(GK150906299001)
关键词
视频修复
时空金字塔
全局目标函数
结构特征因子
近似最近邻搜索
video completion
space-time pyramid
global objective function
structural feature factor
approximate nearest neighbour search
