摘要
在动态场景下进行目标检测与跟踪处理时,提取的前景目标往往会因受到背景抖动干扰而出现目标误判、轮廓不完整等问题,为此提出结合稳像与补帧、VIBE算法与连通域修正的抖动视频前景目标提取方法。首先利用ORB对相邻两帧图像进行特征匹配,使用RANSAC剔除误匹配点,以运动目标为中心调整图像边距,裁剪与修补不重合的部分,通过统计法求相邻两帧的偏移均值,完成视频稳像处理;其次利用稠密光流法计算相邻两帧图像的位移,通过位置重映射生成中间帧,实现视频补帧;然后将VIBE算法增加形态学处理与连通域修正,结合Canny算子进行边缘检测,增加目标轮廓的完整性;最后使用视频实例进行测试,与其他视频目标提取算法进行比较分析,精度、召回率至少提高10%,漏检率、错分率至少降低15%。实验结果表明,所提方法能有效去除抖动带来的影响,提取的目标完整性较高。
In target detection and tracking processing area,the extracted foreground target is often disturbed by background jittering,resulting the problems of target misjudgment,incomplete contour and so on.In this paper,we present a method to improve the integrity of foreground target extraction by combining image stabilization and frame supplement,and then using VIBE algorithm and connected domain correction.Firstly,the image of two adjacent frames is matched by ORB feature,and the wrong matching points are eliminated by RANSAC method.Then,the image margin is adjusted with the moving target as the center,and the non-coincident parts are cropped and repaired.The offset mean value of two adjacent frames is calculated by statistical method to achieve the purpose of video image stabilization.Secondly,the dense optical flow method is used to calculate the displacement of two adjacent frames,and then the intermediate frame is generated by position remapping and supplemented to make the video sequence more smooth and stable.Thirdly,based on VIBE algorithm,morphological processing and connected domain correction are added,and Canny operator is combined for edge detection to increase the integrity of target contour.Finally,a video example is used to test and compare with the commonly used video target extraction algorithms.The precision and recall rates increase by at least 10%.The rates of FNR and PWC reduce by at least 15%.Experimental results show that the proposed method can effectively remove the influence of jitter in most dynamic backgrounds,and the integrity of the extracted target is high.
作者
刘新富
蒋慕蓉
黄亚群
张占伟
周莹瑛
LIU Xin-fu;JIANG Mu-rong;HUANG Ya-qun;ZHANG Zhan-wei;ZHOU Ying-ying(School of Information Science&Engineering,Yunnan University,Kunming 650091,China)
出处
《计算机科学》
CSCD
北大核心
2022年第S02期404-411,共8页
Computer Science
基金
云南省高校科技创新团队支持项目(IRTSTYN19N07)
关键词
目标提取
抖动视频
稳像
补帧
VIBE算法
连通域修正
Target extraction
Jitter video
Image stabilization
Frame compensation
VIBE algorithm
Connected domain modification
