高清图像(高分辨率图像)前景遮罩提取问题是图像合成、自动前景提取等图像处理领域的热点难题,其本质是前景背景像素对的大规模组合优化问题,目前相关研究成果较少.本文针对问题维度过高难以直接求解这一问题,设计了基于RGB聚类的多类...高清图像(高分辨率图像)前景遮罩提取问题是图像合成、自动前景提取等图像处理领域的热点难题,其本质是前景背景像素对的大规模组合优化问题,目前相关研究成果较少.本文针对问题维度过高难以直接求解这一问题,设计了基于RGB聚类的多类协同优化策略,以实现决策空间的有效降维;给出协同目标反馈的分组优化策略,通过将协同目标中的最优前景背景像素对作为启发式信息反馈给每个分组,实现大规模组合优化问题的分组协同求解.在分组优化策略的基础上,论文提出了基于分组协同的群体竞争优化算法(competitive swarm optimization algorithm based on group collaboration,GC-CSO),为高维优化问题分析提供了借鉴.为了验证所提方法的有效性,本文选用alpha matting基准数据集作为测试数据,通过与群体竞争优化算法、典型带分组策略的大规模优化算法进行对比分析,验证了:(1)基于RGB聚类的协同优化策略可以显著地降低问题维度;(2) GC-CSO算法提高了高清图像前景遮罩的提取精度.展开更多
In this paper we present a novel automatic background substitution approach for live video. The objective of background substitution is to extract the foreground from the input video and then combine it with a new bac...In this paper we present a novel automatic background substitution approach for live video. The objective of background substitution is to extract the foreground from the input video and then combine it with a new background. In this paper, we use a color line model to improve the Gaussian mixture model in the background cut method to obtain a binary foreground segmentation result that is less sensitive to brightness differences. Based on the high quality binary segmentation results, we can automatically create a reliable trimap for alpha matting to refine the segmentation boundary. To make the composition result more realistic, an automatic foreground color adjustment step is added to make the foreground look consistent with the new background. Compared to previous approaches, our method can produce higher quality binary segmentation results, and to the best of our knowledge, this is the first time such an automatic and integrated background substitution system has been proposed which can run in real time, which makes it practical for everyday applications.展开更多
文摘高清图像(高分辨率图像)前景遮罩提取问题是图像合成、自动前景提取等图像处理领域的热点难题,其本质是前景背景像素对的大规模组合优化问题,目前相关研究成果较少.本文针对问题维度过高难以直接求解这一问题,设计了基于RGB聚类的多类协同优化策略,以实现决策空间的有效降维;给出协同目标反馈的分组优化策略,通过将协同目标中的最优前景背景像素对作为启发式信息反馈给每个分组,实现大规模组合优化问题的分组协同求解.在分组优化策略的基础上,论文提出了基于分组协同的群体竞争优化算法(competitive swarm optimization algorithm based on group collaboration,GC-CSO),为高维优化问题分析提供了借鉴.为了验证所提方法的有效性,本文选用alpha matting基准数据集作为测试数据,通过与群体竞争优化算法、典型带分组策略的大规模优化算法进行对比分析,验证了:(1)基于RGB聚类的协同优化策略可以显著地降低问题维度;(2) GC-CSO算法提高了高清图像前景遮罩的提取精度.
基金supported by the National HighTech R&D Program of China (Project No. 2012AA011903)the National Natural Science Foundation of China (Project No. 61373069)+1 种基金the Research Grant of Beijing Higher Institution Engineering Research CenterTsinghua–Tencent Joint Laboratory for Internet Innovation Technology
文摘In this paper we present a novel automatic background substitution approach for live video. The objective of background substitution is to extract the foreground from the input video and then combine it with a new background. In this paper, we use a color line model to improve the Gaussian mixture model in the background cut method to obtain a binary foreground segmentation result that is less sensitive to brightness differences. Based on the high quality binary segmentation results, we can automatically create a reliable trimap for alpha matting to refine the segmentation boundary. To make the composition result more realistic, an automatic foreground color adjustment step is added to make the foreground look consistent with the new background. Compared to previous approaches, our method can produce higher quality binary segmentation results, and to the best of our knowledge, this is the first time such an automatic and integrated background substitution system has been proposed which can run in real time, which makes it practical for everyday applications.
