摘要
目的 图像合成方法随着计算机视觉的不断发展和深度学习技术的逐渐成熟为人们的生活带来了丰富的体验。然而,用于传播虚假信息的恶意篡改图像可能对社会造成极大危害,使人们对数字内容在图像媒体中的真实性产生怀疑。面部编辑作为一种常用的图像篡改手段,通过修改面部的五官信息来伪造人脸。图像修复技术是面部编辑常用的手段之一,使用其进行面部伪造篡改同样为人们的生活带来了很大干扰。为了对此类篡改检测方法的相关研究提供数据支持,本文制作了面向人脸修复篡改检测的大规模数据集。方法 具体来说,本文选用了不同质量的源数据集(高质量的人脸图像数据集CelebA-HQ及低质量的人脸视频数据集FF++),通过图像分割方法将面部五官区域分割,最后使用两种基于深度网络的修复方法CTSDG(image inpainting via conditional texture and structure dual generation)和RFR(recurrent feature reasoning for image inpainting)以及一种传统修复方法 SC(struct completion),生成总数量达到60万幅的大规模修复图像数据集。结果 实验结果表明,由FF++数据集生成的图像在基准检测网络ResNet-50下的检测精度下降了15%,在Xception-Net网络下检测精度下降了5%。且不同面部部位的检测精度相差较大,其中眼睛部位的检测精度最低,检测精度为0.91。通过泛化性实验表明,同一源数据集生成的数据在不同部位的修复图像间存在一定的泛化性,而不同的源数据制作的数据集间几乎没有泛化性。因此,该数据集也可为修复图像之间的泛化性研究提供研究数据,可以在不同数据集、不同修复方式和不同面部部位生成的图像间进行修复图像的泛化性研究。结论 基于图像修复技术的篡改方式在一定程度上可以骗过篡改检测器,对于此类篡改方式的检测方法研究具有现实意义。提供的大型基于修复技术的人脸篡�
Objective DeepFake technology,born with the continuous maturation of deep learning techniques,primarily utilizes neural networks to create non-realistic faces.This method has enriched people's lives as computer vision advances and deep learning technologies mature.It has revolutionized the film industry by generating astonishing visuals and reducing production costs.Similarly,in the gaming industry,it has facilitated the creation of smooth and realistic animation effects.However,the malicious use of image manipulation to spread false information poses significant risks to society,casting doubt on the authenticity of digital content in visual media.Forgery techniques encompass four main categories:face reenactment,face replacement,face editing,and face synthesis.Face editing,a commonly employed image manipulation method,involves falsifying facial features by modifying the information related to the five facial regions.As one of the commonly employed methods in facial editing,image inpainting technology involves utilizing known content from an image to fill in missing areas,aiming to restore the image in a way that aligns as closely as possible with human perception.In the context of facial forgery,image inpainting is primarily used for identity falsification,wherein facial features are altered to achieve the goal of replacing a face.The use of image inpainting for facial manipulation similarly introduces significant disruption to people's lives.To support research on detection methods for such manipulations,this paper produced a large-scale dataset for face manipulation detection based on inpainting techniques.Method This paper specifically focuses on the field of image tampering detection,utilizing two classic datasets:the high-quality CelebA-HQ dataset,comprising 25 000 high-resolution(1 024 × 1 024 pixels) celebrity face images,and the low-quality FF++ dataset,consisting of 15 000 face images extracted from video frames.On the basis of the two datasets,facial feature regions(eyebrows,eyes,nose,mouth,and the en
作者
李伟
黄添强
黄丽清
郑翱鲲
徐超
Li Wei;Huang Tianqiang;Huang Liqing;Zheng Aokun;Xu Chao(College of Computer and Network Space Security,Fujian Normal University,Fuzhou 350117,China;Fujian Provincial Engineering Research Center for Public Service Big Data Mining and Application,Fuzhou 350117,China;Digital Fujian Big Data Security Technology Institute,Fuzhou 350117,China)
出处
《中国图象图形学报》
CSCD
北大核心
2024年第7期1834-1848,共15页
Journal of Image and Graphics
基金
国家自然科学基金项目(62072106)
福建省科技创新平台项目(2023-P-003)
福建省科技厅产学研合作项目(2021H6004)。
关键词
图像篡改
深度学习
图像修复
数据集
基准
image tampering
deep learning
image inpainting
dataset
benchmark
