摘要
针对人脸图像试戴3D眼镜过程中存在的镜腿遮挡人脸问题,文中提出一种基于人脸图像的3D眼镜虚拟试戴技术。利用构建的人脸形状的三维模型,使其在虚拟试戴中对镜腿起到消隐作用,解决镜腿的遮挡问题。文中对输入的人脸图像进行关键点检测,结合Graham扫描法求得人脸形状的凸多边形,利用平移扫描构建人脸形状的三维模型。此外,文中根据定位人脸图像上的关键点以及姿态估计后对三维眼镜模型的变换,将眼镜模型佩戴到人脸图像上。实验结果表明,该方法对于多视角的人脸图像实现了虚拟试戴效果,解决了多种视角下人脸图像试戴过程中镜腿的遮挡问题,虚拟试戴中镜腿遮挡平均准确率为94.5%,遮挡精度较高。
In order to solve the problem that the mirror legs shade the face in the process of trying on 3D glasses on face image,this study proposes a virtual trying on system of 3D glasses based on face image.The three-dimensional model of the face shape is used to blank the mirror leg and solve the occlusion problem of the mirror leg.The key points of the input face image are detected,and the convex hull of the face shape is obtained by combining the Graham scanning method,and the three-dimensional model of the face shape is constructed by the translation scanning method.Additionally,according to the positioning of key points on the face image and the transformation of the 3D glasses model after pose estimation,the glasses model is worn on the face image.The experimental results show that the method achieves virtual try-on effect for multi-view face images,and solves the problem of occlusion of temples in the process of face images from multiple viewing angles.The average occlusion accuracy of the blanking leg during virtual trial is 94.5%,and the occlusion accuracy is high.
作者
王晓锋
付东翔
WANG Xiaofeng;FU Dongxiang(School of Optical-Electrical and Computer Engineering,University of Shanghai for Science and Technology,Shanghai 200093,China)
出处
《电子科技》
2023年第1期44-50,共7页
Electronic Science and Technology
基金
国家自然科学基金(61605114
61703277)。
关键词
虚拟试戴
遮挡问题
多视角试戴
凸包算法
Graham扫描法
关键点检测
姿态估计
平移扫描
virtual try on
occlusion problem
multi-angle try-on
convex hull algorithm
Graham scanning method
key point detection
pose estimation
translation scan
