期刊文献+

非线性联合学习的三维人脸表情合成方法 被引量:7

3D Facial Expression Synthesis Based on Nonlinear Co-learning
下载PDF
导出
摘要 针对人脸表情数据的非线性分布特性,提出一种基于非线性联合学习的三维人脸表情合成方法.首先提出非线性联合学习理论,通过无监督回归将具有相同属性的三维人脸映射到相同的低维表达;其次,基于三维人脸的低维表达对低维表达进行重建操作,为给定的三维人脸合成表情,或基于样例表情进行表情的重定向.另外,非线性联合学习方法还能有效地处理带噪声及不完整的人脸数据,获得完整的表情人脸.实验结果表明,文中方法的表情重定向合成结果及合成效率优于已有方法. 3D facial expression synthesis has been an important and challenging task in the field computer animation. Inspired by the fact that facial expressions distribute on a nonlinear manifold, propose an approach for 3D facial expression synthesis based on nonlinear co-learning. Firstly, facial expressions with the same attribute are projected onto an identical low dimensional representat according to the theory of nonlinear co-learning, by means of unsupervised regression. Second based on the low dimensional representations of 3D faces, reconstruction operations are needed of we aD ion ly, to synthesize expressions for given 3D faces, and to retarget expressions based on given expression samples. The proposed approach is able to handle noisy/incomplete input faces, and generate intact expressional faces. Experimental results show that the proposed 3D facial expression synthesis outperforms the existing methods both in quality and in efficiency.
出处 《计算机辅助设计与图形学学报》 EI CSCD 北大核心 2011年第2期363-370,376,共9页 Journal of Computer-Aided Design & Computer Graphics
基金 国家自然科学基金(60873124)
关键词 表情重定向 表情合成 非线性联合学习 无监督回归 expression retargeting expression synthesis nonlinear co-learning unsupervised regression
  • 相关文献

参考文献21

  • 1姜大龙..真实感三维人脸合成方法研究[D].中国科学院计算技术研究所,2005:
  • 2常江龙..三维人脸表情合成研究[D].中国科学技术大学,2009:
  • 3Wang Y, Huang X L, Lee C S, et al. High resolution acquisition, learning and transfer of dynamic 3-D facial expressions [J]. Computer Graphics Forum, 2004, 23 (3) : 677-686. 被引量:1
  • 4Parke F I. Computer generated animation of faces [C]// Proceedings of the ACM Annual Conference. New York: ACM Press, 1972, 1: 451-457. 被引量:1
  • 5Parke F, Waters K. Computer facial animation[M]. Wellesley: A K Peters Ltd, 2008. 被引量:1
  • 6Noh J Y, Neumann U. Expression cloning [C] //Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques. New York: ACM Press, 2001: 277- 288. 被引量:1
  • 7Song M L, Dong Z, Theobalt C, et al. A generic framework for efficient 2-D and 3-D facial expression analogy [J]. IEEE Transactions on Multimedia, 2007, 9(7) : 1384-1395. 被引量:1
  • 8Vlasic D, Brand M, Pfister H, et al. Face transfer with multilinear models [J]. ACM Transactions on Graphics, 2005, 24(3): 426-433. 被引量:1
  • 9Tao D C, Song M L, Li X L, etal. Bayesian tensor approach for 3-D face modeling [J]. IEEE Transactions on Circuits and Systems for Video Technology, 2008, 18(10): 1397-1410. 被引量:1
  • 10Ekmau P, Friesen W V, Hager J C. Facial action coding system [M]. Palo Alto: Consulting Psychologists Press, 1978. 被引量:1

二级参考文献18

  • 1Yuencheng Lee,Computer Graphics Proceedings,Annual Conference Series,ACM SIGGRAPH,1996年,55页 被引量:1
  • 2Horace H S Ip,The Visual Computer,1996年,12卷,5期,254页 被引量:1
  • 3Besl P J,Mckay N D.A method for registration of 3D shapes[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,1992,14(2):239-256 被引量:1
  • 4Sumner R W,Popovic J.Deformation transfer for triangle meshes[C] //Computer Graphics Proceedings,Annual Conference Series,ACM SIGGRAPH,Los Angeles,California,2004:399-405 被引量:1
  • 5Allen B,Curless B,Popovic Z.The space of all body shapes:reconstruction and parameterization from range scans[C]//Computer Graphics Proceedings,Annual Conference Series,ACM SIGGRAPH,San Diego,California,2003:587-594 被引量:1
  • 6Allen B,Curless B,Popovic Z.Articulated body deformation from range scan data[C] //Computer Graphics Proceedings,Annual Conference Series,ACM SIGGRAPH,San Antonio,Texas,2002:612-619 被引量:1
  • 7Marschner S R,Guenter B,Raghupathy S.Modeling and rendering for realistic facial animation[C] //Proceedings of the 11th Eurographics Workshop on Rendering,Brno,Czech Republic,2000:231-242 被引量:1
  • 8Noh J Y,Neumann U.Expression cloning[C].//Computer Graphics Proceedings,Annual Conference Series,ACM SIGGRAPH,Los Angeles,California,2001:277-288 被引量:1
  • 9Pei Y,Zha H,Yuan Z.Tissue map based craniofacial reconstruction and facial deformation using RBF network[C]//Proceedings of the 3rd International Conference on Image and Graphics,Hong Kong,2004:398-401 被引量:1
  • 10Na K,Jung M R.Hierarchical retargeting of fine facial motions[J].Computer Graphics Forum,2004,23(3):687-695 被引量:1

共引文献22

同被引文献57

  • 1郑南宁,付昀,张婷,卓峰.人脸的表情与年龄变换和非完整信息的重构技术(上)[J].电子学报,2003,31(z1):1955-1962. 被引量:7
  • 2吴恩华,柳有权.基于图形处理器(GPU)的通用计算[J].计算机辅助设计与图形学学报,2004,16(5):601-612. 被引量:226
  • 3姜大龙,高文,王兆其,陈益强.面向纹理特征的真实感三维人脸动画方法[J].计算机学报,2004,27(6):750-757. 被引量:9
  • 4XuCH, LiS, TanT H, etal. Automatic gD face recognition from depth and intensity Gabor features [J]. Pattern Recognition, 2009, 42(9): 1895-1905. 被引量:1
  • 5Hu Y L, Zhou M Q, Wu Z K. A dense point-to-point alignment method for realistic 3D face morphing and animation [J]. International Journal of Computer Games Technology, 2009, 2009: Article No. 3. 被引量:1
  • 6Wang Y M, Liu J Z, Tang X O. Robust 3D face recognition by local shape difference boosting [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2010, 32 (10) : 1858-1870. 被引量:1
  • 7Passalis G, Perakis P, Theoharis T, et al. Using facial symmetry to handle pose variations in real-world 3D face recognition [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2011, 33(10): 1938-1951. 被引量:1
  • 8Lu X G, Jain A K. Automatic feature extraction for multiview 3D face recognition [C] //Proceedings of the 7th Conference on Automatic Face and Gesture Recognition. Los Alamitos: IEEE Computer Society Press, 2006:585-590. 被引量:1
  • 9Besl P J, Mekay N D. A method for registration of 3 D shapes [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1992, 14(2): 239-256. 被引量:1
  • 10Perakis P, Theoharis T, Passalis G, et al. Automatic 3D facial region retrieval from multi pose facial datasets [C] // Proceedings of Eurographics Workshop on 3D Object Retrieval. Aire-la-Ville: Eurographics Association Press, 2009, 37-44. 被引量:1

引证文献7

二级引证文献16

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部