期刊文献+

基于Kinect的实时稳定的三维多手指跟踪算法 被引量:12

Real Time Robust Multi-fingertips Tracking in 3DSpace Using Kinect
下载PDF
导出
摘要 针对现有手指跟踪算法的不足,利用微软Kinect设备提出一种实时鲁棒的三维多手指跟踪算法.首先利用深度图分割出一个粗糙的手区域,对该区域应用基于像素分类的指尖检测算法得到二维指尖点的位置;然后在深度图上对二维指尖位置周围的点进行采样,将均值作为指尖点的Z坐标,再利用卡尔曼滤波器以及帧之间的连续性对指尖点的三维位置进行跟踪.依据Kinect数据特点提出的二维指尖检测算法和利用帧之间连续性的卡尔曼滤波器是文中算法的关键.实验结果证明,该算法能够实时、稳定地进行三维多手指跟踪. In this paper, we introduce a fast and robust algorithm for tracking 3D multi-fingertips using Kinect. Our method firstly uses Kinect to get a rough hand region, then applies the fingertip detection method based on pixel classification to get the 2D fingertips. Finally, we sample on the depth map around the detected fingertip to get the Z-value of the fingertips and then combine the Kalman filter and the continuity between frames to track the 3D position of fingertips. The fingertip detection method based on the specialty of the data of Kinect and the Kalman filter applied with continuity between frames are the key of our algorithm. The experimental results show that our algorithm can robustly track 3D multi-fingertips in real time.
出处 《计算机辅助设计与图形学学报》 EI CSCD 北大核心 2013年第12期1801-1809,共9页 Journal of Computer-Aided Design & Computer Graphics
基金 国家自然科学基金(61173124,61202284)
关键词 多手指跟踪 3D人机交互 KINECT multi-fingertips tracking 3D human computer interaction Kinect
  • 相关文献

参考文献22

  • 1Vezhnevets V. Andreeva A. A survey on pixel-based skin color detection techniques[CJ I/Proceedings of the 13th International Conference of Computer Graphics and Visualization. Los Alamitos: IEEE Computer Society Press. 2003: 85-92. 被引量:1
  • 2陈锻生,刘政凯.肤色检测技术综述[J].计算机学报,2006,29(2):194-207. 被引量:118
  • 3曹昕燕,赵继印,李敏.基于肤色和运动检测技术的单目视觉手势分割[J].湖南大学学报(自然科学版),2011,38(1):78-83. 被引量:20
  • 4Oka K. Sato Y. Koike H. Real-time fingertip tracking and gesture recognition[J]. IEEE Computer Graphics and Applications. 2002. 22(6): 64-71. 被引量:1
  • 5Oka K. Sato Y. Koike H. et al . Real-time tracking of multiple fingertips and gesture recognition for augmented desk interface systems[CJ /IProceedings of the 5th IEEE International Conference on Automatic Face and Gesture Recognition. Los Alamitos: IEEE Computer Society Press. 2002: 429-434. 被引量:1
  • 6Sato Y. Kobayashi Y. Koike H. Fast tracking of hands and fingertips in infrared images for augmented desk interface[CJ /IProceedings of the 4th IEEE International Conference on Automatic Face and Gesture Recognition. Los Alamitos: IEEE Computer Society Press. 2000: 462-467. 被引量:1
  • 7Crowley 1 L. Berard F. CoutazJ. Finger tacking as an iriput device for augmented reality[CJ /IProceedings of International Workshop on Automatic Face and Gesture Recognition. Los Alamitos: IEEE Computer Society Press. 1995: 195-200. 被引量:1
  • 8Keaton T. Dominguez S M. Sayed A H. SNAP&TELL: a multi -modal wearable computer interface for browsing the environment[CJ //Proceedings of the 6th International Symposium on Wearable Computers. Los Alamitos: IEEE Computer Society Press. 2002: 75-82. 被引量:1
  • 9Quek F. Mysliwiec T. Zhao M. Finger mouse: a free hand pointing computer interface[CJ //Proceedings of International Workshop on Automatic Face and Gesture Recognition. Los Alamitos: IEEE Computer Society Press. 1995: 372-377. 被引量:1
  • 10Tomita A. Ishii R. Hand shape extraction from a sequence of digitized grayscale images[CJ //Proceedings of the 12th International Conference on Industrial Electronics. Control and Instrumentation. Los Alamitos: IEEE Computer Society Press. 1994: 1925-1930. 被引量:1

二级参考文献156

共引文献153

同被引文献121

  • 1姜峰,高文,王春立,姚鸿勋,赵德斌.非特定人手语识别进展及关键问题研究思路[J].软件学报,2007,18(3):477-489. 被引量:2
  • 2宋新,罗军,王鲁平,沈振康.基于GVF Snake的运动目标跟踪方法[J].红外与激光工程,2007,36(2):226-228. 被引量:6
  • 3王西颖,张习文,戴国忠.一种面向实时交互的变形手势跟踪方法[J].软件学报,2007,18(10):2423-2433. 被引量:29
  • 4Raheja J L,Chaudhary A,Singal K.Tracking of fingertips and centers of palm using KINECT[C].Third International Conference and Computational Intelligence,2011:248-252. 被引量:1
  • 5Liang H,Yuan J S,Thalmann D.3D Fingertip and palm tracking in depth image sequences[C].Proceedings of the 20th ACM International Conference on Multimedia,2012:785-788. 被引量:1
  • 6Tao H Y,Yu Y L.Finger tracking and gesture recognition with kinect[C].12th International Conference on Computer and Information Technology.IEEE,2012:214-218. 被引量:1
  • 7Wu X Y,Cheng Y,Wang Y W,et al.An intelligent interactive system based on hand gesture recognition algorithm and kinect[C].Fifth International Symposium on Computational Intelligence and Design,2012:294-298. 被引量:1
  • 8ZHU Y,YANG Z,YUAN B.Vision based hand gesture recognition[C]//ICSS 2013:Proceedings of the 2013 International Conference on Service Sciences.Washington,DC:IEEE Computer Society,2013:260-265. 被引量:1
  • 9MAZUMDAR D,TALUKDAR A K,SARMA K K.Gloved and free hand tracking based hand gesture recognition[C]//ICETACS 2013:Proceedings of the 2013 1st International Conference on Emerging Trends and Applications in Computer Science.Piscataway:IEEE,2013:197-202. 被引量:1
  • 10CHOUDHOURY A,TALUKDAR A K,SARMA K K.A novel hand segmentation method for multiple-hand gesture recognition system under complex background[C]//SPIN 2014:Proceedings of the 2014 International Conference on Signal Processing and Integrated Networks.Piscataway:IEEE,2014:136-140. 被引量:1

引证文献12

二级引证文献69

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部