摘要
文中主要介绍了手势分割、手势轮廓、手势凸包、凸包缺陷、指尖定位与手势跟踪,并基于此架构实现对键盘鼠标的模拟。将图像由RGB模型转化为HSV模型后,再通过HSV利用肤色阈值对人手进行分割,从而获得手势轮廓凸包。通过三角形原理计算出指尖与凸包缺陷,解决了手势水平状态下凸包缺陷无法定位的问题。采用单目视觉下的手势跟踪算法进行指尖定位初始化跟踪目标,实现无监督的Camshift实时手势跟踪。实验结果表明,在光照良好的条件下,对键盘模拟的准确率高达90%以上。
In this paper,the gesture segmentation,gesture contour,gesture convex hull,convex hull defect,fingertip positioning and gesture tracking are introduced mainly,and the simulation of keyboard and mouse is realized based on this architecture.The image is transformed from RGB model to HSV(hue,saturation,value)model,and then the skin color threshold is used to segment the hand according to HSV,so as to obtain the convex hull of gesture contour.In this paper,the number of the fingertips and the convex hull defects is calculated by principle of triangle,which solves the problem that convex hull defects fail to be positioned in the horizontal state of gesture.The gesture tracking algorithm with monocular vision is used to perform fingertip positioning initialization object tracking in order to realize unsupervised Camshift real-time gesture tracking.The experimental results show that the accuracy rate of keyboard simulation is over 90%under the conditions of good lighting.
作者
郭金朋
韩昌林
陆洲
邵阳
GUO Jinpeng;HAN Changlin;LU Zhou;SHAO Yang(Zhejiang Uniview Technologies Co.,Ltd.,Hangzhou 310051,China;Anhui Open University,Hefei 230022,China;Guangdong University of Technology,Guangzhou 510006,China)
出处
《现代电子技术》
北大核心
2024年第15期81-85,共5页
Modern Electronics Technique
关键词
指尖定位
手势跟踪
键鼠模拟
凸包缺陷
单目视觉
帧差法
色彩模型
图像增强
fingertip positioning
gesture tracking
simulation of keyboard and mouse
convex hull defect
monocular vision
frame difference method
color model
image enhancement
