摘要
针对疲劳驾驶极易造成拖拉机交通事故这一问题,该文提出了一种基于卷积神经网络面部特征识别的拖拉机驾驶员疲劳检测方法。首先,利用伽马亮度校正对驾驶员面部图像进行光照预处理,再通过小波包去除图像中的椒盐噪声和高斯噪声,对预处理后的图像分别通过PCA-SCM人脸特征识别定位算法和基于人脸核心特征库及肤色模型的人脸识别算法进行驾驶员面部的识别定位,并通过比对这2种算法识别的偏差大小校验算法识别的有效性,以减小拖拉机工作振动时采样对图像中人脸定位精度的影响。将提取到的驾驶员面部图像输入到卷积神经网络进行深度学习和训练,并建立驾驶员疲劳视觉检测模型,从而实现基于拖拉机驾驶员面部图像的疲劳检测。统计训练过程中各项参数变化情况并进行T-SNE降维迭代分析,与其他常规方法相比,CNN在检测准确度和检测效率方面都有较为明显的优势。试验表明,所提出的检测模型准确率98.9%,图片识别效率38 ms/帧(Inter i7-4510U双核处理器),能够实现拖拉机驾驶员疲劳状况的实时检测,该研究可为解决疲劳驾驶这一安全问题提供参考。
Tractor is a popular tool for agricultural farming in the world.But many factors such as high labor intensity,absence of sleeping and monotonous environment make driver fatigued easily in farming season.Aiming at the phenomenon of fatigue driving which is the major reason for tractor traffic accidents,a tractor fatigue detection method based on facial feature recognition using convolution neural network was proposed.Firstly,1200 driving images were sampled during different daytimes by 60 drivers in which the male accounted for 77%.Then the face images of tractor drivers were pretreated by gamma intensity correction(GIC)method,aimed to solve the problem of the uneven brightness of images with fast processing speed because of its simple algorithm,and hence reduce the influence of illumination of faces.Due to the complex working environment of the tractor and the special surrounding window design,wavelet denoising method was applied in image denoising because it is powerful for the removal of impulse noise and Gaussian noise which are the main noise in the images.In addition,principal component analysis– skin color model(PCA-SCM)method was used to detect and locate faces and then skin color model was applied to rectify and extract the facial area.For improving the face recognition precision,dual-face recognition and checking algorithm was proposed.Firstly,core feature face database was established and human face recognition classifier was generated.Secondly the core feature memory space of human face was formed to locate human face in image.Thirdly,to establish a Gaussian skin color model in YCbCr color space and perform the binary converting,bloat and corrosion methods were also applied to remove fake areas for improving accuracy.In the end,the obtained face position was compared with the previous one to evaluate the effectiveness of this image.Finally,the drivers’facial images were input to the convolution neural network(CNN)for training,and the driver fatigue detection model was established to identify the fa
作者
卢伟
胡海阳
王家鹏
王玲
Yiming Deng
Lu Wei;Hu Haiyang;Wang Jiapeng;Wang Ling;Yiming Deng(Department of Engineering,Nanjing Agricultural University,Nanjing 210031,China;Jiangsu Province Engineering Laboratory of Modern Facility Agriculture Technology and Equipment,Nanjing 210031,China;Michigan State University,College of Engineering,East Lansing,48824,America)
出处
《农业工程学报》
EI
CAS
CSCD
北大核心
2018年第7期192-199,共8页
Transactions of the Chinese Society of Agricultural Engineering
基金
国家自然科学基金青年基金(51405239)；江苏省农机三新工程项目(SZ120170036)；Asia hub on WEF and Agriculture，NAU-MSU联合研究项目(2017-H-11)
