With the increasing intensive and large-scale development of the sika deer breeding industry,it is crucial to assess the health status of the sika deer by monitoring their behaviours.A machine vision-based method for ...With the increasing intensive and large-scale development of the sika deer breeding industry,it is crucial to assess the health status of the sika deer by monitoring their behaviours.A machine vision-based method for the behaviour recognition of sika deer is proposed in this paper.Google Inception Net(GoogLeNet)is used to optimise the model in this paper.First,the number of layers and size of the model were reduced.Then,the 5×5 convolution was changed to two 3×3 convolutions,which reduced the parameters and increased the nonlinearity of the model.A 5×5 convolution kernel was used to replace the original convolution for extracting coarse-grained features and improving the model’s extraction ability.A multi-scale module was added to the model to enhance the multi-faceted feature extraction capability of the model.Simultaneously,the Squeeze-and-Excitation Networks(SE-Net)module was included to increase the channel’s attention and improve the model’s accuracy.The dataset’s images were rotated to reduce overfitting.For image rotation,the angle wasmultiplied by 30°to obtain the dataset enhanced by rotation operations of 30°,60°,90°,120°and 150°.The experimental results showed that the recognition rate of this model in the behaviour of sika deer was 98.92%.Therefore,the model presented in this paper can be applied to the behaviour recognition of sika deer.The results will play an essential role in promoting animal behaviour recognition technology and animal health monitoring management.展开更多
With the rapid development of deep learning technology,behavior recognition based on video streams has made great progress in recent years.However,there are also some problems that must be solved:(1)In order to improv...With the rapid development of deep learning technology,behavior recognition based on video streams has made great progress in recent years.However,there are also some problems that must be solved:(1)In order to improve behavior recognition performance,the models have tended to become deeper,wider,and more complex.However,some new problems have been introduced also,such as that their real-time performance decreases;(2)Some actions in existing datasets are so similar that they are difficult to distinguish.To solve these problems,the ResNet34-3DRes18 model,which is a lightweight and efficient two-dimensional(2D)and three-dimensional(3D)fused model,is constructed in this study.The model used 2D convolutional neural network(2DCNN)to obtain the feature maps of input images and 3D convolutional neural network(3DCNN)to process the temporal relationships between frames,which made the model not only make use of 3DCNN’s advantages on video temporal modeling but reduced model complexity.Compared with state-of-the-art models,this method has shown excellent performance at a faster speed.Furthermore,to distinguish between similar motions in the datasets,an attention gate mechanism is added,and a Res34-SE-IM-Net attention recognition model is constructed.The Res34-SE-IM-Net achieved 71.85%,92.196%,and 36.5%top-1 accuracy(The predicting label obtained from model is the largest one in the output probability vector.If the label is the same as the target label of the motion,the classification is correct.)respectively on the test sets of the HMDB51,UCF101,and Something-Something v1 datasets.展开更多
基金This research is supported by the Science and Technology Department of Jilin Province[20210202128NC http://kjt.jl.gov.cn]The People’s Republic of China Ministry of Science and Technology[2018YFF0213606-03 http://www.most.gov.cn]+1 种基金Jilin Province Development and Reform Commission[2019C021 http://jldrc.jl.gov.cn]the Science and Technology Bureau of Changchun City[21ZGN27 http://kjj.changchun.gov.cn].
文摘With the increasing intensive and large-scale development of the sika deer breeding industry,it is crucial to assess the health status of the sika deer by monitoring their behaviours.A machine vision-based method for the behaviour recognition of sika deer is proposed in this paper.Google Inception Net(GoogLeNet)is used to optimise the model in this paper.First,the number of layers and size of the model were reduced.Then,the 5×5 convolution was changed to two 3×3 convolutions,which reduced the parameters and increased the nonlinearity of the model.A 5×5 convolution kernel was used to replace the original convolution for extracting coarse-grained features and improving the model’s extraction ability.A multi-scale module was added to the model to enhance the multi-faceted feature extraction capability of the model.Simultaneously,the Squeeze-and-Excitation Networks(SE-Net)module was included to increase the channel’s attention and improve the model’s accuracy.The dataset’s images were rotated to reduce overfitting.For image rotation,the angle wasmultiplied by 30°to obtain the dataset enhanced by rotation operations of 30°,60°,90°,120°and 150°.The experimental results showed that the recognition rate of this model in the behaviour of sika deer was 98.92%.Therefore,the model presented in this paper can be applied to the behaviour recognition of sika deer.The results will play an essential role in promoting animal behaviour recognition technology and animal health monitoring management.
基金the National Science Fund for Distinguished Young Scholars,No.61425002the National Natural Science Foundation of China,Nos.91748104,61632006,61877008+3 种基金Program for ChangJiang Scholars and Innovative Research Team in University,No.IRT_15R07Program for the Liaoning Distinguished Professor,Program for Dalian High-level Talent Innovation Support,No.2017RD11the Scientific Research fund of Liaoning Provincial Education Department,No.L2019606the Science and Technology Innovation Fund of Dalian,No.2018J12GX036.
文摘With the rapid development of deep learning technology,behavior recognition based on video streams has made great progress in recent years.However,there are also some problems that must be solved:(1)In order to improve behavior recognition performance,the models have tended to become deeper,wider,and more complex.However,some new problems have been introduced also,such as that their real-time performance decreases;(2)Some actions in existing datasets are so similar that they are difficult to distinguish.To solve these problems,the ResNet34-3DRes18 model,which is a lightweight and efficient two-dimensional(2D)and three-dimensional(3D)fused model,is constructed in this study.The model used 2D convolutional neural network(2DCNN)to obtain the feature maps of input images and 3D convolutional neural network(3DCNN)to process the temporal relationships between frames,which made the model not only make use of 3DCNN’s advantages on video temporal modeling but reduced model complexity.Compared with state-of-the-art models,this method has shown excellent performance at a faster speed.Furthermore,to distinguish between similar motions in the datasets,an attention gate mechanism is added,and a Res34-SE-IM-Net attention recognition model is constructed.The Res34-SE-IM-Net achieved 71.85%,92.196%,and 36.5%top-1 accuracy(The predicting label obtained from model is the largest one in the output probability vector.If the label is the same as the target label of the motion,the classification is correct.)respectively on the test sets of the HMDB51,UCF101,and Something-Something v1 datasets.
