期刊文献+

模拟初级视皮层脉冲神经元的动作识别系统 被引量:1

Action Recognition System with Analog Model of Neurons in Primate Visual Cortex
下载PDF
导出
摘要 大脑中致力于运动信息处理的区域是初级视皮层(V1)和中颞区(MT).目前有关运动模式是在哪个区域完成的,存在不同的推测.迄今大多数关于动作识别的研究都是围绕MT阶段展开的.本文针对V1阶段获得的信息能否进行动作识别的问题展开研究,提出了模拟初级视皮层(V1)脉冲神经元的动作识别系统.该系统首先采用3D Gabor滤波器及其组合分别模拟初级视觉皮层中简单、复杂细胞的感受野,以此对视频图像进行处理,从而获取对运动速度和方向敏感的运动能量,并通过V1阶段的环绕抑制来增强运动能量和降低噪声的影响.其次,采用Integrate-and-fire脉冲神经元模型模拟初级视觉皮层的神经元,将获取的运动信息转换为神经元响应的脉冲链.最后,根据脉冲链平均发放率的特性提取运动特征向量,采用支持向量机(Support vector machine,SVM)作为分类器.在Weiziman数据库下进行测试,实验结果表明,V1阶段获得的信息可以进行动作的识别. There are several theories which speculate on how and where pattern motion is computed from visual cortex or middle temporal area (V1/MT) dedicated to motion. So far, most researches in action recognition remain rooted in MT. This paper proposed a method of human action recognition by modeling the human V1 neurons for information obtained in V1 which could benefit action recognition. The method firstly simulates the classical receptive field (CRF) of simple and complex cells in the primary visual cortex with 3D Gabor filter and its combination to process the video sequence, in order to obtain the sport energy that is sensitive to the sport speed and direction. Meanwhile, it enhances the sport energy and reduces the influence of noise through surround inhibition in V1. Secondly, conductance-driven integrate and fire neuron model is used to simulate the primary visual cortex neuron, by which motion information is converted into spike train. Finally, the mean firing rate of spike train forms a feature vector that captures the characteristic of human actions in this video sequence. Using support vector machine (SVM), the method is tested on the Weizmann action dataset. The obtained impressive results show that the information obtained in phase V1 could benefit action recognition.
出处 《自动化学报》 EI CSCD 北大核心 2012年第12期1975-1984,共10页 Acta Automatica Sinica
基金 国家自然科学基金(60972158) 湖北省自然科学基金计划重点项目(2011CDA078) 中南民族大学中央高校基本科研业务费专项资金项目(CZQ12011)资助~~
关键词 动作识别 3D Gabor滤波器 环绕抑制 脉冲神经元模型 Action recognition, 3D Gabor filter, surround inhibition, spiking neural model
  • 相关文献

参考文献33

  • 1谌先敢,刘娟,高智勇,刘海华.基于累积边缘图像的现实人体动作识别[J].自动化学报,2012,38(8):1380-1384. 被引量:15
  • 2黄飞跃,徐光祐.视角无关的动作识别[J].软件学报,2008,19(7):1623-1634. 被引量:14
  • 3谷军霞,丁晓青,王生进.基于人体行为3D模型的2D行为识别[J].自动化学报,2010,36(1):46-53. 被引量:16
  • 4罗四维等著..视觉信息认知计算理论[M].北京:科学出版社,2010:222.
  • 5Casile A, Giese M. Roles of motion and form in biologi- cal motion recognition. In: Proceedings of the 2003 Joint International Conference on Artificial Networks and Neural Information Processing. Berlin, Heidelberg: Springer-Verlag 2003. 854-862. 被引量:1
  • 6Mingolla E, Todd J T, Normal J F. The perception of globally coherent motion. Vision Research, 1992, 32(6): 1015-1031. 被引量:1
  • 7Simoncelli E P, tteeger D J. A model of neuronal responses in visual area MT. Vision Research, 1998, 38(5): 743-761. 被引量:1
  • 8Bayerl P, Neumann It. Disambiguating visual motion through contextual feedback modulation. Neural Computa- tion, 2004, 16(10): 2041-2066. 被引量:1
  • 9Bayerl P, Neumann H. A fast biologically inspired algo- rithm for recurrent motion estimation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2007, 29(2): 246- 260. 被引量:1
  • 10Jhuang It, Serre T, Wolf L, Poggio T. A biologically inspired system for action recognition. In: Proceedings of the llth IEEE International Conference on Computer Vision. Rio de Janeiro, Brazil: IEEE, 2007. 1-8. 被引量:1

二级参考文献40

  • 1Davis J W, Bobick A F. The representation and recognition of human movement using temporal templates. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. San Juan, Puerto Rico: IEEE, 1997. 928-934. 被引量:1
  • 2Wang L, Suter D. Informative shape representations for human action recognition. In: Proceedings of the 18th International Conference on Pattern Recognition. Hong Kong, China: IEEE, 2006. 1266-1269. 被引量:1
  • 3Mohiuddin A, Lee S W. Human action recognition using shape and CLG-motion flow from multiview image sequences. Pattern Recognition, 2008, 41(7): 2237-2252. 被引量:1
  • 4Weinland D, Boyer E, Ronfard R. Action recognition from arbitrary views using 3D exemplars. In: Proceedings of the 11th International Conference on Computer Vision. Rio de Janeiro, Brazil: IEEE, 2007. 1-7. 被引量:1
  • 5Ren H B, Xu G Y. Human action recognition with primitivebased coupled-HMM. In: Proceedings of the 16th International Conference on Pattern Recognition. Quebec, Canada: IEEE, 2002. 494-498. 被引量:1
  • 6Shen Y P, Ashraf N, Foroosh H. Action recognition based on homography constraints. In: Proceedings of the 19th International Conference on Pattern Recognition. Tampa, USA: IEEE, 2008. 1-4. 被引量:1
  • 7Yilmaz A, Shah M. Matching actions in presence of camera motion. Computer Vision and Image Understanding, 2006, 104(2-3): 221-231. 被引量:1
  • 8Johansson G. Visual motion perception. Scientific American, 1975, 232(2): 76-88. 被引量:1
  • 9Gu J X, Ding X Q, Wang S J, Wu Y S. Full body trackingbased human action recognition. In: Proceedings of the 19th International Conference on Pattern Recognition. Tampa, USA: IEEE, 2008. 1-4. 被引量:1
  • 10Gu J X, Ding X Q, Wang S J, Wu Y S. Adaptive particle filter with body part segmentation for full body tracking. In: Proceedings of IEEE Conference on Automatic Face and Gesture Recognition. Amsterdam, The Netherlands: IEEE, 2008. 1-6. 被引量:1

共引文献41

同被引文献14

  • 1Escobar M J, Masson G S, Vieville T, et al. Action recognition using a bio-inspired feedforward spiking network[J]. International Journal of Computer Vision, 2009, 82(3): 284-301. 被引量:1
  • 2Simoncelli E P, Heeger D J. A model of neuronal responses in visual area MT [ J ]. Vision Research, 1998, 38(5) : 743-761. 被引量:1
  • 3Escobar M J, Masson G S, Vieville T, et al. Action recognition using a bio-inspired feedforward spiking network[ J ]. International Journal of Computer Vision, 2009, 82(3): 284-301. 被引量:1
  • 4Gilbert C D, Wiesel T N. Clustered intrinsic connections in cat visual cortex [ J ]. The Journal of Neuroscience, 1983, 3(5) : 1116-1133. 被引量:1
  • 5Van Hooser S D, Heimel J A, Chung S, et al. Lack of patchy horizontal connectivity in primary visual cortex of a mammal without orientation maps [ J ]. The Journal of Neuroscience, 2006, 26 (29) : 7680-7692. 被引量:1
  • 6MeLaughlin D, Shapley R, Shelley M, et al. A neuronal network model of macaque primary visual cortex ( V1 ) : Orientation selectivity and dynamics in the input layer 4CoL [ J ]. Proceedings of the National Academy of Sciences, 2000, 97 (14) : 8087-8092. 被引量:1
  • 7Buzas P, Kovatcs K, Ferecsko A S, et al. Model - based analysis of excitatory lateral eonneetions in the visual cortex [ J ]. Journal of Comparative Neurology,2006, 499(6) : 861-881. 被引量:1
  • 8Hunt J J, Bosking W H, Goodhill G J. Statistical structure of lateral connections in the primary visual cortex[ J]. Neural Systems and Circuits, 2011, 1 (1): 3. 被引量:1
  • 9Arkachar P, Wagh M D. Criticality of lateral inhibition for edge enhancement in neural systems [ J ]. Neurocomputing, 2007, 70(4): 991-999. 被引量:1
  • 10Wielaard D J, Shelley M, McLaughlin D, et al. How simple cells are made in a nonlinear network model of the visual cortex [ J ]. The Journal of Neuroscience, 2001, 21(14): 5203-5211. 被引量:1

引证文献1

二级引证文献1

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部