期刊文献+

一种新的快速收敛的反向传播算法 被引量:8

Novel Quick Convergence Back-propagation Algorithm
下载PDF
导出
摘要 提出了一种新的快速的误差反向传播算法 .这种方法从神经网络的权值调节公式入手 ,通过避免过早饱和、加大权值调节的幅度等手段来加快收敛 .并通过对两个奇偶问题、一个函数逼近问题的仿真 ,验证了所提出的算法的有效性 .结果表明 ,所提出的算法在收敛速度等方面大大优于通常的BP(反向传播 )算法、带动量项的BP算法以及其他的一些改进的算法 . In this paper,in order to effectively speed up the weight convergence speed of neural network,a new back-propagation algorithm is proposed. Starting with the weight adjusting equation,the proposed algorithm speeds up the convergence speed by avoiding early saturation and by amplifying the range of weight adjusting.The efficacy of the proposed algorithm is verified by means of simulations on two parity problems,and a function approximation problem.The results show that the proposed algorithm improves considerably on the convergence speed of the general back-propagation algorithms,including when using momentum,and other improved algorithms.
作者 武妍 王守觉
出处 《同济大学学报(自然科学版)》 EI CAS CSCD 北大核心 2004年第8期1092-1095,共4页 Journal of Tongji University:Natural Science
基金 国家自然科学基金资助项目 (60 13 5 0 10 )
关键词 神经网络 反向传播 学习算法 neural network back-propagation learning algorithm
  • 相关文献

参考文献8

  • 1Yu X H,Chen G A.Efficient backpropagation learning using optimal learning rate and momentum[J].Neural Network,1997,10(3): 517-527. 被引量:1
  • 2Jacobs R A.Increasing rate of convergence through learning rate adaptation[J].Neural Networks,1988,1(4): 295-307. 被引量:1
  • 3Magoulas G D,Plagiananakos V P,Vrahatis M N.Globally convergent algorithms with local learning rates[J].IEEE Trans on Neural Networks,2002,13(3):774-779. 被引量:1
  • 4Trentin E.Networks with trainable amplitude of activation functions[J].Neural Networks,2001,14(4-5):471-493. 被引量:1
  • 5Eom K,Jung K,Sirisena H.Performance improvement of backpropagation algorithm by automatic activation function gain tuning using fuzzy logic[J].Neurocomputing,2003,50:439-460. 被引量:1
  • 6Chen C T,Chang W D.A feedforward neural network with function shape autotuning[J].Neural Networks,1996,9(4): 627-641. 被引量:1
  • 7Yam J Y F,Chow T W S.A weight initialization method for improving training speed in feedforward neural network[J].Neurocomputing,2000,30(1-4):219-232. 被引量:1
  • 8Zweiri Y H,Whidborne J F,Seneviratne L D.A three-term backpropagation algorithm[J].Neurocomputing,2003,50:305-318. 被引量:1

同被引文献51

引证文献8

二级引证文献60

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部