期刊文献+

An Overview and Perspectives On Bidirectional Intelligence: Lmser Duality, Double IA Harmony,and Causal Computation 被引量:3

An Overview and Perspectives On Bidirectional Intelligence: Lmser Duality, Double IA Harmony,and Causal Computation
下载PDF
导出
摘要 Advances on bidirectional intelligence are overviewed along three threads,with extensions and new perspectives.The first thread is about bidirectional learning architecture,exploring five dualities that enable Lmser six cognitive functions and provide new perspectives on which a lot of extensions and particularlly flexible Lmser are proposed.Interestingly,either or two of these dualities actually takes an important role in recent models such as U-net,ResNet,and Dense Net.The second thread is about bidirectional learning principles unified by best yIng-yAng(IA)harmony in BYY system.After getting insights on deep bidirectional learning from a bird-viewing on existing typical learning principles from one or both of the inward and outward directions,maximum likelihood,variational principle,and several other learning principles are summarised as exemplars of the BYY learning,with new perspectives on advanced topics.The third thread further proceeds to deep bidirectional intelligence,driven by long term dynamics(LTD)for parameter learning and short term dynamics(STD)for image thinking and rational thinking in harmony.Image thinking deals with information flow of continuously valued arrays and especially image sequence,as if thinking was displayed in the real world,exemplified by the flow from inward encoding/cognition to outward reconstruction/transformation performed in Lmser learning and BYY learning.In contrast,rational thinking handles symbolic strings or discretely valued vectors,performing uncertainty reasoning and problem solving.In particular,a general thesis is proposed for bidirectional intelligence,featured by BYY intelligence potential theory(BYY-IPT)and nine essential dualities in architecture,fundamentals,and implementation,respectively.Then,problems of combinatorial solving and uncertainty reasoning are investigated from this BYY IPT perspective.First,variants and extensions are suggested for AlphaGoZero like searching tasks,such as traveling salesman problem(TSP)and attributed graph matching(AGM)that ar Advances on bidirectional intelligence are overviewed along three threads, with extensions and new perspectives. The first thread is about bidirectional learning architecture, exploring five dualities that enable Lmser six cognitive functions and provide new perspectives on which a lot of extensions and particularlly flexible Lmser are proposed. Interestingly, either or two of these dualities actually takes an important role in recent models such as U-net, ResNet, and DenseNet. The second thread is about bidirectional learning principles unified by best yIng-yAng(IA)harmony in BYY system. After getting insights on deep bidirectional learning from a bird-viewing on existing typical learning principles from one or both of the inward and outward directions,maximum likelihood, variational principle, and several other learning principles are summarised as exemplars of the BYY learning, with new perspectives on advanced topics. The third thread further proceeds to deep bidirectional intelligence, driven by long term dynamics(LTD) for parameter learning and short term dynamics(STD) for image thinking and rational thinking in harmony. Image thinking deals with information flow of continuously valued arrays and especially image sequence, as if thinking was displayed in the real world, exemplified by the flow from inward encoding/cognition to outward reconstruction/transformation performed in Lmser learning and BYY learning. In contrast,rational thinking handles symbolic strings or discretely valued vectors, performing uncertainty reasoning and problem solving.In particular, a general thesis is proposed for bidirectional intelligence, featured by BYY intelligence potential theory(BYY-IPT)and nine essential dualities in architecture, fundamentals, and implementation, respectively. Then, problems of combinatorial solving and uncertainty reasoning are investigated from this BYY IPT perspective. First, variants and extensions are suggested for Alpha Go Zero like searching tasks, such as traveling salesman problem(TSP) and attr
作者 Lei Xu
出处 《IEEE/CAA Journal of Automatica Sinica》 SCIE EI CSCD 2019年第4期865-893,共29页 自动化学报(英文版)
基金 supported by the Zhi-Yuan Chair Professorship Start-up Grant (WF220103010) from Shanghai Jiao Tong University
关键词 Autoencoder LMSER DUALITY outward attention associative recall concept formation imagining pattern transformation STD vs LTD RPCL skip connection feedback variational least redundancy Bayesian Ying Yang IA system best HARMONY best matching image THINKING rational THINKING INTELLIGENCE potential theory Alpha-TSP Alpha-AGM graph matching ME Player BYY Follower constraint satisfaction CAUSAL potential theory Autoencoder LMSER duality outward attention associative recall concept formation imagining pattern transformation STD vs LTD RPCL skip connection feedback variational least redundancy Bayesian Ying Yang IA system best harmony best matching image thinking rational thinking intelligence potential theory Alpha-TSP Alpha-AGM graph matching ME Player BYY Follower constraint satisfaction causal potential theory
  • 相关文献

参考文献2

二级参考文献100

  • 1李未,计算机科学,1993年,20卷,1页 被引量:1
  • 2潘云鹤,浙江大学学报,1993年,27卷,3期,363页 被引量:1
  • 3潘云鹤,模式识别与人工智能,1991年,2期,7页 被引量:1
  • 4何新贵,知识处理与专家系统,1990年 被引量:1
  • 5钱学森,关于思维科学,1986年 被引量:1
  • 6Xu L. Bayesian Ying-Yang system,best harmony learning,and five action circling.A special issue on Emerging Themes on Information Theory and Bayesian Approach[J].Frontiers of Electrical and Electronic Engineering in China,2010,(03):281-328. 被引量:1
  • 7Xu L. Bayesian-Kullback coupled YING-YANG machines:Unified learning and new results on vector quantization[A].Cambridge,MA:The MIT Press,. 被引量:1
  • 8Xn L. Codimensional matrix pairing perspective of BYY harmony learning:Hierarchy of bilinear systems,joint decomposition of data-covariance,and applications of network biology.A special issue on Machine Learning and Intelligence Science,1ScIDE2010 (A)[J].Frontiers of Electrical and Electronic Engineering in China,2011,(l):86-119. 被引量:1
  • 9Xu L. Advances on BYY harmony learning:Information theoretic perspective,generalized projection geometry,and independent factor autodeternination[J].IEEE Transactions on Neural Networks,2004,(04):885-902. 被引量:1
  • 10Xu L. Temporal BYY encoding,Markovian state spaces,and space dimension determination[J].IEEE Transactions on Neural Networks,2004,(05):1276-1295. 被引量:1

共引文献31

同被引文献7

引证文献3

二级引证文献5

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部