Visual simultaneous localization and mapping (SLAM) provides mapping and self-localization results for a robot in an unknown environment based on visual sensors, that have the advantages of small volume, low power con...Visual simultaneous localization and mapping (SLAM) provides mapping and self-localization results for a robot in an unknown environment based on visual sensors, that have the advantages of small volume, low power consumption, and richness of information acquisition. Visual SLAM is essential and plays a significant role in supporting automated and intelligent applications of robots. This paper presents the key techniques of visual SLAM, summarizes the current research status, and analyses the new trends of visual SLAM research and development. Finally, specific applications of visual SLAM in restricted environments, including deep space and indoor scenarios, are discussed.展开更多
The high demand for rapid wound healing has spurred the development of multifunctional and smart bioadhesives with strong bioadhesion,antibacterial effect,real-time sensing,wireless communication,and on-demand treatme...The high demand for rapid wound healing has spurred the development of multifunctional and smart bioadhesives with strong bioadhesion,antibacterial effect,real-time sensing,wireless communication,and on-demand treatment capabilities.Bioadhesives with bio-inspired structures and chemicals have shown unprecedented adhesion strengths,as well as tunable optical,electrical,and bio-dissolvable properties.Accelerated wound healing has been achieved via directly released antibacterial and growth factors,material or drug-induced host immune responses,and delivery of curative cells.Most recently,the integration of biosensing and treatment modules with wireless units in a closed-loop system yielded smart bioadhesives,allowing real-time sensing of the physiological conditions(e.g.,pH,temperature,uric acid,glucose,and cytokine)with iterative feedback for drastically enhanced,stage-specific wound healing by triggering drug delivery and treatment to avoid infection or prolonged inflammation.Despite rapid advances in the burgeoning field,challenges still exist in the design and fabrication of integrated systems,particularly for chronic wounds,presenting significant opportunities for the future development of next-generation smart materials and systems.展开更多
针对室内环境下的2D激光同步定位与制图(simultaneous localization and mapping,SLAM)问题,提出一种改进的扫描匹配方法,扫描到子图匹配。用连续的激光扫描帧构建子图,对齐新的扫描帧到邻近的子图以产生约束,通过高斯牛顿求解约束并估...针对室内环境下的2D激光同步定位与制图(simultaneous localization and mapping,SLAM)问题,提出一种改进的扫描匹配方法,扫描到子图匹配。用连续的激光扫描帧构建子图,对齐新的扫描帧到邻近的子图以产生约束,通过高斯牛顿求解约束并估计新的子图,利用Ceres优化来进行闭环,生成全局一致地图。经在室内条件下的测试,定位误差控制在0.4 m以下,制图误差控制在0.5 m左右,在激光匹配效率方面,相比传统方法提高了38.24%,实验结果表明,该方法可以有效提高定位与制图的精度和激光匹配效率。展开更多
视觉导航技术是保证机器人自主移动的关键技术之一。为了从整体上把握当前国际上最新的视觉导航研究动态,全面评述了仿生机器人视觉导航技术的研究进展,重点分析了视觉SLAM(Simultaneous Local-ization and Mapping)、闭环探测、视觉返...视觉导航技术是保证机器人自主移动的关键技术之一。为了从整体上把握当前国际上最新的视觉导航研究动态,全面评述了仿生机器人视觉导航技术的研究进展,重点分析了视觉SLAM(Simultaneous Local-ization and Mapping)、闭环探测、视觉返家三个关键问题的研究现状及存在的问题。提出了一个新的视觉SLAM算法框架,给出了待解决的关键理论问题,并对视觉导航技术发展的难点及未来趋势进行了总结。展开更多
A critical component of visual simultaneous localization and mapping is loop closure detection(LCD),an operation judging whether a robot has come to a pre-visited area.Concretely,given a query image(i.e.,the latest vi...A critical component of visual simultaneous localization and mapping is loop closure detection(LCD),an operation judging whether a robot has come to a pre-visited area.Concretely,given a query image(i.e.,the latest view observed by the robot),it proceeds by first exploring images with similar semantic information,followed by solving the relative relationship between candidate pairs in the 3D space.In this work,a novel appearance-based LCD system is proposed.Specifically,candidate frame selection is conducted via the combination of Superfeatures and aggregated selective match kernel(ASMK).We incorporate an incremental strategy into the vanilla ASMK to make it applied in the LCD task.It is demonstrated that this setting is memory-wise efficient and can achieve remarkable performance.To dig up consistent geometry between image pairs during loop closure verification,we propose a simple yet surprisingly effective feature matching algorithm,termed locality preserving matching with global consensus(LPM-GC).The major objective of LPM-GC is to retain the local neighborhood information of true feature correspondences between candidate pairs,where a global constraint is further designed to effectively remove false correspondences in challenging sceneries,e.g.,containing numerous repetitive structures.Meanwhile,we derive a closed-form solution that enables our approach to provide reliable correspondences within only a few milliseconds.The performance of the proposed approach has been experimentally evaluated on ten publicly available and challenging datasets.Results show that our method can achieve better performance over the state-of-the-art in both feature matching and LCD tasks.We have released our code of LPM-GC at https://github.com/jiayi-ma/LPM-GC.展开更多
基金The National Key Research and Development Program of China (2016YFB0502102)The National Natural Science Foundation of China (41471388).
文摘Visual simultaneous localization and mapping (SLAM) provides mapping and self-localization results for a robot in an unknown environment based on visual sensors, that have the advantages of small volume, low power consumption, and richness of information acquisition. Visual SLAM is essential and plays a significant role in supporting automated and intelligent applications of robots. This paper presents the key techniques of visual SLAM, summarizes the current research status, and analyses the new trends of visual SLAM research and development. Finally, specific applications of visual SLAM in restricted environments, including deep space and indoor scenarios, are discussed.
基金supported by the National Institute of Biomedical Imaging and Bioengineering of the National Institutes of Health under Award No.R21EB030140the National Heart,Lung,and Blood Institute of the National Institutes of Health under Award Number R61HL154215,the National Science Foundation(NSF)(Grant No.ECCS-1933072)Penn State University.Y.L.would like to acknowledge the support of the Natural Science Foundation of China under Grant 61825102,U21A20460.
文摘The high demand for rapid wound healing has spurred the development of multifunctional and smart bioadhesives with strong bioadhesion,antibacterial effect,real-time sensing,wireless communication,and on-demand treatment capabilities.Bioadhesives with bio-inspired structures and chemicals have shown unprecedented adhesion strengths,as well as tunable optical,electrical,and bio-dissolvable properties.Accelerated wound healing has been achieved via directly released antibacterial and growth factors,material or drug-induced host immune responses,and delivery of curative cells.Most recently,the integration of biosensing and treatment modules with wireless units in a closed-loop system yielded smart bioadhesives,allowing real-time sensing of the physiological conditions(e.g.,pH,temperature,uric acid,glucose,and cytokine)with iterative feedback for drastically enhanced,stage-specific wound healing by triggering drug delivery and treatment to avoid infection or prolonged inflammation.Despite rapid advances in the burgeoning field,challenges still exist in the design and fabrication of integrated systems,particularly for chronic wounds,presenting significant opportunities for the future development of next-generation smart materials and systems.
文摘视觉导航技术是保证机器人自主移动的关键技术之一。为了从整体上把握当前国际上最新的视觉导航研究动态,全面评述了仿生机器人视觉导航技术的研究进展,重点分析了视觉SLAM(Simultaneous Local-ization and Mapping)、闭环探测、视觉返家三个关键问题的研究现状及存在的问题。提出了一个新的视觉SLAM算法框架,给出了待解决的关键理论问题,并对视觉导航技术发展的难点及未来趋势进行了总结。
基金supported by the Key Research and Development Program of Hubei Province(2020BAB113)。
文摘A critical component of visual simultaneous localization and mapping is loop closure detection(LCD),an operation judging whether a robot has come to a pre-visited area.Concretely,given a query image(i.e.,the latest view observed by the robot),it proceeds by first exploring images with similar semantic information,followed by solving the relative relationship between candidate pairs in the 3D space.In this work,a novel appearance-based LCD system is proposed.Specifically,candidate frame selection is conducted via the combination of Superfeatures and aggregated selective match kernel(ASMK).We incorporate an incremental strategy into the vanilla ASMK to make it applied in the LCD task.It is demonstrated that this setting is memory-wise efficient and can achieve remarkable performance.To dig up consistent geometry between image pairs during loop closure verification,we propose a simple yet surprisingly effective feature matching algorithm,termed locality preserving matching with global consensus(LPM-GC).The major objective of LPM-GC is to retain the local neighborhood information of true feature correspondences between candidate pairs,where a global constraint is further designed to effectively remove false correspondences in challenging sceneries,e.g.,containing numerous repetitive structures.Meanwhile,we derive a closed-form solution that enables our approach to provide reliable correspondences within only a few milliseconds.The performance of the proposed approach has been experimentally evaluated on ten publicly available and challenging datasets.Results show that our method can achieve better performance over the state-of-the-art in both feature matching and LCD tasks.We have released our code of LPM-GC at https://github.com/jiayi-ma/LPM-GC.
