摘要
同时定位和地图构建(SLAM)凭借其高能效和低功耗等特点在诸多领域应用前景广阔。然而,在传统的SLAM系统中仍存在一些问题:传统的视觉里程计中关键帧并不包含语义信息,移动机器人获取的图像信息较为单一,且在实际场景中关键帧总包含大量误匹配点和动态点。针对以上问题,本文提出一种语义SLAM思路。首先,为了能够匹配到正确且对应的特征点,摒弃动态点和误匹配点的干扰,提出了一种基于Lucas-Kanade光流法的相邻帧特征状态判别法,将这项功能作为新的线程加入ORB-SLAM3的视觉里程计部分,完成对部分传统SLAM框架的优化和改进工作。其次,针对传统SLAM系统前端视觉里程计获取的图像帧不包含任何语义信息的问题,使用基于YOLOV4的目标检测算法和融合全连接条件随机场CRF的Mask R-CNN语义分割算法对ORB-SLAM3中的关键帧图像进行处理,有效提高了机器人等智能设备对室内环境的感知能力。
Simultaneous localization and mapping(SLAM)has broad application prospects in many fields due to its high energy efficiency and low power consumption.However,there are still some problems in the traditional SLAM system:the key frame in the traditional visual odometer does not contain semantic information,the image information obtained by the mobile robot is relatively single,and the key frame in the actual scene always contains a large number of mismatched points and dynamic points.In response to the above problems,this paper proposes a new idea of semantic SLAM mapping technology.First,in order to find the correct and corresponding feature points,abandon the interference of dynamic points and mismatched points simultaneously,a method for judging the feature state of adjacent frames based on the Lucas-Kanade optical flow method is proposed,and this function is regarded as a new feature.The thread is added to the visual odometry part of ORB-SLAM3 to complete the optimization and improvement of part of the traditional SLAM framework.Secondly,in view of the problem that the image frame obtained by the front-end visual odometer of the traditional SLAM system does not contain any semantic information,the target detection algorithm based on YOLOV4 and the Mask R-CNN semantic segmentation algorithm fused with fully connected conditional random field CRF are used to compare ORB-SLAM3.The key frame image processing of the robot effectively improves the perception of the indoor environment of smart devices such as robots.
作者
邓晨
李宏伟
张斌
许智宾
肖志远
DENG Chen;LI Hongwei;ZHANG Bin;XU Zhibin;XIAO Zhiyuan(School of Information Engineering, Zhengzhou University, Zhengzhou 450052, China;School of Geoscience and Technology, Zhengzhou University, Zhengzhou 450052, China;School of Water Conservancy Science and Engineering, Zhengzhou University, Zhengzhou 450001, China)
出处
《测绘学报》
EI
CSCD
北大核心
2021年第11期1605-1616,共12页
Acta Geodaetica et Cartographica Sinica
基金
中国工程科技发展战略河南研究院战略咨询研究项目(2020HENZT07)。
