S. Wu, X. Zhang*, S. Zhang, Z. Song, R. Wang, and J. Yuan. MPOC-SLAM: An RGB-D SLAM System with Motion Probability and Object Category in High Dynamic Environments. IEEE/ASME Transactions on Mechatronics(T-MECH), 2024, accepted.

Abstract

       The performance of simultaneous localization and mapping (SLAM) is significantly impacted by dynamic objects. Existing dynamic SLAM methods still suffer from some major issues, such as insufficient use of semantic information, losing track when dynamic objects occupy the field of view, and inability to achieve real-time processing. In this paper, we present MPOC-SLAM, an RGB-D SLAM system capable of high-performance, real-time work in high dynamic environments. Considering intensive semantic information, our method introduces the concepts of motion probability (MP) and object category (OC), and tightly integrates them within the whole SLAM system. Firstly, a priority feature extraction strategy is proposed based on MP, and then a dual-constraint feature matching method is designed with the adaptive probability threshold and category consistency. Both methods reduce the influence of dynamic objects in the extraction and association process. Secondly, to speed up the process of calculating reprojection errors, a semantic-guided geometric method with the partitioning hypothetico-deductive method is presented. The semantic-guided geometric method and instance segmentation are then fused through the Variance Weighted Fusion (VWF) with their confidences. Finally, as a more important part of SLAM, dynamic-aware weights are added to the original pose optimization, which assigns larger weights to static feature points and map points to reduce their alteration during optimization. We perform evaluations on the TUM public dataset and real-world environments. Compared with ORB-SLAM2, the percentage reduction of RMSE of ATE is as high as 98.72%. Results show that MPOC-SLAM realizes a significant improvement in accuracy as well as a more robust and real-time performance compared with other state-of-the-art dynamic SLAM methods.