SAMLoc: Structure-Aware Constraints with Multi-Task Distillation for Long-Term Visual Localization
Jian Ning, Yunzhou Zhang, Xinge Zhao, Sonya Coleman, Kunmo Li, Dermot Kerr
Abstract
Real-time and robust long-term visual localization is a crucial technology for autonomous driving. Season and illumination variance make this problem more challenging. At present, most of excellent visual localization algorithms cannot run in real-time on devices with limited computing resources. In this paper, we propose SAMLoc, a structure- aware and self-supervised visual localization system, for fast and robust 6-DoF localization. To obtain structural features in the scene, we propose local and global structure-aware constraints using edge information. Then, we integrate the structure-aware constraints into the hierarchical localization network of multi-task distillation, which significantly reduces the feature extraction time while ensuring localization accuracy. As a result, real-time and robust large-scale localization can be achieved on mobile devices. Experimental results on public datasets show that our system can achieve high localization accuracy and have satisfactory real-time performance. Com- pared with several state-of-the-art visual localization systems, our framework achieves a competitive localization performance.