Research Analyzer
← Back ICRA 2024

Spatial-Aware Dynamic Lightweight Self-Supervised Monocular Depth Estimation

Linna Song, Dianxi Shi, Jianqiang Xia, Qianying Ouyang, Ziteng Qiao, Songchang Jin, Shaowu Yang

PDF

Abstract

Self-supervised monocular depth estimation has at- tracted extensive attention in recent years. Lightweight depth esti- mation methods are crucial for resource-constrained edge devices. However, existing lightweight methods often encounter the chal- lenge of limited representation capacity and increased computa- tional resource consumption for image reconstruction. To alleviate these issues, we propose a novel spatial-aware dynamic lightweight monocular depth estimation method (SAD-Depth). Specifically, we propose a spatial-aware dynamic encoder, which can capture spa- tial information of the input and generate input-adaptive dynamic convolutions, thereby significantly enhancing the model’s adapt- ability to complex scenes. Meanwhile, we propose a multi-scale sub-pixel lightweight decoder that generates high-quality depth maps while maintaining a lightweight design. Experimental results demonstrate that our proposed SAD-Depth exhibits superiority in both model size and inference speed, achieving state-of-the-art performance on the KITTI benchmark.

Index terms

Deep Learning for Visual Perception Deep Learning Methods Mapping