3-D Model-Based Pan-Tilt Multi-Camera System for High-Speed Wide-Area Volumetric Shooting
Adam Mail, Feiyue Wang, Kohei Shimasaki, Idaku Ishii
Abstract
Stereo matching between different cameras presents significant challenges, particularly for wide-area scan- ning systems using pan-tilt cameras with continuously changing orientations. This paper proposes a 3-D model-based multi pan-tilt camera system that establishes stereo correspondence between cameras by introducing a shared 3-D coordinate space derived from a reference model. Our approach re- duces matching complexity by leveraging 3-D model-based calibration, enabling scalable volumetric capture for real- world measurement and monitoring applications. To validate the proposed system, we conducted wide-area experiments on outdoor Heating, Ventilation, and Air Conditioning (HVAC) units. Each pan-tilt camera captured 25 high-resolution images, stitched into panoramic mosaics. Using 3-D reference points from a laser scanner, we established projective mappings through feature-point correspondence registration and mapped pixel coordinates to pan-tilt angles via linear interpolation. The experimental results demonstrated that multiple cam- era views can be directly aligned through their shared 3-D model, achieving stereo correspondence without appearance- based matching. Volumetric measurement through stereo DIC on 4000 frames captured at 400 fps successfully show 3-D vibration with sub-millimeter velocity accuracy and identified dominant frequencies, validating the system’s effectiveness for large-scale structural monitoring and industrial diagnostics.