L3 F-TOUCH: A Wireless GelSight with Decoupled Tactile and Three-Axis Force Sensing

GelSight sensors that estimate contact geometry and force by reconstructing the deformation of their soft elastomer from images would yield poor force measurements when the elastomer deforms uniformly or reaches deformation saturation. Here we present an L3 F-TOUCH sensor that considerably en- hances the three-axis force sensing capability of typical GelSight sensors. Specifically, the L3 F-TOUCH sensor comprises: (i) an elastomer structure resembling the classic GelSight sensor design for fine-grained contact geometry sensing; and (ii) a mechan- ically simple suspension structure to enable three-dimensional elastic displacement of the elastomer structure upon contact. Such displacement is tracked by detecting the displacement of an ARTag and is transformed to three-axis contact force via calibration. We further revamp the sensor’s optical system by fixing the ARTag on the base and reflecting it to the same camera viewing the elastomer through a mirror. As a result, the tactile and force sensing modes can operate independently, but the entire L3 F-TOUCH remains Light-weight and Low- cost while facilitating a wireLess deployment. Evaluations and experiment results demonstrate that the proposed L3 F-TOUCH sensor compromises GelSight’s limitation in force sensing and is more practical compared with equipping commercial three-axis force sensors. Thus, the L3 F-TOUCH could further empower existing Vision-based Tactile Sensors (VBTSs) in replication and deployment. The design is open-sourced at: https://github.com/ wangmeng13thu/L3-F-TOUCH.