Research Analyzer
← Back ICRA 2023

Detecting Spatio-Temporal Relations by Combining a Semantic Map with a Stream Processing Engine

Lennart Niecksch, Henning Deeken, Thomas Wiemann

PDF

Abstract

Changes in topological spatial relations of objects are often strong indicators for state transitions in the underlying processes they are involved in. While various aspects of semantic mapping have been extensively researched, the reasoning about the temporal development of spatial relations of instances is often neglected. This paper presents a concept to combine a semantic map with a stream processing framework for live analysis of the spatio-temporal relation of objects, based on the map and information inferred from sensors streams. To demonstrate the functionality of our concept, we implemented a proof-of-concept system to track everyday events in an office environment. The presented application scenario clearly demonstrates the benefits of the proposed architecture for detecting and handling complex spatio-temporal events.

Index terms

Semantic Scene Understanding Human Detection and Tracking Big Data in Robotics and Automation