Research Analyzer
← Back ICRA 2023

CogniDaVinci: Towards Estimating Mental Workload Modulated by Visual Delays During Telerobotic Surgery -- an EEG-Based Analysis

Satyam Kumar, Deland Hu Liu, Frigyes Samuel Racz, Manuel Retana, Susheela Sharma, Fumiaki Iwane, Braden Murphy, Rory O'Keeffe, S. Farokh Atashzar, Farshid Alambeigi, José del R. Millán

PDF

Abstract

Communication latency in any delicate telerobotic operation (such as remote surgery over distance) would impose a significant challenge due to the temporal degradation of visual perception and can substantially affect the outcomes. Less is known, however, about the neurophysiological basis of how operators adapt/react to delayed visual feedback. Identification of such neural markers might provide novel ways for future applications to monitor the mental workload (MW). In this study, we recorded electroencephalography (EEG) data from nine users while performing a peg transfer task using the da Vinci Research Kit with three levels of induced visual delay in the video feedback. Our results suggest that spectral EEG-based features can provide markers of the operator’s MW modulated by arbitrary visual delay. We also show that the exposure to different visual delays could be successfully classified/detected solely from EEG data, using a Riemannian geometry-based classifier, which highlights the utility of EEG signals for detecting the effect of visual delay on brain activity.

Index terms

Medical Robots and Systems Brain-Machine Interfaces Physical Human-Robot Interaction