Using Eye Gaze and Body Location to Organize and Retrieve Information in Mixed Reality

This study proposes a new method for organizing and accessing information in MR environments by anchoring data to parts of the human body (such as the head or hands). The system utilizes Microsoft HoloLens 2 and eye-tracking technology to enable users to intuitively access virtual informa- tion through gaze-based operations. This approach introduces a relative spatial coordinate system based on the user’s body. User studies were conducted to verify the effectiveness of body- based tagging and information management in MR spaces. The results confirmed that this information access method is usable without issues, and it was revealed that rules exist governing the relationship between the access time and location of body-tagged information. These results suggest that body- based information tagging has the potential to enhance the usability of MR for everyday tasks.