Human gaze and head rotation during navigation, exploration, and object manipulation in shared environments with robots

Tim Schreiter, Andrey Rudenko, Martin Magnusson and Achim J. Lilienthal
Proceedings of 2024 33rd IEEE International Conference on Robot and Human Interactive Communication (ROMAN)

Abstract

The human gaze is an important cue to signal intention, attention, distraction, and the regions of interest in the immediate surroundings. Gaze tracking can transform how robots perceive, understand, and react to people, enabling new modes of robot control, interaction, and collaboration. In this paper, we use gaze tracking data from a rich dataset of human motion (THÖR-MAGNI) to investigate the coordination between gaze direction and head rotation of humans engaged in various indoor activities involving navigation, interaction with objects, and collaboration with a mobile robot. In particular, we study the spread and central bias of fixations in diverse activities and examine the correlation between gaze direction and head rotation. We introduce various human motion metrics to enhance the understanding of gaze behavior in dynamic interactions. Finally, we apply semantic object labeling to decompose the gaze distribution into activity-relevant regions.

@INPROCEEDINGS{10731190,
  author={Schreiter, Tim and Rudenko, Andrey and Magnusson, Martin and Lilienthal, Achim J.},
  booktitle={2024 33rd IEEE International Conference on Robot and Human Interactive Communication (ROMAN)}, 
  title={Human Gaze and Head Rotation during Navigation, Exploration and Object Manipulation in Shared Environments with Robots}, 
  year={2024},
  volume={},
  number={},
  pages={1258-1265},
  keywords={Measurement;Navigation;Robot kinematics;Semantics;Dynamics;Human-robot interaction;Collaboration;Gaze tracking;Mobile robots;Labeling},
  doi={10.1109/RO-MAN60168.2024.10731190}}