TrackCap: Enabling Smartphones for 3D Interaction on Mobile Head-Mounted Displays

The latest generation of consumer market Head-mounted displays (HMD) now include self-contained inside-out tracking of head motions, which makes them suitable for mobile applications. However, 3D tracking of input devices is either not included at all or requires to keep the device in sight, so that it can be observed from a sensor mounted on the HMD. Both approaches make natural interactions cumbersome in mobile applications. TrackCap, a novel approach for 3D tracking of input devices, turns a conventional smartphone into a precise 6DOF input device for an HMD user. The device can be conveniently operated both inside and outside the HMD’s field of view, while it provides additional 2D input and output capabilities.

Citation

Peter Mohr, Markus Tatzgern, Tobias Langlotz, Andreas Lang, Dieter Schmalstieg and Denis Kalkofen. “TrackCap: Enabling Smartphones For 3D Interaction on Mobile Head-Mounted Displays.” In ACM CHI Conference On Human Factors in Computing Systems Proceedings, 2019.