C.E.E. : Command Everything with Eyes, Multi-modal gaze-based interface for everyday Interaction

Abstract

Although gaze interface has high potential to be a pervasive interface, previous researches focused on enhancing performance to control single display device and researches of gaze interaction method with multi devices are lacking. To improve the gaze interface as an interface for everyday interaction, this paper proposes a multi-modal wearable gaze interface optimized for multi devices control. First, we developed high performance wearable gaze interface which can be fully customized for multi device control. A manual input modality for confirmation was added to improve accuracy and avoid Midas touch. Second, an infrared boundary+ID markers and its novel recognition algorithm are suggested and they enabled immediate device switching maintaining high robustness in various light condition. To verify the appropriateness of the developed gaze interface for multi displays control, user tests controlling three display devices were conducted and we compared performance with conventional interfaces, touch and mouse. The performance is similar to touch and better than mouse. In user interviews, the developed gaze interface showed better scores in most factors than other interfaces. Finally, by developing gaze sound ID recognition method, we expand the usability of gaze interface to control non-display device.