Driving nowadays is promisingly adapting the Voice User In- terface (VUI), which can let drivers utilize diverse applications with low effort. However, the VUI has innate usability issues such as turn-taking problem, short-term memory workload, control inefficiency, and error correction difficulty. To over- come these weaknesses, we explored the possibility of supple- menting the VUI with tactile interaction. As an early result, we present the Voice+Tactile interactions that augment the VUI using multi-touch inputs and high-resolution tactile outputs. We designed various Voice+Tactile interactions supporting dif- ferent VUI interaction stages, and derived four Voice+Tactile interaction themes: Status Feedback, Input Adjustment, Out- put Control, and Finger Feedforward. A user study showed the Voice+Tactile interactions not only improved the VUI efficiency but also its user experiences, while not incurring significant additional distraction overhead on driving. We hope these early results would open up new research questions to improve in-vehicle VUI with a tactile channel.
This research was presented in CHI'20 Paper. [acm dl] [video]
