KnuckleBoard: Knuckle-based Input in Augmented Reality while Sitting, Standing, and Walking

Sammanfattning

The way people engage with digital content has changed substantially as a result of Augmented Reality (AR), especially in dynamic, mobile scenarios. Input in AR, often essential in contexts for tasks like messaging or note-taking, typically relies on traditional methods such as mid-air keyboards and controllers. However, these input methods can result in user fatigue, require significant visual attention, and are not designed for use in public spaces. This makes them impractical for mobile contexts where users are not static, such as walking outside or using the subway. This study addresses these issues by exploring a novel on-body input method using haptic gloves, which leverages the knuckles as interactive buttons to provide tactile feedback. We conducted a controlled experiment with 18 participants while they were sitting, standing, and walking to assess this approach’s user-friendliness. From the preliminary evaluation of our proof of concept the findings revealed that despite a steeper learning curve, the knuckle input method was preferred in dynamic scenarios like walking due to its engaging nature and reduced need for visual focus. Conversely, controller-based interaction was favoured in static scenarios like sitting, owing to its accuracy and ease of use. Our findings suggest that using the knuckles as on-body landmarks for input, enhanced user experience and preference by leveraging the body memory users develop over time, suggesting that novel soft and wearable or on-skin interfaces can improve interaction by making it easier to locate and press buttons situated on our own body intuitively and without visual guidance.