Innovative Wearable Interface for Non-Visual Drone Control Developed by Jeonbuk National University

Introduction

Operating drones typically involves a screen that pilots must keep in view while controlling the aircraft. This reliance on visual monitoring can often limit a pilot's ability to effectively manage their surroundings, creating an urgent need for more intuitive methods of drone operation. In response, researchers at Jeonbuk National University have developed an innovative wearable interface that merges hand gestures with tactile feedback through abdominal vibrations, enabling users to control drones without the need for constant visual supervision.

The Innovation

Led by Professor Kee-Ho Yu in the Department of Aerospace Engineering, the research team includes researchers Myeong-Ho Shin and Dr. Giancarlo Eder Guerra Padilla. The new system utilizes a sensor worn on the back of the user's hand along with a belt equipped with 36 vibration motors. This setup allows users to issue commands through recognizable hand gestures, which are then translated by a computer into specific drone operations.

The interface not only allows users to send commands but also communicates the drone's three-dimensional position through unique vibration patterns that indicate direction, distance, and altitude.

Experiments and Findings

The system's efficacy was thoroughly evaluated through various trials, including gesture recognition tests, simulated flying activities, and even real-drone tasks. The research paper documenting their findings was published online on June 12, 2026, in the journal IEEE Robotics and Automation Letters.

Notably, the gesture recognition model showcased an impressive accuracy rate of 97.58% with a macro F1 score of 0.9773. In a simulated waypoint task involving novice users, the average completion time decreased significantly from 263 seconds in the initial trial to 186 seconds by the fifth trial. Participants also engaged in an indoor study where they completed 1,200 trials using the wearable belt without visual guidance, successfully identifying key parameters 82.75% of the time with an average response time of just 3.1 seconds.

User Experience and Future Applications

Prof. Yu expressed, "Our goal was to connect the user’s intent with precise information about the drone's location, instead of merely enhancing commands or feedback in isolation." The hand sensor allows for familiar gestures, while the vibrating waist device communicates spatial information through touch. In practical trials, one novice participant utilized the gesture controller under two conditions: with visual feedback and solely tactile guidance. Results revealed that while vision aided success in reaching targets across the board, tactile-only operation was still highly effective, completing 8 out of 9 trials.

It's crucial to note that while the findings indicate feasibility, further advancements are required for practical deployment. The trials highlighted the need for improved communication of distance and the minimization of response delays. Continuous studies are recommended under diverse outdoor conditions to enhance the system's performance.

Conclusion

This revolutionary wearable interface paves the way for a range of potential drone applications, including infrastructure inspection, search-and-rescue operations, and training scenarios. These compelling uses remain untested but point to an exciting future where drone operation could become far less reliant on visual screens, allowing users to interact freely with their environment. As this technology evolves, it holds promise for more efficient and effective drone management in various fields.

Reference

Original paper: Wearable Human–Drone Interface Gesture-Based Control and Vibrotactile Spatial Awareness
Published in: IEEE Robotics and Automation Letters
DOI: 10.1109/LRA.2026.3703244