Natural interaction for unmanned systems

Glenn Taylor; Ben Purman; Paul Schermerhorn; Guillermo Garcia-Sampedro; Matt Lanting; Michael Quist; Chris Kawatsu

doi:10.1117/12.2180008

22 May 2015 Natural interaction for unmanned systems

Glenn Taylor, Ben Purman, Paul Schermerhorn, Guillermo Garcia-Sampedro, Matt Lanting, Michael Quist, Chris Kawatsu

Proceedings Volume 9468, Unmanned Systems Technology XVII; 946805 (2015) https://doi.org/10.1117/12.2180008
Event: SPIE Defense + Security, 2015, Baltimore, MD, United States

Abstract

Military unmanned systems today are typically controlled by two methods: tele-operation or menu-based, search-andclick interfaces. Both approaches require the operator’s constant vigilance: tele-operation requires constant input to drive the vehicle inch by inch; a menu-based interface requires eyes on the screen in order to search through alternatives and select the right menu item. In both cases, operators spend most of their time and attention driving and minding the unmanned systems rather than on being a warfighter. With these approaches, the platform and interface become more of a burden than a benefit. The availability of inexpensive sensor systems in products such as Microsoft Kinect™ or Nintendo Wii™ has resulted in new ways of interacting with computing systems, but new sensors alone are not enough. Developing useful and usable human-system interfaces requires understanding users and interaction in context: not just what new sensors afford in terms of interaction, but how users want to interact with these systems, for what purpose, and how sensors might enable those interactions. Additionally, the system needs to reliably make sense of the user’s inputs in context, translate that interpretation into commands for the unmanned system, and give feedback to the user. In this paper, we describe an example natural interface for unmanned systems, called the Smart Interaction Device (SID), which enables natural two-way interaction with unmanned systems including the use of speech, sketch, and gestures. We present a few example applications SID to different types of unmanned systems and different kinds of interactions.

Citation Download Citation

Glenn Taylor, Ben Purman, Paul Schermerhorn, Guillermo Garcia-Sampedro, Matt Lanting, Michael Quist, and Chris Kawatsu "Natural interaction for unmanned systems", Proc. SPIE 9468, Unmanned Systems Technology XVII, 946805 (22 May 2015); https://doi.org/10.1117/12.2180008

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available