Using a natural language and gesture interface for unmanned vehicles

Dennis Perzanowski; Alan C. Schultz; William Adams; Elaine Marsh

doi:10.1117/12.391644

10 July 2000 Using a natural language and gesture interface for unmanned vehicles

Dennis Perzanowski, Alan C. Schultz, William Adams, Elaine Marsh

Proceedings Volume 4024, Unmanned Ground Vehicle Technology II; (2000) https://doi.org/10.1117/12.391644
Event: AeroSense 2000, 2000, Orlando, FL, United States

Abstract

Unmanned vehicles, such as mobile robots, must exhibit adjustable autonomy. They must be able to be self-sufficient when the situation warrants; however, as they interact with each other and with humans, they must exhibit an ability to dynamically adjust their independence or dependence as co-operative agents attempting to achieve some goal. This is what we mean by adjustable autonomy. We have been investigating various modes of communication that enhance a robot's capability to work interactively with other robots and with humans. Specifically, we have been investigating how natural language and gesture can provide a user- friendly interface to mobile robots. We have extended this initial work to include semantic and pragmatic procedures that allow humans and robots to act co-operatively, based on whether or not goals have been achieved by the various agents in the interaction. By processing commands that are either spoken or initiated by clicking buttons on a Personal Digital Assistant and by gesturing either naturally or symbolically, we are tracking the various goals of the interaction, the agent involved in the interaction, and whether or not the goal has been achieved. The various agents involved in achieving the goals are each aware of their own and others' goals and what goals have been stated or accomplished so that eventually any member of the group, be it robot or a human, if necessary, can interact with the other members to achieve the stated goals of a mission.

Citation Download Citation

Dennis Perzanowski, Alan C. Schultz, William Adams, and Elaine Marsh "Using a natural language and gesture interface for unmanned vehicles", Proc. SPIE 4024, Unmanned Ground Vehicle Technology II, (10 July 2000); https://doi.org/10.1117/12.391644

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available