Scaling intelligent agent combat behaviors through hierarchical reinforcement learning

Scotty E. Black; Christian J. Darken

doi:10.1117/12.2679843

15 June 2023 Scaling intelligent agent combat behaviors through hierarchical reinforcement learning

Scotty E. Black, Christian J. Darken

Proceedings Volume 12542, Disruptive Technologies in Information Sciences VII; 125420U (2023) https://doi.org/10.1117/12.2679843
Event: SPIE Defense + Commercial Sensing, 2023, Orlando, Florida, United States

Conference Poster

Abstract

Remaining competitive in future conflicts with technologically-advanced competitors requires us to continue to invest in developing robust artificial intelligence (AI) for wargaming. Although deep reinforcement learning (RL) continues to show promising results in intelligent agent behavior development, it has yet to perform at or above the human level in the long-horizon, complex tasks typically found in combat modeling and simulation. Capitalizing on the proven potential of RL and recent successes of hierarchical reinforcement learning (HRL), our research aims to extend the use of HRL to create intelligent agents capable of performing effectively in these large and complex simulation environments. We plan to do so by developing a scalable HRL agent architecture and training framework, developing a dimension-invariant dynamic abstraction engine, and demonstrating scalability by incorporating our approach into a high-fidelity combat simulation.

Citation Download Citation

Scotty E. Black and Christian J. Darken "Scaling intelligent agent combat behaviors through hierarchical reinforcement learning", Proc. SPIE 12542, Disruptive Technologies in Information Sciences VII, 125420U (15 June 2023); https://doi.org/10.1117/12.2679843

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available