How should simulated data be collected for AI/ML and unmanned aerial vehicles?

Jeffrey Kerley; Derek T. Anderson; Brendan Alvey; Andrew Buck

doi:10.1117/12.2663717

13 June 2023 How should simulated data be collected for AI/ML and unmanned aerial vehicles?

Jeffrey Kerley, Derek T. Anderson, Brendan Alvey, Andrew Buck

Proceedings Volume 12529, Synthetic Data for Artificial Intelligence and Machine Learning: Tools, Techniques, and Applications; 125290J (2023) https://doi.org/10.1117/12.2663717
Event: SPIE Defense + Commercial Sensing, 2023, Orlando, Florida, United States

Abstract

Large and diverse datasets can now be simulated with associated truth to train and evaluate AI/ML algorithms. This convergence of readily accessible simulation (SIM) tools, real-time high-performance computing, and large repositories of high-quality, free-to-inexpensive photorealistic scanned assets is a potential artificial intelligence (AI) and machine learning (ML) gamechanger. While this feat is now within our grasp, what SIM data should be generated, how should it be generated, and how can this be achieved in a controlled and scalable fashion? First, we discuss a formal procedural language for specifying scenes (LSCENE) and collecting sampled datasets (LCAP). Second, we discuss specifics regarding our production and storage of data, ground truth, and metadata. Last, two LSCENE/LCAP examples are discussed and three unmanned aerial vehicle (UAV) AI/ML use cases are provided to demonstrate the range and behavior of the proposed ideas. Overall, this article is a step towards closed-loop automated AI/ML design and evaluation.

Conference Presentation

Citation Download Citation

Jeffrey Kerley, Derek T. Anderson, Brendan Alvey, and Andrew Buck "How should simulated data be collected for AI/ML and unmanned aerial vehicles?", Proc. SPIE 12529, Synthetic Data for Artificial Intelligence and Machine Learning: Tools, Techniques, and Applications, 125290J (13 June 2023); https://doi.org/10.1117/12.2663717

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available