Multimodal 3D measurement setup for generating multimodal real-world data sets for AI-based transparent object recognition

Christina Junger; Martin Landmann; Henri Speck; Stefan Heist; Gunther Notni

doi:10.1117/12.3017783

7 June 2024 Multimodal 3D measurement setup for generating multimodal real-world data sets for AI-based transparent object recognition

Christina Junger, Martin Landmann, Henri Speck, Stefan Heist, Gunther Notni

Author Affiliations +

Proceedings Volume 13038, Dimensional Optical Metrology and Inspection for Practical Applications XIII; 1303804 (2024) https://doi.org/10.1117/12.3017783
Event: SPIE Defense + Commercial Sensing, 2024, National Harbor, Maryland, United States

Abstract

Multimodal 3D imaging is a key technology in various areas, such as medical technology, trust-based human-robot collaboration and material recognition for recycling. This technology offers new possibilities, particularly for the 3D perception of optically uncooperative surfaces in the VIS and NIR spectral range, e.g., transparent or specular materials. For this purpose, a thermal 3D sensor developed by Landmann et al. allows the 3D detection of transparent and reflective surfaces without object preparation, which can be used to generate real multimodal 3D data sets for AI-based methods. The 3D perception of optically uncooperative surfaces in VIS or NIR is still nowadays an open challenge (cf. Jiang et al.). However, to overcome this challenge, we have developed a new measurement principle TranSpec3D, with which we can generate real multimodal 3D data sets with annotation without object preparation techniques. This system significantly reduces the effort required for data acquisition. We also show the advantages and disadvantages of our extended measurement principle and data set compared to other data sets (generated with object preparation).

Conference Presentation

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Christina Junger, Martin Landmann, Henri Speck, Stefan Heist, and Gunther Notni "Multimodal 3D measurement setup for generating multimodal real-world data sets for AI-based transparent object recognition", Proc. SPIE 13038, Dimensional Optical Metrology and Inspection for Practical Applications XIII, 1303804 (7 June 2024); https://doi.org/10.1117/12.3017783

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available