A real-time software framework for driver monitoring systems: software architecture and use cases

Juan Diego Ortega; Marcos Nieto; Paola Cañas; Oihana Otaegui; Luis Salgado

doi:10.1117/12.2588712

12 April 2021 A real-time software framework for driver monitoring systems: software architecture and use cases

Juan Diego Ortega, Marcos Nieto, Paola Cañas, Oihana Otaegui, Luis Salgado

Proceedings Volume 11736, Real-Time Image Processing and Deep Learning 2021; 117360E (2021) https://doi.org/10.1117/12.2588712
Event: SPIE Defense + Commercial Sensing, 2021, Online Only

Abstract

The presence of Advanced Driver Assistance Systems (ADAS) in modern vehicles has become a reality in recent years, enhancing the comfort and safety of drivers and road users. In the track to achieve full autonomous driving it is vital to include Driver Monitoring Systems (DMS) as part of the automation set of systems to assure possible hand-over/hand-back actions. The development of DMS usually involve the integration of different computer vision and deep learning components. In this work we present a modular approach for rapid prototyping of DMS by defining atomic processing units (i.e. Analyzers) and the interface (i.e. Measures) between these units. This approach allows the definition of a network of Analyzers which can be easily interconnected in pipelines to perform specific DMS tasks (drowsiness, distraction, identity recognition). A key advantage of our approach is that a single step can be re-used for multiple DMS functionalities without the need to double computational resources. In addition, it is possible to test and validate different methods that share the same interfaces and produce the same measures. Therefore, it is easy to switch between different algorithms in a pipeline. The distributed processing capabilities of the resulting DMS architectures obtained from the proposed framework allow the generation of parallel processes in specialized hardware (i.e. Multi-core CPU and GPU boards) with a positive impact on real-time performance. Our DMS framework is compatible with RTMaps automotive-level platform for real-time multi-sensor data processing and the interfaces are compliant with the ASAM OpenLABEL concept paper by using VCD description format.

Conference Presentation

Citation Download Citation

Juan Diego Ortega, Marcos Nieto, Paola Cañas, Oihana Otaegui, and Luis Salgado "A real-time software framework for driver monitoring systems: software architecture and use cases", Proc. SPIE 11736, Real-Time Image Processing and Deep Learning 2021, 117360E (12 April 2021); https://doi.org/10.1117/12.2588712

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available