Traffic accidents determine a large number of injuries, sometimes fatal, every year. Among other factors affecting a driver's performance, an important role is played by stress which can decrease decision-making capabilities and situational awareness. In this perspective, it would be beneficial to develop a non-invasive driver stress monitoring system able to recognize the driver's altered state. In this study, a contactless procedure for drivers' stress state assessment by means of thermal infrared imaging was investigated. Thermal imaging was acquired during an experiment on a driving simulator, and thermal features of stress were investigated with comparison to a gold-standard metric (i.e., the stress index, SI) extracted from contact electrocardiography (ECG). A data-driven multivariate machine learning approach based on a non-linear support vector regression (SVR) was employed to estimate the SI through thermal features extracted from facial regions of interest (i.e., nose tip, nostrils, glabella). The predicted SI showed a good correlation with the real SI (r = 0.61, p = similar to 0). A two-level classification of the stress state (STRESS, SI >= 150, versus NO STRESS, SI < 150) was then performed based on the predicted SI. The ROC analysis showed a good classification performance with an AUC of 0.80, a sensitivity of 77%, and a specificity of 78%.

Driver Stress State Evaluation by Means of Thermal Imaging: A Supervised Machine Learning Approach Based on ECG Signal

Daniela Cardone
Primo
;
David Perpetuini;Chiara Filippini;Antonio Maria Chiarelli
Penultimo
;
Arcangelo Merla
Ultimo
2020-01-01

Abstract

Traffic accidents determine a large number of injuries, sometimes fatal, every year. Among other factors affecting a driver's performance, an important role is played by stress which can decrease decision-making capabilities and situational awareness. In this perspective, it would be beneficial to develop a non-invasive driver stress monitoring system able to recognize the driver's altered state. In this study, a contactless procedure for drivers' stress state assessment by means of thermal infrared imaging was investigated. Thermal imaging was acquired during an experiment on a driving simulator, and thermal features of stress were investigated with comparison to a gold-standard metric (i.e., the stress index, SI) extracted from contact electrocardiography (ECG). A data-driven multivariate machine learning approach based on a non-linear support vector regression (SVR) was employed to estimate the SI through thermal features extracted from facial regions of interest (i.e., nose tip, nostrils, glabella). The predicted SI showed a good correlation with the real SI (r = 0.61, p = similar to 0). A two-level classification of the stress state (STRESS, SI >= 150, versus NO STRESS, SI < 150) was then performed based on the predicted SI. The ROC analysis showed a good classification performance with an AUC of 0.80, a sensitivity of 77%, and a specificity of 78%.
2020
Inglese
ELETTRONICO
10
16 / Art. 5673
1
17
17
driver stress state; IR imaging; machine learning; support vector machine (SVR); advanced driver-assistance systems (ADAS)
https://www.mdpi.com/2076-3417/10/16/5673
no
7
info:eu-repo/semantics/article
262
Cardone, Daniela; Perpetuini, David; Filippini, Chiara; Spadolini, Edoardo; Mancini, Lorenza; Chiarelli, ANTONIO MARIA; Merla, Arcangelo
1 Contributo su Rivista::1.1 Articolo in rivista
open
File in questo prodotto:
File Dimensione Formato  
applsci-10-05673.pdf

accesso aperto

Descrizione: Article
Tipologia: PDF editoriale
Dimensione 2.45 MB
Formato Adobe PDF
2.45 MB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11564/729504
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 64
  • ???jsp.display-item.citation.isi??? 47
social impact