Modeling of Driver Behavior in Real World Scenarios Using Multiple Noninvasive Sensors
- 21 January 2013
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Multimedia
- Vol. 15 (5), 1213-1225
- https://doi.org/10.1109/tmm.2013.2241416
Abstract
With the development of new in-vehicle technology, drivers are exposed to more sources of distraction, which can lead to an unintentional accident. Monitoring the driver attention level has become a relevant research problem. This is the precise aim of this study. A database containing 20 drivers was collected in real-driving scenarios. The drivers were asked to perform common secondary tasks such as operating the radio, phone and a navigation system. The collected database comprises of various noninvasive sensors including the controller area network-bus (CAN-Bus), video cameras and microphone arrays. The study analyzes the effects in driver behaviors induced by secondary tasks. The corpus is analyzed to identify multimodal features that can be used to discriminate between normal and task driving conditions. Separate binary classifiers are trained to distinguish between normal and each of the secondary tasks, achieving an average accuracy of 77.2%. When a joint, multi-class classifier is trained, the system achieved accuracies of 40.8%, which is significantly higher than chances (12.5%). We observed that the classifiers' accuracy varies across secondary tasks, suggesting that certain tasks are more distracting than others. Motivated by these results, the study builds statistical models in the form of Gaussian Mixture Models (GMMs) to quantify the actual deviations in driver behaviors from the expected normal driving patterns. The study includes task independent and task dependent models. Building upon these results, a regression model is proposed to obtain a metric that characterizes the attention level of the driver. This metric can be used to signal alarms, preventing collision and improving the overall driving experience.Keywords
This publication has 38 references indexed in Scilit:
- Modeling and prediction of driver behavior by foot gesture analysisComputer Vision and Image Understanding, 2012
- Evaluation of Distraction in a Driver-Vehicle-Environment Framework: An Application of Different Data-Mining TechniquesLecture Notes in Computer Science, 2009
- Distraction Assessment Methods Based on Visual Behavior and Event DetectionPublished by Taylor & Francis ,2008
- Drowsy Driver Detection Through Facial Movement AnalysisPublished by Springer Nature ,2007
- Driver cognitive distraction detection: Feature estimation and implementationProceedings of the Institution of Mechanical Engineers, Part D: Journal of Automobile Engineering, 2007
- An on-road assessment of cognitive distraction: Impacts on drivers’ visual behavior and braking performanceAccident Analysis & Prevention, 2007
- Automatic Recognition of Facial Actions in Spontaneous ExpressionsJournal of Multimedia, 2006
- Real-Time System for Monitoring Driver VigilanceIEEE Transactions on Intelligent Transportation Systems, 2006
- Effects of visual and cognitive load in real and simulated motorway drivingTransportation Research Part F: Traffic Psychology and Behaviour, 2005
- Experimental evaluation of eye-blink parameters as a drowsiness measureEuropean Journal of Applied Physiology, 2003