Explore the vast range of titles available.

Estimating the driver’s gaze in a natural real-world setting can be problematic for different challenging scenario conditions. For example, faces will undergo facial occlusions, illumination, or various face positions while driving. In this effort, we aim to reduce misclassifications in driving situations when the driver has different face distances regarding the camera. Three-dimensional Convolutional Neural Networks (CNN) models can make a spatio-temporal driver’s representation that extracts features encoded in multiple adjacent frames that can describe motions. This characteristic may help ease the deficiencies of a per-frame recognition system due to the lack of context information. For example, the front, navigator, right window, left window, back mirror, and speed meter are part of the known common areas to be checked by drivers. Based on this, we implement and evaluate a model that is able to detect the head direction toward these regions having various distances from the camera. In our evaluation, the 2D CNN model had a mean average recall of 74.96% across the three models, whereas the 3D CNN model had a mean average recall of 87.02%. This result show that our proposed 3D CNN-based approach outperforms a 2D CNN per-frame recognition approach in driving situations when the driver’s face has different distances from the camera.

Human factors are a primary cause of vehicle accidents. Driver monitoring systems, utilizing a range of sensors and techniques, offer an effective method to monitor and alert drivers to minimize driver error and reduce risky driving behaviors, thus helping to avoid Safety Critical Events (SCEs) and enhance overall driving safety. Artificial Intelligence (AI) tools, in particular, have been widely investigated to improve the efficiency and accuracy of driver monitoring or analysis of SCEs. To better understand the state-of-the-art practices and potential directions for AI tools in this domain, this work is an inaugural attempt to consolidate AI-related tools from academic and industry perspectives. We include an extensive review of AI models and sensors used in driver gaze analysis, driver state monitoring, and analyzing SCEs. Furthermore, researchers identified essential AI tools, both in academia and industry, utilized for camera-based driver monitoring and SCE analysis, in the market. Recommendations for future research directions are presented based on the identified tools and the discrepancies between academia and industry in previous studies. This effort provides a valuable resource for researchers and practitioners seeking a deeper understanding of leveraging AI tools to minimize driver errors, avoid SCEs, and increase driving safety.

The lack of attention during the driving task is considered as a major risk factor for fatal road accidents around the world. Despite the ever-growing trend for autonomous driving which promises to bring greater road-safety benefits, the fact is today’s vehicles still only feature partial and conditional automation, demanding frequent driver action. Moreover, the monotony of such a scenario may induce fatigue or distraction, reducing driver awareness and impairing the regain of the vehicle’s control. To address this challenge, we introduce a non-intrusive system to monitor the driver in terms of fatigue, distraction, and activity. The proposed system explores state-of-the-art sensors, as well as machine learning algorithms for data extraction and modeling. In the domain of fatigue supervision, we propose a feature set that considers the vehicle’s automation level. In terms of distraction assessment, the contributions concern (i) a holistic system that covers the full range of driver distraction types and (ii) a monitoring unit that predicts the driver activity causing the faulty behavior. By comparing the performance of Support Vector Machines against Decision Trees, conducted experiments indicated that our system can predict the driver’s state with an accuracy ranging from 89% to 93%.

This review provides an overview of unobtrusive monitoring techniques that could be used to monitor some of the human vital signs (i.e., heart activity, breathing activity, temperature and potentially oxygen saturation) in a car seat. It will be shown that many techniques actually measure mechanical displacement, either on the body surface and/or inside the body. However, there are also techniques like capacitive electrocardiogram or bioimpedance that reflect electrical activity or passive electrical properties or thermal properties (infrared thermography). In addition, photopleythysmographic methods depend on optical properties (like scattering and absorption) of biological tissues and—mainly—blood. As all unobtrusive sensing modalities are always fragile and at risk of being contaminated by disturbances (like motion, rapidly changing environmental conditions, triboelectricity), the scope of the paper includes a survey on redundant sensor arrangements. Finally, this review also provides an overview of automotive demonstrators for vital sign monitoring.

We investigated the effect of driver posture on driving control following a takeover request (TOR) from autonomous to manual driving in level 3 autonomous vehicles. When providing a TOR, driving behaviors need to be investigated to develop driver monitoring systems, and it is important to clarify the effect of driver postures. Experiments were conducted using driver postures that are likely to be adopted in autonomous driving. Driver postures were set based on combinations of two types of upper-body posture and three types of foot posture. The driver’s upper body and head were set to either a forward or sideways orientation. For each of these there were three types of foot posture: both feet on the floor, crossed legs, and cross-legged sitting. Following a TOR, we compared the braking and steering maneuvers of subjects driving normally and examined the effects of posture on driver reaction time. The results show that both the upper-body and foot postures of the driver affect the steering and braking reaction time. The driver monitoring system should be able to detect posture and activate a TOR warning, and detection times up to 2 and 1.3 times faster than those for normal postures should be considered for different upper-body and foot postures, respectively.

People spend a significant amount of time daily in the driving seat and some health complexity is possible to happen like heart-related problems, and stroke. Driver’s health conditions may also be attributed to fatigue, drowsiness, or stress levels when driving on the road. Drivers’ health is important to make sure that they are vigilant when they are driving on the road. A driver-centered pervasive application is proposed to monitor a driver’s heart rate while driving. The input will be acquired from the interaction between the driver and embedded sensors at the steering wheel, which is tied to a Bluetooth link with an Android smartphone. The driver can view his historical data easily in tabular or graph form with selected filters using the application since the sensor data are transferred to a real-time database for storage and analysis. The application is coupled with the tool to demonstrate an opportunity as an aftermarket service for vehicles that are not equipped with this technology.

The present study aimed to introduce an approach to implement facial analysis on monitoring driver emotional status in real time. For this purpose, an experimental setup had been performed based on commercial technologies. Such experimental protocol includes the main variables involved in driving and how those variables influence in the driver performance. The goal of the experimental design was to detect which emotions of the driver s face are present during driving and how those emotions can be changed in presence of stimuli from a passive advanced driver for assistance systems (ADAS). Finally, the idea is to investigate if the driver performance changes when some external stimuli are applied as hazards are reported to the driver. The experimental results suggest that the ADAS is not sufficient to enhance the driver’s performance. As a result, the authors propose a new framework for driver assistance systems based on driver state, especially emotions: advanced driver monitoring for assistance systems (ADMAS), refer to Fig. 1 . With ADMAS implementation security and intelligence can be provided to a car and thus help to reduce traffic accidents.

Real time driver health condition monitoring system with drowsiness alertness was proposed. A new embedded electrocardiogram (ECG) sensor with electrically conductive fabric electrodes on the steering wheel of a car was designed to monitor the driver's health condition. The ECG signals were measured at a sampling rate of 100 Hz from the driver's palms as they stay on a pair of conductive fabric electrodes located on the steering wheel. Practical tests were conducted using an embedded ECG sensor with a wireless sensor node, and their performance was assessed under non-stop 2 h driving test. The ECG signals were measured and transmitted wirelessly to a base station connected to a server PC in personal area network environment. The driver's health condition such as the normal, fatigued and drowsy states was analysed by evaluating the heart rate variability in the time and frequency domains.

In recent years, the growing number of vehicles on the road have exacerbated issues related to safety and traffic congestion. However, the advent of the Internet of Vehicles (IoV) holds the potential to transform mobility, enhance traffic management and safety, and create smarter, more interconnected road networks. This paper addresses key road safety concerns, focusing on driver condition detection, vehicle monitoring, and traffic and road management. Specifically, various models proposed in the literature for monitoring the driver’s health and detecting anomalies, drowsiness, and impairment due to alcohol consumption are illustrated. The paper describes vehicle condition monitoring architectures, including diagnostic solutions for identifying anomalies, malfunctions, and instability while driving on slippery or wet roads. It also covers systems for classifying driving style, as well as tire and emissions monitoring. Moreover, the paper provides a detailed overview of the proposed traffic monitoring and management solutions, along with systems for monitoring road and environmental conditions, including the sensors used and the Machine Learning (ML) algorithms implemented. Finally, this review also presents an overview of innovative commercial solutions, illustrating advanced devices for driver monitoring, vehicle condition assessment, and traffic and road management.