Explore the vast range of titles available.

Sensor-based human activity recognition (HAR) has attracted enormous interests due to its wide applications in the Internet of Things (IoT), smart homes and healthcare. In this paper, a low-resolution infrared array sensor-based HAR approach is proposed using the deep learning framework. The device-free sensing system leverages the infrared array sensor of 8×8 pixels to collect the infrared signals, which can ensure users’ privacy and effectively reduce the deployment cost of the network. To reduce the influence of temperature variations, a combination of the J-filter noise reduction method and the Butterworth filter is performed to preprocess the infrared signals. Long short-term memory (LSTM), a representative recurrent neural network, is utilized to automatically extract characteristics from the infrared signal and build the recognition model. In addition, the real-time HAR interface is designed by embedding the LSTM model. Experimental results show that the typical daily activities can be classified with the recognition accuracy of 98.287%. The proposed approach yields a better result compared to the existing machine learning methods, and it provides a low-cost yet promising solution for privacy-preserving scenarios.

Thermopile sensor arrays provide a sufficient counterbalance between person detection and localization while preserving privacy through low resolution. The latter is especially important in the context of smart building automation applications. Current research has shown that there are two machine learning-based algorithms that are particularly prominent for general object detection: You Only Look Once (YOLOv5) and Detection Transformer (DETR). Over the course of this paper, both algorithms are adapted to localize people in 32 × 32-pixel thermal array images. The drawbacks in precision due to the sparse amount of labeled data were counteracted with a novel generative image generator (IIG). This generator creates synthetic thermal frames from the sparse amount of available labeled data. Multiple robustness tests were performed during the evaluation process to determine the overall usability of the aforementioned algorithms as well as the advantage of the image generator. Both algorithms provide a high mean average precision (mAP) exceeding 98%. They also prove to be robust against disturbances of warm air streams, sun radiation, the replacement of the sensor with an equal type sensor, new persons, cold objects, movements along the image frame border and people standing still. However, the precision decreases for persons wearing thick layers of clothes, such as winter clothing, or in scenarios where the number of present persons exceeds the number of persons the algorithm was trained on. In summary, both algorithms are suitable for detection and localization purposes, although YOLOv5m has the advantage in real-time image processing capabilities, accompanied by a smaller model size and slightly higher precision.

Due to the rapid aging of the population in recent years, the number of elderly people in hospitals and nursing homes is increasing, which results in a shortage of staff. Therefore, the situation of elderly citizens requires real-time attention, especially when dangerous situations such as falls occur. If staff cannot find and deal with them promptly, it might become a serious problem. For such a situation, many kinds of human motion detection systems have been in development, many of which are based on portable devices attached to a user’s body or external sensing devices such as cameras. However, portable devices can be inconvenient for users, while optical cameras are affected by lighting conditions and face privacy issues. In this study, a human motion detection system using a low-resolution infrared array sensor was developed to protect the safety and privacy of people who need to be cared for in hospitals and nursing homes. The proposed system can overcome the above limitations and have a wide range of application. The system can detect eight kinds of motions, of which falling is the most dangerous, by using a three-dimensional convolutional neural network. As a result of experiments of 16 participants and cross-validations of fall detection, the proposed method could achieve 98.8% and 94.9% of accuracy and F1-measure, respectively. They were 1% and 3.6% higher than those of a long short-term memory network, and show feasibility of real-time practical application.

In this paper, we propose an activity detection system using a 24 × 32 resolution infrared array sensor placed on the ceiling. We first collect the data at different resolutions (i.e., 24 × 32, 12 × 16, and 6 × 8) and apply the advanced deep learning (DL) techniques of Super-Resolution (SR) and denoising to enhance the quality of the images. We then classify the images/sequences of images depending on the activities the subject is performing using a hybrid deep learning model combining a Convolutional Neural Network (CNN) and a Long Short-Term Memory (LSTM). We use data augmentation to improve the training of the neural networks by incorporating a wider variety of samples. The process of data augmentation is performed by a Conditional Generative Adversarial Network (CGAN). By enhancing the images using SR, removing the noise, and adding more training samples via data augmentation, our target is to improve the classification accuracy of the neural network. Through experiments, we show that employing these deep learning techniques to low-resolution noisy infrared images leads to a noticeable improvement in performance. The classification accuracy improved from 78.32% to 84.43% (for images with 6 × 8 resolution), and from 90.11% to 94.54% (for images with 12 × 16 resolution) when we used the CNN and CNN + LSTM networks, respectively.

Knowledge about the indoor occupancy is one of the important sources of information to design smart buildings. In some applications, the number of occupants in each zone is required. However, there are many challenges such as user privacy, communication limit, and sensor’s computational capability in development of the occupancy monitoring systems. In this work, a people flow counting algorithm has been developed which uses low-resolution thermal images to avoid any privacy concern. Moreover, the proposed scheme is designed to be applicable for wireless sensor networks based on the internet-of-things platform. Simple low-complexity image processing techniques are considered to detect possible objects in sensor’s field of view. To tackle the noisy detection measurements, a multi-Bernoulli target tracking approach is used to track and finally to count the number of people passing the area of interest in different directions. Based on the sensor node’s processing capability, one can consider either a centralized or a full in situ people flow counting system. By performing the tracking part either in sensor node or in a fusion center, there would be a trade off between the computational complexity and the transmission rate. Therefore, the developed system can be performed in a wide range of applications with different processing and transmission constraints. The accuracy and robustness of the proposed method are also evaluated with real measurements from different conducted trials and open-source dataset.

Background Pressure sensors have been used for sleeping posture detection, which meet privacy requirements. Most of the existing techniques for sleeping posture recognition used force-sensitive resistor (FSR) sensors. However, lower limbs cannot be recognized accurately unless thousands of sensors are deployed on the bedsheet. Method We designed a sleeping posture recognition scheme in which FSR sensors were deployed on the upper part of the bedsheet to record the pressure distribution of the upper body. In addition, an infrared array sensor was deployed to collect data for the lower body. Posture recognition was performed using a fuzzy c-means clustering algorithm. Six types of sleeping body posture were recognized from the combination of the upper and lower body postures. Results The experimental results showed that the proposed method achieved an accuracy of above 88%. Moreover, the proposed scheme is cost-efficient and easy to deploy. Conclusions The proposed sleeping posture recognition system can be used for pressure ulcer prevention and sleep quality assessment. Compared to wearable sensors and cameras, FSR sensors and infrared array sensors are unobstructed and meet privacy requirements. Moreover, the proposed method provides a cost-effective solution for the recognition of sleeping posture.

The field-of-view (FOV) of compound eyes is an important index for performance evaluation. Most artificial compound eyes are optical, fabricated by imitating insect compound eyes with a fixed FOV that is difficult to adjust over a wide range. The compound eye is of great significance in the field of tracking high-speed moving objects. However, the tracking ability of a compound eye is often limited by its own FOV size and the reaction speed of the rudder unit matched with the compound eye, so that the compound eye cannot better adapt to tracking high-speed moving objects. Inspired by the eyes of many organisms, we propose a soft-array, surface-changing compound eye (SASCE). Taking soft aerodynamic models (SAM) as the carrier and an infrared sensor as the load, the basic model of the variable structure infrared compound eye (VSICE) is established using an array of infrared sensors on the carrier. The VSICE model is driven by air pressure to change the array surface of the infrared sensor. Then, the spatial position of each sensor and its viewing area are changed and, finally, the FOV of the compound eye is changed. Simultaneously, to validate the theory, we measured the air pressure, spatial sensor position, and the FOV of the compound eye. When compared with the current compound eye, the proposed one has a wider adjustable FOV.

Human sensing based on the low-resolution infrared sensor is widely used in hand gestures recognition, activity recognition, intrusion detection, etc. However, the information about humans acquired by the previous human sensing system using the infrared sensor is limited. In this paper, a human pose estimation system is proposed to realize the three-dimensional skeleton information acquisition by low-resolution infrared sensors. It is a difficult task to acquire human pose estimation with more rich human information from low-resolution infrared sensors. The system leverages the 8 × 8 pixels low-resolution infrared array sensor to collect the activity data and the Kinect v2 camera to capture the three-dimensional skeleton of the human body as annotations of the infrared data. The convolutional neural network-bidirectional gated recurrent unit model with attention mechanism (CNN-BiGRU-AM) model is employed for model training to effectively extract the characteristics of the infrared data from spatial and temporal dimensions. The attention mechanism (AM) can improve the ability of the model to capture important local information. The bone joint point data predicted by the model are utilized to draw the three-dimensional skeleton diagram. The k-means clustering algorithm is applied to eliminate the outliers that affect the overall visualization effect in the prediction. The accuracy and completeness of human pose estimation are measured by the euclidean distance between the real coordinates of the bone joint points obtained by Kinect v2 camera and the coordinates predicted by the model. The proportion of the number of predictions with euclidean distance less than a threshold 20 mm is 90.151%, representing the accuracy of human pose estimation. The experimental results show that three-dimensional skeleton information can be acquired accurately by the low-resolution infrared array sensor and the subtle difference within each activity can be observed through the 3D human pose to improve the effect of activity recognition.

In the current era of advanced IoT technology, human occupancy monitoring and positioning technology is widely used in various scenarios. For example, it can optimize passenger flow in public transportation systems, enhance safety in large shopping malls, and adjust smart home devices based on the location and number of occupants for energy savings. Additionally, in homes requiring special care, it can provide timely assistance. However, this technology faces limitations such as privacy concerns, environmental factors, and costs. Traditional cameras may not effectively address these issues, but infrared thermal sensors can offer similar applications while overcoming these challenges. Infrared thermal sensors detect the infrared heat emitted by the human body, protecting privacy and functioning effectively day and night with low power consumption, making them ideal for continuous monitoring scenarios like security systems or elderly care. In this study, we propose a system using the AMG8833, an 8 × 8 Infrared Thermal Array Sensor. The sensor data are processed through interpolation, adaptive thresholding, and blob detection, and the merged human heat signatures are separated. To enhance stability in human position estimation, a dynamic sliding window adjusts its size based on movement speed, effectively handling environmental changes and uncertainties.