Catalogue Search | MBRL
Are you sure you want to remove the book from the shelf?
{{itemTitle}}
21,526
result(s) for
"Data Fusion"
Sort by:
An Adaptive Multi-Sensor Data Fusion Method Based on Deep Convolutional Neural Networks for Fault Diagnosis of Planetary Gearbox
A fault diagnosis approach based on multi-sensor data fusion is a promising tool to deal with complicated damage detection problems of mechanical systems. Nevertheless, this approach suffers from two challenges, which are (1) the feature extraction from various types of sensory data and (2) the selection of a suitable fusion level. It is usually difficult to choose an optimal feature or fusion level for a specific fault diagnosis task, and extensive domain expertise and human labor are also highly required during these selections. To address these two challenges, we propose an adaptive multi-sensor data fusion method based on deep convolutional neural networks (DCNN) for fault diagnosis. The proposed method can learn features from raw data and optimize a combination of different fusion levels adaptively to satisfy the requirements of any fault diagnosis task. The proposed method is tested through a planetary gearbox test rig. Handcraft features, manual-selected fusion levels, single sensory data, and two traditional intelligent models, back-propagation neural networks (BPNN) and a support vector machine (SVM), are used as comparisons in the experiment. The results demonstrate that the proposed method is able to detect the conditions of the planetary gearbox effectively with the best diagnosis accuracy among all comparative methods in the experiment.
Journal Article
Recent Advances in Deep Learning-Based Spatiotemporal Fusion Methods for Remote Sensing Images
Remote sensing images captured by satellites play a critical role in Earth observation (EO). With the advancement of satellite technology, the number and variety of remote sensing satellites have increased, which provide abundant data for precise environmental monitoring and effective resource management. However, existing satellite imagery often faces a trade-off between spatial and temporal resolutions. It is challenging for a single satellite to simultaneously capture images with high spatial and temporal resolutions. Consequently, spatiotemporal fusion techniques, which integrate images from different sensors, have garnered significant attention. Over the past decade, research on spatiotemporal fusion has achieved remarkable progress. Nevertheless, traditional fusion methods often encounter difficulties when dealing with complicated fusion scenarios. With the development of computer science, deep learning models, such as convolutional neural networks (CNNs), generative adversarial networks (GANs), Transformers, and diffusion models, have recently been introduced into the field of spatiotemporal fusion, resulting in efficient and accurate algorithms. These algorithms exhibit various strengths and limitations, which require further analysis and comparison. Therefore, this paper reviews the literature on deep learning-based spatiotemporal fusion methods, analyzes and compares existing deep learning-based fusion algorithms, summarizes current challenges in this field, and proposes possible directions for future studies.
Journal Article
Big data fusion with knowledge graph: a comprehensive overview
Along with the wide application of intelligent systems in various fields, the combination of data fusion and knowledge graph has become the key to enhance the system’s problem solving capability. However, existing data fusion methods still face challenges when dealing with multi-source heterogeneous data, especially in how to effectively combine knowledge graph. Therefore, this paper systematically reviews existing data fusion methods based on knowledge graph and classifies them into three categories: fusion of raw data, fusion of raw data with knowledge graph, and fusion of knowledge graphs. Each category of methods is described and analyzed in detail by combining a general framework with specific examples. In addition, this paper also discusses the future research direction of data fusion based on knowledge graph, and analyzes the challenges and opportunities it faces. This paper provides a theoretical framework and practical guidance for the problem of multi-source heterogeneous data fusion, and provides methodological support for the development of intelligent systems.
Journal Article
Enhancement of Detecting Permanent Water and Temporary Water in Flood Disasters by Fusing Sentinel-1 and Sentinel-2 Imagery Using Deep Learning Algorithms: Demonstration of Sen1Floods11 Benchmark Datasets
Identifying permanent water and temporary water in flood disasters efficiently has mainly relied on change detection method from multi-temporal remote sensing imageries, but estimating the water type in flood disaster events from only post-flood remote sensing imageries still remains challenging. Research progress in recent years has demonstrated the excellent potential of multi-source data fusion and deep learning algorithms in improving flood detection, while this field has only been studied initially due to the lack of large-scale labelled remote sensing images of flood events. Here, we present new deep learning algorithms and a multi-source data fusion driven flood inundation mapping approach by leveraging a large-scale publicly available Sen1Flood11 dataset consisting of roughly 4831 labelled Sentinel-1 SAR and Sentinel-2 optical imagery gathered from flood events worldwide in recent years. Specifically, we proposed an automatic segmentation method for surface water, permanent water, and temporary water identification, and all tasks share the same convolutional neural network architecture. We utilize focal loss to deal with the class (water/non-water) imbalance problem. Thorough ablation experiments and analysis confirmed the effectiveness of various proposed designs. In comparison experiments, the method proposed in this paper is superior to other classical models. Our model achieves a mean Intersection over Union (mIoU) of 52.99%, Intersection over Union (IoU) of 52.30%, and Overall Accuracy (OA) of 92.81% on the Sen1Flood11 test set. On the Sen1Flood11 Bolivia test set, our model also achieves very high mIoU (47.88%), IoU (76.74%), and OA (95.59%) and shows good generalization ability.
Journal Article
IoMT-Enabled Fusion-Based Model to Predict Posture for Smart Healthcare Systems
Smart healthcare applications depend on data from wearable sensors (WSs) mounted on a patient’s body for frequent monitoring information. Healthcare systems depend on multi-level data for detecting illnesses and consequently delivering correct diagnostic measures. The collection of WS data and integration of that data for diagnostic purposes is a difficult task. This paper proposes an Errorless Data Fusion (EDF) approach to increase posture recognition accuracy. The research is based on a case study in a health organization. With the rise in smart healthcare systems, WS data fusion necessitates careful attention to provide sensitive analysis of the recognized illness. As a result, it is dependent on WS inputs and performs group analysis at a similar rate to improve diagnostic efficiency. Sensor breakdowns, the constant time factor, aggregation, and analysis results all cause errors, resulting in rejected or incorrect suggestions. This paper resolves this problem by using EDF, which is related to patient situational discovery through healthcare surveillance systems. Features of WS data are examined extensively using active and iterative learning to identify errors in specific postures. This technology improves position detection accuracy, analysis duration, and error rate, regardless of user movements. Wearable devices play a critical role in the management and treatment of patients. They can ensure that patients are provided with a unique treatment for their medical needs. This paper discusses the EDF technique for optimizing posture identification accuracy through multi-feature analysis. At first, the patients’ walking patterns are tracked at various time intervals. The characteristics are then evaluated in relation to the stored data using a random forest classifier.
Journal Article
PFDI: a precise fruit disease identification model based on context data fusion with faster-CNN in edge computing environment
Fruits significantly impact everyday living, i.e., Citrus fruits. Numerous fruits have a solid nutritious value and are packed with multivitamins and trace components. Citrus fruits are delicate and susceptible to many diseases and infections. Many researchers have suggested deep and machine learning-based fruit disease detection and classification models. This research presents a precise fruit disease identification model based on context data fusion with Faster-CNN in an edge computing environment. The goal is to develop an accurate, efficient, and trustable fruit disease detection model, a critical component of autonomous food production in a robotic edge platform. This research examines and explores four different diseases of Citrus fruits using CNN deep learning models to be adopted as edge computing solutions. Identification of citrus diseases such as cankers black spot, greening, scab, melanosis, and healthy citrus fruits are implemented using the proposed sequential model without pruning, with pruning having different sparsity levels followed by post quantization. Through the transfer learning method, this model is optimized for the assignment of fruit disease detection employing visuals from two patterns: Near-infrared (NIFR) and RGB. Early and late data fusion techniques for integrating multi-model (NIFR and RGB) facts are evaluated. The accuracy obtained from the proposed model for the canker disease is 97%, scab 95%, melanosis 99%, Greening 97%, Black spot 97% and healthy 97%. In this paper, the results of the proposed model are compared and evaluated with the sparsity levels of 50–80%, 60–90%, 70–90%, and 80–90% pruning and also obtained the results of post-quantization on each level. The results show that the model size with 60–90% pruning can be counteracted to the 47.64 of the baseline model without significant loss of accuracy. Moreover, post-quantization can reduce the 60–90% pruning from 28.16 to 8.72. In addition to enhanced precision, the above initiative is much faster to implement for new fruit diseases because it needs bounding box annotation instead of pixel-level annotation.
Journal Article
Infra-3DRC-FusionNet: Deep Fusion of Roadside Mounted RGB Mono Camera and Three-Dimensional Automotive Radar for Traffic User Detection
Mono RGB cameras and automotive radar sensors provide a complementary information set that makes them excellent candidates for sensor data fusion to obtain robust traffic user detection. This has been widely used in the vehicle domain and recently introduced in roadside-mounted smart infrastructure-based road user detection. However, the performance of the most commonly used late fusion methods often degrades when the camera fails to detect road users in adverse environmental conditions. The solution is to fuse the data using deep neural networks at the early stage of the fusion pipeline to use the complete data provided by both sensors. Research has been carried out in this area, but is limited to vehicle-based sensor setups. Hence, this work proposes a novel deep neural network to jointly fuse RGB mono-camera images and 3D automotive radar point cloud data to obtain enhanced traffic user detection for the roadside-mounted smart infrastructure setup. Projected radar points are first used to generate anchors in image regions with a high likelihood of road users, including areas not visible to the camera. These anchors guide the prediction of 2D bounding boxes, object categories, and confidence scores. Valid detections are then used to segment radar points by instance, and the results are post-processed to produce final road user detections in the ground plane. The trained model is evaluated for different light and weather conditions using ground truth data from a lidar sensor. It provides a precision of 92%, recall of 78%, and F1-score of 85%. The proposed deep fusion methodology has 33%, 6%, and 21% absolute improvement in precision, recall, and F1-score, respectively, compared to object-level spatial fusion output.
Journal Article