Search Results Heading

MBRLSearchResults

mbrl.module.common.modules.added.book.to.shelf
Title added to your shelf!
View what I already have on My Shelf.
Oops! Something went wrong.
Oops! Something went wrong.
While trying to add the title to your shelf something went wrong :( Kindly try again later!
Are you sure you want to remove the book from the shelf?
Oops! Something went wrong.
Oops! Something went wrong.
While trying to remove the title from your shelf something went wrong :( Kindly try again later!
    Done
    Filters
    Reset
  • Discipline
      Discipline
      Clear All
      Discipline
  • Is Peer Reviewed
      Is Peer Reviewed
      Clear All
      Is Peer Reviewed
  • Item Type
      Item Type
      Clear All
      Item Type
  • Subject
      Subject
      Clear All
      Subject
  • Year
      Year
      Clear All
      From:
      -
      To:
  • More Filters
446 result(s) for "missing data reconstruction"
Sort by:
Study of Building Safety Monitoring by Using Cost-Effective MEMS Accelerometers for Rapid After-Earthquake Assessment with Missing Data
Suffering from structural deterioration and natural disasters, the resilience of civil structures in the face of extreme loadings inevitably drops, which may lead to catastrophic structural failure and presents great threats to public safety. Earthquake-induced extreme loading is one of the major reasons behind the structural failure of buildings. However, many buildings in earthquake-prone areas of China lack safety monitoring, and prevalent structural health monitoring systems are generally very expensive and complicated for extensive applications. To facilitate cost-effective building-safety monitoring, this study investigates a method using cost-effective MEMS accelerometers for buildings’ rapid after-earthquake assessment. First, a parameter analysis of a cost-effective MEMS sensor is conducted to confirm its suitability for building-safety monitoring. Second, different from the existing investigations that tend to use a simplified building model or small-scaled frame structure excited by strong motions in laboratories, this study selects an in-service public building located in a typical earthquake-prone area after an analysis of earthquake risk in China. The building is instrumented with the selected cost-effective MEMS accelerometers, characterized by a low noise level and the capability to capture low-frequency small-amplitude dynamic responses. Furthermore, a rapid after-earthquake assessment scheme is proposed, which systematically includes fast missing data reconstruction, displacement response estimation based on an acceleration response integral, and safety assessment based on the maximum displacement and maximum inter-story drift ratio. Finally, the proposed method is successfully applied to a building-safety assessment by using earthquake-induced building responses suffering from missing data. This study is conducive to the extensive engineering application of MEMS-based cost-effective building monitoring and rapid after-earthquake assessment.
Gap filling for satellite-derived products of lake aquatic environment using historical big data
Effective monitoring of lake aquatic environments is crucial for assessing lake health, identifying issues, and developing emergency plans. Satellite-based remote sensing has been recognized as an effective method for timely and comprehensive monitoring of these environments. However, satellite-derived products often lack complete spatial coverage due to invalid pixels resulting from factors such as cloud cover, high sun glint contamination, and high satellite-viewing angles. To address this issue, we propose a novel gap filling method for satellite-derived products of lake aquatic environments, utilizing historical big data. We initially developed a machine-learning-based model for similarity matching across various dates. This model was based on 10 factors, selected from water quality and meteorological conditions that have a significant correlation with the lake aquatic environment. This model allows for the assignment of values to invalid pixels in a specific satellite-derived product, derived from the corresponding pixels in the products of historical dates. The proposed method has been applied to the satellite-derived Chl-a products of Lake Chaohu. The experimental findings demonstrate that the computed mean value of the peak signal-to-noise ratio (PSNR) stands at 35.75, as derived from the experimental data. This substantiates the precision of the gap filling method applied to satellite-derived products. This study underscores the significant value of the proposed method in gap filling for satellite-derived products, as well as in predicting the aquatic environment of lakes.
Reconstruction of Missing Data Completely at Random for Trains Based on Improved GAN
Reconstruction of missing data for heavy-haul trains is critical to ensuring safe train operation. However, existing generative model training methods require a complete dataset, making it difficult for them to address the issue of missing data completely at random. To address this issue, this study proposes a new attention-generative adversarial network to reconstruct missing data. First, a mask matrix is designed to locate the missing data, and the gradient descent algorithm is applied in combination with the output probability matrix of the discriminator so that the mask matrix can still fill up the data well in the case of an incomplete data set. Subsequently, the prompt matrix is derived based on the mask matrix to solve the problem of model overfitting and accelerate the convergence. Finally, an attention mechanism is introduced into the entire generative adversarial network to improve the expression of data features using the feature extraction network. The experimental results show that the mean square error and mean absolute error percentage indexes of reconstruction accuracy can be maintained below 1.5 for measurement data at different missing rates, and the reconstructed data can also well conform to the distribution law of measurement data.
Reconstruction of Land Surface Temperature Derived from FY-4A AGRI Data Based on Two-Point Machine Learning Method
Land surface temperature (LST) is one of the most important parameters of the interface between the earth surface and the atmosphere, and it plays a significant role in many research fields, such as agriculture, climate, hydrology, and the environment. However, the thermal infrared band of remote sensors is easily affected by clouds and aerosols, leading to many data gaps in LST products, which restricts the subsequent application of these products. In this paper, Beijing, China, is selected as the study area, and the LST data retrieved from Fengyun 4A (FY-4A) Advanced Geosynchronous Radiation Imager (AGRI) are reconstructed based on the two-point machine learning method. Firstly, the two-point machine learning model is built to reconstruct the theoretical clear-sky LST from simulated and actual images, and the accuracy of the reconstruction results is evaluated compared with the random forest algorithm and the inverse distance weighted method. Secondly, the actual LST under the influence of clouds is reconstructed by using the ERA5 reanalysis LST data as the auxiliary data, and the reconstruction accuracy is then evaluated by the field measurement LST data. The experimental results show that (1) the prediction accuracy of the two-point machine learning method is higher than that of the random forest method in both simulated data and actual data experiments; (2) the R2 of reconstructed LST under theoretical clear-sky conditions is 0.6860 and the root mean square error (RMSE) is 2.9 K, while the R2 of the reconstructed accuracy of actual LST under clouds is 0.7275 and the RMSE is 2.6 K, i.e., the RMSE decreases by 10.34%; (3) the two-point machine method combined with the auxiliary ERA5 LST data can well reconstruct LST under cloudy conditions and present a reasonable LST distribution.
Reconstruction of missing spring discharge by using deep learning models with ensemble empirical mode decomposition of precipitation
A continuous and complete spring discharge record is critical in understanding the hydrodynamic behavior of karst aquifers and the variability of freshwater resources. However, due to equipment errors, failure of observation and other reasons, missing data is a common problem for spring discharge monitoring and further hydrological investigations and data analysis. In this study, a novel approach that integrates deep learning algorithms and ensemble empirical mode decomposition (EEMD) is proposed to reconstruct the missing spring discharge data with a given local precipitation record. Using EEMD, the local precipitation data is decomposed into several intrinsic mode functions (IMFs) from high to low frequencies and a residual function, which are served as the input of convolutional neural network (CNN), long short-term memory (LSTM), and hybrid CNN-LSTM models to reconstruct the missing discharge data. Evaluation metrics, including root mean squared error (RMSE), mean absolute error (MAE), and Nash–Sutcliffe efficiency coefficient (NSE), are calculated to evaluate the reconstruction performance. The monthly spring discharge and precipitation data from March 1978 to October 2021 collected at Barton Springs in Texas are used for the validation and evaluation of newly proposed deep learning models. The results indicate that deep learning models coupled with EEMD overperform the models without EEMD and significantly improve the reconstruction results. The LSTM-EEMD model obtains the best reconstruction results among three deep learning algorithms. For models with monthly data, the missing rate affects the reconstruction performance because of the number of data samples: the best reconstruction results are achieved when the missing rate was low. If the missing rate was 50%, the reconstruction results become notably poorer. However, when the daily precipitation and discharge data are used, the models can obtain satisfactory reconstruction results with missing rate ranged from 10 to 50%.
An Improved CNN-Based Completion Method for Power Grid Middle Platform Data
The transmission of power data would be likely to be interrupted or interfered, which results in the middle platform data missing. Missing data reconstruction plays a key role in power data processing, based on which the quality and utilization of power data have been enhanced. In traditional power data filling methods, only a single data distribution was considered, the correlation of power data in time and space was ignored. In this paper, an improved Convolutional Neural Network (CNN) method for filling power data was presented, and a CNN structure was designed. Through the unsupervised training of CNN, this method mines the correlation of data from the dimensions of time and space, and efficiently completes the missing data through the constraints of time continuity and space continuity. The completion results show that our method can fill the missing data efficiently, furthermore, experimental evaluations validate the performs of the proposed method.
Reconstructing Missing and Anomalous Data Collected from High-Frequency In-Situ Sensors in Fresh Waters
In situ sensors that collect high-frequency data are used increasingly to monitor aquatic environments. These sensors are prone to technical errors, resulting in unrecorded observations and/or anomalous values that are subsequently removed and create gaps in time series data. We present a framework based on generalized additive and auto-regressive models to recover these missing data. To mimic sporadically missing (i) single observations and (ii) periods of contiguous observations, we randomly removed (i) point data and (ii) day- and week-long sequences of data from a two-year time series of nitrate concentration data collected from Arikaree River, USA, where synoptically collected water temperature, turbidity, conductance, elevation, and dissolved oxygen data were available. In 72% of cases with missing point data, predicted values were within the sensor precision interval of the original value, although predictive ability declined when sequences of missing data occurred. Precision also depended on the availability of other water quality covariates. When covariates were available, even a sudden, event-based peak in nitrate concentration was reconstructed well. By providing a promising method for accurate prediction of missing data, the utility and confidence in summary statistics and statistical trends will increase, thereby assisting the effective monitoring and management of fresh waters and other at-risk ecosystems.
Lightweight Evidential Time Series Imputation Method for Bridge Structural Health Monitoring
Long-term data loss resulting from sensor malfunctions, communication interruptions, and other factors in Structural Health Monitoring (SHM) significantly undermines the reliability of damage identification and safety assessment. Existing methods—ranging from statistical approaches and low-rank matrix completion to traditional machine learning and deep learning imputation techniques—often suffer from either limited accuracy or excessive model size and slow inference, making deployment in resource-constrained scenarios difficult. To address these challenges, this paper proposes TEFN–Imputation, a lightweight and efficient time-series imputation model. This model utilizes observation-driven non-stationary normalization to mitigate the impact of time-varying characteristics and dimensional discrepancies. It employs linear projection for temporal length alignment and constructs BPA-style mass representations from dual perspectives of time and channel. Furthermore, it replaces strict Dempster–Shafer belief combination with an expectation-based evidential aggregation (readout), thereby significantly reducing computational overhead while enabling uncertainty-aware evidential indicators for interpretation rather than claiming a direct accuracy gain from uncertainty modeling. The observed accuracy and robustness improvements are primarily attributed to the normalization and dual temporal–channel modeling design under the same lightweight readout. Systematic experiments on two real-world bridge monitoring datasets, Z24 and Hell Bridge, demonstrate that TEFN consistently maintains low Mean Absolute Error (MAE) and minimal volatility across various combinations of training and testing missing rates, exhibiting high robustness against variations in missing rates and train–test mismatches. Concurrently, compared to RNN and large-scale Transformer baselines, TEFN reduces parameter count and CPU inference time by one to two orders of magnitude. Thus, it achieves a superior trade-off among accuracy, efficiency, and model scale, making it highly suitable for online SHM and imputation tasks in practical engineering applications. Across the settings on Z24, TEFN achieves a mean MAE of 0.218 with a standard deviation of 0.002, while using only 0.02 MB parameters and 2.73 ms per batch CPU inference.
Reconstruction and Prediction of Chaotic Time Series with Missing Data: Leveraging Dynamical Correlations Between Variables
Although data-driven machine learning methods have been successfully applied to predict complex nonlinear dynamics, forecasting future evolution based on incomplete past information remains a significant challenge. This paper proposes a novel data-driven approach that leverages the dynamical relationships among variables. By integrating Non-Stationary Transformers with LightGBM, we construct a robust model where LightGBM builds a fitting function to capture and simulate the complex coupling relationships among variables in dynamically evolving chaotic systems. This approach enables the reconstruction of missing data, restoring sequence completeness and overcoming the limitations of existing chaotic time series prediction methods in handling missing data. We validate the proposed method by predicting the future evolution of variables with missing data in both dissipative and conservative chaotic systems. Experimental results demonstrate that the model maintains stability and effectiveness even with increasing missing rates, particularly in the range of 30% to 50%, where prediction errors remain relatively low. Furthermore, the feature importance extracted by the model aligns closely with the underlying dynamic characteristics of the chaotic system, enhancing the method’s interpretability and reliability. This research offers a practical and theoretically sound solution to the challenges of predicting chaotic systems with incomplete datasets.
TIEOF: Algorithm for Recovery of Missing Multidimensional Satellite Data on Water Bodies Based on Higher-Order Tensor Decompositions
Satellite research methods are frequently used in observations of water bodies. One of the most important problems in satellite observations is the presence of missing data due to internal malfunction of satellite sensors and poor atmospheric conditions. We proceeded on the assumption that the use of data recovery methods based on spatial relationships in data can increase the recovery accuracy. In this paper, we present a method for missing data reconstruction from remote sensors. We refer our method to as Tensor Interpolating Empirical Orthogonal Functions (TIEOF). The method relies on the two-dimensional nature of sensor images and organizes the data into three-dimensional tensors. We use high-order tensor decomposition to interpolate missing data on chlorophyll a concentration in lake Baikal (Russia, Siberia). Using MODIS and SeaWiFS satellite data of lake Baikal we show that the observed improvement of TIEOF was 69% on average compared to the current state-of-the-art DINEOF algorithm measured in various preprocessing data scenarios including thresholding and different interpolating schemes.