Catalogue Search | MBRL
Search Results Heading
Explore the vast range of titles available.
MBRLSearchResults
-
DisciplineDiscipline
-
Is Peer ReviewedIs Peer Reviewed
-
Item TypeItem Type
-
SubjectSubject
-
YearFrom:-To:
-
More FiltersMore FiltersSourceLanguage
Done
Filters
Reset
129
result(s) for
"ADAM optimization algorithm"
Sort by:
Advanced Deep Learning Model for Predicting the Academic Performances of Students in Educational Institutions
by
Baniata, Laith H.
,
Alsharaiah, Mohammad A.
,
Kang, Sangwoo
in
Academic achievement
,
ADAM optimization algorithm
,
Analysis
2024
Educational institutions are increasingly focused on supporting students who may be facing academic challenges, aiming to enhance their educational outcomes through targeted interventions. Within this framework, leveraging advanced deep learning techniques to develop recommendation systems becomes essential. These systems are designed to identify students at risk of underperforming by analyzing patterns in their historical academic data, thereby facilitating personalized support strategies. This research introduces an innovative deep learning model tailored for pinpointing students in need of academic assistance. Utilizing a Gated Recurrent Neural Network (GRU) architecture, the model is rich with features such as a dense layer, max-pooling layer, and the ADAM optimization method used to optimize performance. The effectiveness of this model was tested using a comprehensive dataset containing 15,165 records of student assessments collected across several academic institutions. A comparative analysis with existing educational recommendation models, like Recurrent Neural Network (RNN), AdaBoost, and Artificial Immune Recognition System v2, highlights the superior accuracy of the proposed GRU model, which achieved an impressive overall accuracy of 99.70%. This breakthrough underscores the model’s potential in aiding educational institutions to proactively support students, thereby mitigating the risks of underachievement and dropout.
Journal Article
An Improved BGE-Adam Optimization Algorithm Based on Entropy Weighting and Adaptive Gradient Strategy
2024
This paper introduces an enhanced variant of the Adam optimizer—the BGE-Adam optimization algorithm—that integrates three innovative technologies to augment the adaptability, convergence, and robustness of the original algorithm under various training conditions. Firstly, the BGE-Adam algorithm incorporates a dynamic β parameter adjustment mechanism that utilizes the rate of gradient variations to dynamically adjust the exponential decay rates of the first and second moment estimates (β1 and β2), the adjustment of β1 and β2 is symmetrical, which means that the rules that the algorithm considers when adjusting β1 and β2 are the same. This design helps to maintain the consistency and balance of the algorithm, allowing the optimization algorithm to adaptively capture the trending movements of gradients. Secondly, it estimates the direction of future gradients by a simple gradient prediction model, combining historic gradient information with the current gradient. Lastly, entropy weighting is integrated into the gradient update step. This strategy enhances the model’s exploratory nature by introducing a certain amount of noise, thereby improving its adaptability to complex loss surfaces. Experimental results on classical datasets, MNIST and CIFAR10, and gastrointestinal disease medical datasets demonstrate that the BGE-Adam algorithm has improved convergence and generalization capabilities. In particular, on the specific medical image gastrointestinal disease test dataset, the BGE-Adam optimization algorithm achieved an accuracy of 69.36%, a significant improvement over the 67.66% accuracy attained using the standard Adam algorithm; on the CIFAR10 test dataset, the accuracy of the BGE-Adam algorithm reached 71.4%, which is higher than the 70.65% accuracy of the Adam optimization algorithm; and on the MNIST dataset, the BGE-Adam algorithm’s accuracy was 99.34%, surpassing the Adam optimization algorithm’s accuracy of 99.23%. The BGE-Adam optimization algorithm exhibits better convergence and robustness. This research not only demonstrates the effectiveness of the combination of these three technologies but also provides new perspectives for the future development of deep learning optimization algorithms.
Journal Article
A Novel Energy Accounting Model Using Fuzzy Restricted Boltzmann Machine—Recurrent Neural Network
by
Sorguli, Sarhang
,
Rjoub, Husam
in
Accounting
,
Accuracy
,
adaptive fuzzy Adam optimization algorithm (AFAOA)
2023
Energy accounting is a system for regularly measuring, analyzing, and reporting the energy use of various activities. This is done to increase energy efficiency and monitor the impact of energy usage on the environment. Primary energy accounting is now done by determining the amount of fossil fuel energy required to generate it. However, if fossil fuels become scarcer, this strategy becomes less viable. Instead, a new energy accounting approach will be required, one that takes into consideration the intermittent character of the two most prevalent renewable energy sources, wind and solar power. Furthermore, estimation of the energy consumption data collected from household surveys, whether using a recall-based approach or a meter-based one, remains a difficult task. Hence, this paper proposes a novel energy accounting model using Fuzzy Restricted Boltzmann Machine-Recurrent Neural Network (FRBM-RNN). The energy consumption dataset is preprocessed using linear-scaling normalization. The proposed model is optimized using the Adaptive Fuzzy Adam Optimization Algorithm (AFAOA). The performance metrics like Mean Square Error (MSE), Root Mean Square Error (RMSE), Mean Absolute Error (MAE), and Mean Absolute Percentage Error (MAPE) are estimated. The estimated results for our proposed technique are MSE (0.19), RMSE (0.44), MAE (0.2), and MAPE (3.5).
Journal Article
A Far-Field Helicopter Acoustic Detection Method Based on FRESH Adaptive Filtering
by
Wei, Chunhua
,
Liu, Tingting
,
Tao, Yingmeng
in
Acoustics
,
Adam optimization algorithm
,
Aerodynamics
2026
Helicopter detection plays a vital role in obtaining critical aerial information promptly and ensuring the safety of lives and property. Since a helicopter’s aerodynamic noise primarily consists of main rotor noise, the cyclostationarity of this noise becomes our detection target. This paper proposes a filter based on the Frequency-Shift (FRESH) principle, which is updated using the Adam optimization algorithm. A smoothed global detector is presented to detect the cyclic frequency of rotor noise. The effectiveness of the proposed helicopter detection approach, comprising both the filter and the detector, has been validated through simulations and confirmed by far-field experiments with a ROBINSON R22 helicopter. In these tests, the proposed method was compared against a cyclostationarity adaptive filter based on the Normalized Least Mean Squares (NLMS) algorithm, as well as the traditional Detection of Envelope Modulation on Noise (DEMON) and Cyclic Modulation Coherence (CMC) algorithms. Experimental results demonstrate the superior robustness of the proposed method over these benchmarks. Even at extended ranges between 11 and 13 km, the system retains a consistent detection rate of 77.8%.
Journal Article
Predicting the total Unified Parkinson’s Disease Rating Scale (UPDRS) based on ML techniques and cloud-based update
by
Akbarzadeh, Omid
,
Hamzehei, Sahand
,
Rezaee, Khosro
in
Algorithms
,
Cloud computing
,
Complexity
2023
Nowadays, smart health technologies are used in different life and environmental areas, such as smart life, healthcare, cognitive smart cities, and social systems. Intelligent, reliable, and ubiquitous healthcare systems are a part of the modern developing technology that should be more seriously considered. Data collection through different ways, such as the Internet of things (IoT)-assisted sensors, enables physicians to predict, prevent and treat diseases. Machine Learning (ML) algorithms may lead to higher accuracy in medical diagnosis/prognosis based on health data provided by the sensors to help physicians in tracking symptom significance and treatment steps. In this study, we applied four ML methods to the data on Parkinson’s disease to assess the methods’ performance and identify the essential features that may be used to predict the total Unified Parkinson’s disease Rating Scale (UPDRS). Since accessibility and high-performance decision-making are so vital for updating physicians and supporting IoT nodes (e.g., wearable sensors), all the data is stored, updated as rule-based, and protected in the cloud. Moreover, by assigning more computational equipment and memory in use, cloud computing makes it possible to reduce the time complexity of the training phase of ML algorithms in the cases we want to create a complete structure of cloud/edge architecture. In this situation, it is possible to investigate the approaches with varying iterations without concern for system configuration, temporal complexity, and real-time performance. Analyzing the coefficient of determination and Mean Square Error (MSE) reveals that the outcomes of the applied methods are mostly at an acceptable performance level. Moreover, the algorithm’s estimated weight indicates that Motor UPDRS is the most significant predictor of Total UPDRS.
Journal Article
Predicting the customer’s opinion on amazon products using selective memory architecture-based convolutional neural network
by
Gugulotu, Narsimha
,
Pabboju, Suresh
,
Mandhula, Trupthi
in
Abbreviations
,
Accuracy
,
Artificial neural networks
2020
Opinion mining and sentiment analysis are useful to extract subjective information out of bulk text documents. Predicting the customer’s opinion on amazon products has several benefits like reducing customer churn, agent monitoring, handling multiple customers, tracking overall customer satisfaction, quick escalations, and upselling opportunities. Though performing sentiment analysis is a challenging task for the researchers to identify the user’s sentiments from the large datasets, it is unstructured in nature, and also includes slangs, misspells, and abbreviations. To address this problem, a new proposed system is developed in this research study. Here, the proposed system comprises of four major phases; they are data collection, pre-processing, keyword extraction, and classification. Initially, the input data were collected from the dataset: amazon customer review. After collecting the data, pre-processing was carried out for enhancing the quality of collected data. The pre-processing phase comprises of three systems: lemmatization, review spam detection, and removal of stop words and URLs. Then, an effective topic modelling approach latent Dirichlet allocation along with modified possibilistic fuzzy C-Means was applied to extract the keywords and also helps in identifying the concerned topics. The extracted keywords were classified into three forms (positive, negative, and neutral) by applying an effective machine learning classifier: Selective memory architecture-based convolutional neural network. The experimental outcome showed that the proposed system enhanced the accuracy in sentiment analysis up to 6–20% related to the existing systems.
Journal Article
A New Method for Calculating Carbonate Mineral Content Based on the Fusion of Conventional and Special Logging Data—A Case Study of a Carbonate Reservoir in the M Oilfield in the Middle East
2025
In this study, we propose a self-adaptive weighted multi-mineral inversion model (SQP_AW) based on Sequential Quadratic Programming (SQP) and the Adam optimization algorithm for the accurate evaluation of mineral content in carbonate reservoir rocks, addressing the high costs of traditional experimental methods and the strong parameter dependence in geophysical inversion. The model integrates porosity curves (compensated density, compensated neutron, and acoustic time difference), elastic modulus parameters (shear and bulk moduli), and nuclear magnetic porosity data for the construction of a multi-dimensional linear equation system, with calibration coefficients derived from core X-ray diffraction (XRD) data. The Adam algorithm dynamically optimizes the weights, solving the overdetermined equation system. We applied the method to the Asmari Formation in the M oilfield in the Middle East with 40 core samples for calibration, achieving a 0.91 fit with the XRD data. For eight additional uncalibrated samples from Well A, the fit reaches 0.87. With the introduction of the elastic modulus and nuclear magnetic porosity, the average relative error in mineral content decreases from 9.45% to 6.59%, and that in porosity estimation decreases from 8.1% to 7.1%. The approach is also scalable to elemental logging data, yielding inversion precision comparable to that of commercial software. Although the method requires a complete set of logging data and further validation of regional applicability for weight parameters, in future research, transfer learning and missing curve prediction could be incorporated to enhance its practical utility.
Journal Article
Bad Data Repair for New Energy Stations in Power System Based on Multi-Model Parallel Integration Approach
2024
The accurate and reliable acquisition of measurement information is very important for the stable operation of power systems, especially the operation status information of new energy stations. With the increasing proportion of new energy stations in power systems, the quality issues of data from these stations, caused by communication congestion, interference, and network attacks, become more pronounced. In this paper, to deal with the issue of low accuracy and poor performance of bad data restoration in new energy stations, a novel deep learning approach by combining the modified long short-term memory (LSTM) neural network and Wasserstein generative adversarial network with gradient penalty (WGAN-GP) is proposed. The proposed method can be implemented in a parallel ensemble way. First, the normal data set acquired from multiple sections of new energy stations is utilized to train the modified LSTM and WGAN-GP model. Secondly, according to the data characteristics and rules captured by each model, the two models are systematically integrated and the bad data repair model pool is constructed. Subsequently, the results of model repair are screened and merged twice by the parallel integration framework to obtain the final repair result. Finally, the extensive experiments are carried out to verify the proposed method. The simulative results of energy stations in a real provincial power grid demonstrate that the proposed method can effectively repair bad data, thereby enhancing the data quality of new energy stations.
Journal Article
Influence of the Symmetry Neural Network Morphology on the Mine Detection Metric
by
Nazarkevych, Mariia Andriivna
,
Lytvyn, Vasyl Volodymyrovych
,
Peleshchak, Roman Mykhailovych
in
Accuracy
,
Anomalies
,
Asymmetry
2024
Presently, active detectors are widely used to detect mines, providing high accuracy. However, the principle of the operation of active detectors can lead to the explosion of hidden mines. The novelty of this work is the development of the morphology of a neural network for the classification of mines made of different materials (metallic, semi-metallic, plastic) with high accuracy (99.23%), based on a vector of input features with the following components: the value of the output voltage of the FLC-100 magnetic field sensor, which measures magnetic field anomalies in the vicinity of mines with an accuracy of 10−10–10−4 Tesla; six different soil types, depending on the humidity; and the height at which the magnetic field sensor is located above the mine. Due to the fact that mines, when made of different materials (metallic, semi-metallic, plastic), have different magnetic properties, the neural network method of mine classification, based on the sensor data regarding anomalies of the magnetic field in the vicinity of mines, allows the classification of mines made of different materials. The accuracy of mine classification was assessed with two-layer and three-layer neural networks on various metrics (confusion matrix, ROC curves, accuracy–loss curves), using ADAM, RMSprop, and SGD optimisers, and analyses and comparisons were then carried out. The impact of asymmetry in the neuron number and the types of activation functions in the first and second hidden layers on the values of the accuracy and loss metrics was studied. In particular, it was established that the asymmetry of the number of neurons in the first and second hidden layers relative to the plane of symmetry between the hidden layers has a significant effect on the accuracy of the model (decrease in accuracy by 25%), while the loss function, when the symmetry of the neurons number in the hidden layers is violated, increases to a maximum of 50%.
Journal Article