Catalogue Search | MBRL
Search Results Heading
Explore the vast range of titles available.
MBRLSearchResults
-
DisciplineDiscipline
-
Is Peer ReviewedIs Peer Reviewed
-
Item TypeItem Type
-
SubjectSubject
-
YearFrom:-To:
-
More FiltersMore FiltersSourceLanguage
Done
Filters
Reset
7
result(s) for
"batch normalisation techniques"
Sort by:
Enhanced CNN for image denoising
by
Wang, Junqian
,
Luo, Nan
,
Xu, Yong
in
Artificial neural networks
,
authors
,
B6135 Optical, image and video signal processing
2019
Owing to the flexible architectures of deep convolutional neural networks (CNNs) are successfully used for image denoising. However, they suffer from the following drawbacks: (i) deep network architecture is very difficult to train. (ii) Deeper networks face the challenge of performance saturation. In this study, the authors propose a novel method called enhanced convolutional neural denoising network (ECNDNet). Specifically, they use residual learning and batch normalisation techniques to address the problem of training difficulties and accelerate the convergence of the network. In addition, dilated convolutions are used in the proposed network to enlarge the context information and reduce the computational cost. Extensive experiments demonstrate that the ECNDNet outperforms the state-of-the-art methods for image denoising.
Journal Article
A comprehensive and quantitative review of dark fermentative biohydrogen production
2012
Biohydrogen production (BHP) can be achieved by direct or indirect biophotolysis, photo-fermentation and dark fermentation, whereof only the latter does not require the input of light energy. Our motivation to compile this review was to quantify and comprehensively report strains and process performance of dark fermentative BHP. This review summarizes the work done on pure and defined co-culture dark fermentative BHP since the year 1901. Qualitative growth characteristics and quantitative normalized results of H
2
production for more than 2000 conditions are presented in a normalized and therefore comparable format to the scientific community.
Statistically based evidence shows that thermophilic strains comprise high substrate conversion efficiency, but mesophilic strains achieve high volumetric productivity. Moreover, microbes of
Thermoanaerobacterales
(Family III) have to be preferred when aiming to achieve high substrate conversion efficiency in comparison to the families
Clostridiaceae
and
Enterobacteriaceae
.
The limited number of results available on dark fermentative BHP from fed-batch cultivations indicates the yet underestimated potential of this bioprocessing application. A Design of Experiments strategy should be preferred for efficient bioprocess development and optimization of BHP aiming at improving medium, cultivation conditions and revealing inhibitory effects. This will enable comparing and optimizing strains and processes independent of initial conditions and scale.
Journal Article
An Intelligent Recurrent Neural Network with Long Short-Term Memory (LSTM) BASED Batch Normalization for Medical Image Denoising
by
Rajeev, R
,
Karthikeyan, N K
,
J Abdul Samath
in
Algorithms
,
Image processing
,
Information processing
2019
The process of denoising of medical images that are corrupted by noise is considered as a long established setback in the signal or image processing domain. An effective system for denoising in order to remove white, salt and also pepper noises by means of merging the Long Short-Term Memory, otherwise known as LSTM, based Batch Normalization and Recurrent Neural Network or RNN techniques have been proposed in this research paper. The images of the lung CT are considered as an input in this particular work. Following this, an effectual batch size is calculated by employing the method of Particle Swarm Optimization (PSO). To denoise the image, Recurrent Neural Network or RNN algorithm were proposed, here to reduce the internal covariate shift present in the neural networks, the Long Short-Term Memory or LSTM based Batch Normalization is brought-in. With respect to SNR or Peak Signal to Noise Ratio and Mean Square Error (MSE), operations were assessed. This algorithm is considered as competitive to other denoising schemes which have been confirmed by the experimental outcomes.
Journal Article
A High-Performance Spectral-Spatial Residual Network for Hyperspectral Image Classification with Small Training Data
by
Sohel, Ferdous
,
Edwards, David
,
Khotimah, Wijayanti Nurul
in
accuracy
,
architecture
,
Batch Normalization
2020
In this paper, we propose a high performance Two-Stream spectral-spatial Residual Network (TSRN) for hyperspectral image classification. The first spectral residual network (sRN) stream is used to extract spectral characteristics, and the second spatial residual network (saRN) stream is concurrently used to extract spatial features. The sRN uses 1D convolutional layers to fit the spectral data structure, while the saRN uses 2D convolutional layers to match the hyperspectral spatial data structure. Furthermore, each convolutional layer is preceded by a Batch Normalization (BN) layer that works as a regularizer to speed up the training process and to improve the accuracy. We conducted experiments on three well-known hyperspectral datasets, and we compare our results with five contemporary methods across various sizes of training samples. The experimental results show that the proposed architecture can be trained with small size datasets and outperforms the state-of-the-art methods in terms of the Overall Accuracy, Average Accuracy, Kappa Value, and training time.
Journal Article
Pseudo high-frequency boosts the generalization of a convolutional neural network for cassava disease detection
2022
Frequency is essential in signal transmission, especially in convolutional neural networks. It is vital to maintain the signal frequency in the neural network to maintain the performance of a convolutional neural network. Due to destructive signal transmission in convolutional neural network, signal frequency downconversion in channels results into incomplete spatial information. In communication theory, the number of Fourier series coefficients determines the integrity of the information transmitted in channels. Consequently, the number of Fourier series coefficients of the signals can be replenished to reduce the information transmission loss. To achieve this, the ArsenicNetPlus neural network was proposed for signal transmission modulation in detecting cassava diseases. First, multiattention was used to maintain the long-term dependency of the features of cassava diseases. Afterward, depthwise convolution was implemented to remove aliasing signals and downconvert before the sampling operation. Instance batch normalization algorithm was utilized to keep features in an appropriate form in the convolutional neural network channels. Finally, the ArsenicPlus block was implemented to generate pseudo high-frequency in the residual structure. The proposed method was tested on the Cassava Datasets and compared with the V2-ResNet-101, EfficientNet-B5, RepVGG-B3g4 and AlexNet. The results showed that the proposed method performed
95.93
%
in terms of accuracy, 1.2440 in terms of loss, and
95.94
%
in terms of the F1-score, outperforming the comparison algorithms.
Journal Article
LSTM Accelerator for Convolutional Object Identification
by
Kanavos, Andreas
,
Sioutas, Spyros
,
Savvopoulos, Alkiviadis
in
Accuracy
,
Algorithms
,
Artificial intelligence
2018
Deep Learning has dramatically advanced the state of the art in vision, speech and many other areas. Recently, numerous deep learning algorithms have been proposed to solve traditional artificial intelligence problems. In this paper, in order to detect the version that can provide the best trade-off in terms of time and accuracy, convolutional networks of various depths have been implemented. Batch normalization is also considered since it acts as a regularizer and achieves the same accuracy with fewer training steps. For maximizing the yield of the complexity by diminishing, as well as minimizing the loss of accuracy, LSTM neural net layers are utilized in the process. The image sequences are proven to be classified by the LSTM in a more accelerated manner, while managing better precision. Concretely, the more complex the CNN, the higher the percentages of exactitude; in addition, but for the high-rank increase in accuracy, the time was significantly decreased, which eventually rendered the trade-off optimal. The average improvement of performance for all models regarding both datasets used amounted to 42 % .
Journal Article
GDnet-IP: Grouped Dropout-Based Convolutional Neural Network for Insect Pest Recognition
by
Li, Dongcheng
,
Xu, Yongqi
,
Yuan, Zheming
in
Accuracy
,
activation function
,
Adaptive algorithms
2024
Lightweight convolutional neural network (CNN) models have proven effective in recognizing common pest species, yet challenges remain in enhancing their nonlinear learning capacity and reducing overfitting. This study introduces a grouped dropout strategy and modifies the CNN architecture to improve the accuracy of multi-class insect recognition. Specifically, we optimized the base model by selecting appropriate optimizers, fine-tuning the dropout probability, and adjusting the learning rate decay strategy. Additionally, we replaced ReLU with PReLU and added BatchNorm layers after each Inception layer, enhancing the model’s nonlinear expression and training stability. Leveraging the Inception module’s branching structure and the adaptive grouping properties of the WeDIV clustering algorithm, we developed two grouped dropout models, the iGDnet-IP and GDnet-IP. Experimental results on a dataset containing 20 insect species (15 pests and five beneficial insects) demonstrated an increase in cross-validation accuracy from 84.68% to 92.12%, with notable improvements in the recognition rates for difficult-to-classify species, such as Parnara guttatus Bremer and Grey (PGBG) and Papilio xuthus Linnaeus (PXLL), increasing from 38% and 47% to 62% and 93%, respectively. Furthermore, these models showed significant accuracy advantages over standard dropout methods on test sets, with faster training times compared to four conventional CNN models, highlighting their suitability for mobile applications. Theoretical analyses of model gradients and Fisher information provide further insight into the grouped dropout strategy’s role in improving CNN interpretability for insect recognition tasks.
Journal Article