Catalogue Search | MBRL
Search Results Heading
Explore the vast range of titles available.
MBRLSearchResults
-
DisciplineDiscipline
-
Is Peer ReviewedIs Peer Reviewed
-
Item TypeItem Type
-
SubjectSubject
-
YearFrom:-To:
-
More FiltersMore FiltersSourceLanguage
Done
Filters
Reset
9,600
result(s) for
"sequence learning"
Sort by:
Multi‐step‐ahead flood forecasting using an improved BiLSTM‐S2S model
by
Zhu, Feilin
,
Zhang, Hanchen
,
Cao, Qing
in
Benchmarks
,
bidirectional long short‐term memory
,
Error reduction
2022
Rainfall–runoff modeling is a complex hydrological issue that still has room for improvement. This study developed a coupled bidirectional long short‐term memory (LSTM) with sequence‐to‐sequence (Seq2Seq) learning (BiLSTM‐Seq2seq) model to simulate multi‐step‐ahead runoff for flood events. The bidirectional LSTM with Seq2Seq learning (LSTM‐Seq2Seq) and multilayer perceptron (MLP) was set as benchmarks. The results show that: (1) root mean absolute error is reduced by approximately 19% up to 27%, and the Nash–Sutcliffe coefficient of efficiency is improved by 14% up to 34% for 6‐h‐ahead runoff prediction for BiLSTM‐Seq2Seq compared LSTM‐Seq2Seq and MLP; (2) The BiLSTM‐Seq2Seq model has good performance not only for one‐peak flood events but also for multi‐peak flood events; and (3) BiLSTM‐Seq2Seq can mitigate the time‐delay problem and time lag is shortened by 39% up to 69% in comparison to LSTM‐Seq2Seq and MLP. These results suggest that the time‐delay problem can be mitigated by BiLSTM‐Seq2Seq, which has excellent potential in time series predictions in the hydrological field.
Journal Article
The Neural Basis of Implicit Perceptual Sequence Learning
by
Roggeman, Chantal
,
Van Waelvelde, Hilde
,
Van Opstal, Filip
in
Brain mapping
,
Caudate Nucleus
,
Color
2011
The present fMRI study investigated the neural areas involved in implicit perceptual sequence learning. To obtain more insight in the functional contributions of the brain areas, we tracked both the behavioral and neural time course of the learning process, using a perceptual serial color matching task. Next, to investigate whether the neural time course was specific for perceptual information, imaging results were compared to the results of implicit motor sequence learning, previously investigated using an identical serial color matching task (Gheysen et al., 2010). Results indicated that implicit sequences can be acquired by at least two neural systems: the caudate nucleus and the hippocampus, having different operating principles. The caudate nucleus contributed to the implicit sequence learning process for perceptual as well as motor information in a similar and gradual way. The hippocampus, on the other hand, was engaged in a much faster learning process which was more pronounced for the motor compared to the perceptual task. Interestingly, the perceptual and motor learning process occurred on a comparable implicit level, suggesting that consciousness is not the main determinant factor dissociating the hippocampal from the caudate learning system. This study is not only the first to successfully and unambiguously compare brain activation between perceptual and motor levels of implicit sequence learning, it also provides new insights into the specific hippocampal and caudate learning function.
Journal Article
Analyzing Students' Learning Progressions Throughout a Teaching Sequence on Acoustic Properties of Materials with a Model-Based Inquiry Approach
by
Couso, Digna
,
Hernández, Maria Isabel
,
Pintó, Roser
in
Acoustic properties
,
Acoustics
,
Active Learning
2015
The study we have carried out aims to characterize 15-to 16-year-old students' learning progressions throughout the implementation of a teaching-learning sequence on the acoustic properties of materials. Our purpose is to better understand students' modeling processes about this topic and to identify how the instructional design and actual enactment influences students' learning progressions. This article presents the design principles which elicit the structure and types of modeling and inquiry activities designed to promote students' development of three conceptual models. Some of these activities are enhanced by the use of ICT such as sound level meters connected to data capture systems, which facilitate the measurement of the intensity level of sound emitted by a sound source and transmitted through different materials. Framing this study within the design-based research paradigm, it consists of the experimentation of the designed teaching sequence with two groups of students (n = 29) in their science classes. The analysis of students' written productions together with classroom observations of the implementation of the teaching sequence allowed characterizing students' development of the conceptual models. Moreover, we could evidence the influence of different modeling and inquiry activities on students' development of the conceptual models, identifying those that have a major impact on students' modeling processes. Having evidenced different levels of development of each conceptual model, our results have been interpreted in terms of the attributes of each conceptual model, the distance between students' preliminary mental models and the intended conceptual models, and the instructional design and enactment.
Journal Article
Sequence to Sequence Model Performance for Education Chatbot
2019
Chatbot for education has great potential to complement human educators and education administrators. For example, it can be around the clock tutor to answer and clarify any questions from students who may have missed class. A chatbot can be implemented either by ruled based or artificial intel-ligence based. However, unlike the ruled-based chatbots, artificial intelli-gence based chatbots can learn and become smarter overtime and is more scalable and has become the popular choice for chatbot researchers recently. Recurrent Neural Network based Sequence-to-sequence (Seq2Seq) model is one of the most commonly researched model to implement artificial intelli-gence chatbot and has shown great progress since its introduction in 2014. However, it is still in infancy and has not been applied widely in educational chatbot development. Introduced originally for neural machine translation, the Seq2Seq model has been adapted for conversation modelling including question-answering chatbots. However, in-depth research and analysis of op-timal settings of the various components of Seq2Seq model for natural an-swer generation problem is very limited. Additionally, there has been no ex-periments and analysis conducted to understand how Seq2Seq model handles variations is questions posed to it to generate correct answers. Our experi-ments add to the empirical evaluations on Seq2Seq literature and provides insights to these questions. Additionally, we provide insights on how a cu-rated dataset can be developed and questions designed to train and test the performance of a Seq2Seq based question-answer model.
Journal Article
A deep learning approach for line-level Amharic Braille image recognition
by
Alemu, Kassawmar Mandefro
,
Asfaw, Nega Agmas
,
Belay, Birhanu Hailu
in
639/705/117
,
639/705/258
,
Amharic braille character recognition
2024
Braille, the most popular tactile-based writing system, uses patterns of raised dots arranged in cells to inscribe characters for visually impaired persons. Amharic is Ethiopia’s official working language, spoken by more than 100 million people. To bridge the written communication gap between persons with and without eyesight, multiple Optical braille recognition systems for various language scripts have been developed utilizing both statistical and deep learning approaches. However, the need for half-character identification and character segmentation has complicated these systems, particularly in the Amharic script, where each character is represented by two braille cells. To address these challenges, this study proposed deep learning model that combines a CNN and a BiLSTM network with CTC. The model was trained with 1,800 line images with 32 × 256 and 48 × 256 dimensions, and validated with 200 line images and evaluated using Character Error Rate. The best-trained model had a CER of 7.81% on test data with a 48 × 256 image dimension. These findings demonstrate that the proposed sequence-to-sequence learning method is a viable Optical Braille Recognition (OBR) solution that does not necessitate extensive image pre and post processing. Inaddition, we have made the first Amharic braille line-image data set available for free to researchers via the link:
https://github.com/Ne-UoG-git/Am-Br-line-image.github.io
.
Journal Article
Implicit sequence learning in people with Parkinson's disease
by
Gamble, Katherine R
,
Cummings, Jr, Thomas J
,
Howard, Jr, James H
in
Adults
,
Age differences
,
Aging
2014
Implicit sequence learning involves learning about dependencies in sequences of events without intent to learn or awareness of what has been learned. Sequence learning is related to striatal dopamine levels, striatal activation, and integrity of white matter connections. People with Parkinson's disease (PD) have degeneration of dopamine-producing neurons, leading to dopamine deficiency and therefore striatal deficits, and they have difficulties with sequencing, including complex language comprehension and postural stability. Most research on implicit sequence learning in PD has used motor-based tasks. However, because PD presents with motor deficits, it is difficult to assess whether learning itself is impaired in these tasks. The present study used an implicit sequence learning task with a reduced motor component, the Triplets Learning Task (TLT). People with PD and age- and education-matched healthy older adults completed three sessions (each consisting of 10 blocks of 50 trials) of the TLT. Results revealed that the PD group was able to learn the sequence, however, when learning was examined using a Half Blocks analysis (Nemeth et al., 2013), which compared learning in the 1st 25/50 trials of all blocks to that in the 2nd 25/50 trials, the PD group showed significantly less learning than Controls in the 2nd Half Blocks, but not in the 1st. Nemeth et al. (2013) hypothesized that the 1st Half Blocks involve recall and reactivation of the sequence learned, thus reflecting hippocampal-dependent learning, while the 2nd Half Blocks involve proceduralized behavior of learned sequences, reflecting striatal-based learning. The present results suggest that the PD group had intact hippocampal-dependent implicit sequence learning, but impaired striatal-dependent learning. Thus, sequencing deficits in PD are likely due to striatal impairments, but other brain systems, such as the hippocampus, may be able to partially compensate for striatal decline to improve performance.
Journal Article
Usage of autoencoders and Siamese networks for online handwritten signature verification
by
Ahrabian, Kian
,
BabaAli, Bagher
in
Accuracy
,
Artificial Intelligence
,
Artificial neural networks
2019
In this paper, we propose a novel writer-independent global feature extraction framework for the task of automatic signature verification which aims to make robust systems for automatically distinguishing negative and positive samples. Our method consists of an autoencoder for modeling the sample space into a fixed-length latent space and a siamese network for classifying the fixed-length samples obtained from the autoencoder based on the reference samples of a subject as being genuine or forged. During our experiments, usage of attention mechanism and applying downsampling significantly improved the accuracy of the proposed framework. We evaluated our proposed framework using SigWiComp2013 Japanese and GPDSsyntheticOnLineOffLineSignature datasets. On the SigWiComp2013 Japanese dataset, we achieved 8.65% equal error rate (EER) that means 1.2% relative improvement compared to the best-reported result. Furthermore, on the GPDSsyntheticOnLineOffLineSignature dataset, we achieved average EERs of 0.13%, 0.12%, 0.21% and 0.25%, respectively, for 150, 300, 1000 and 2000 test subjects which indicate improvement in relative EER on the best-reported result by 95.67%, 95.26%, 92.9% and 91.52%, respectively. Apart from the accuracy gain, because of the nature of our proposed framework which is based on neural networks and consequently is as simple as some consecutive matrix multiplications, it has less computational cost than conventional methods such as Dynamic Time Warping and could be used concurrently on devices such as Graphics Processing Unit and Tensor Processing Unit.
Journal Article
Changing the structure of complex visuo-motor sequences selectively activates the fronto-parietal network
by
Ahmed
,
Pammi, V.S. Chandrasekhar
,
Miyapuram, K.P.
in
Chunking
,
Complex sequence learning
,
Female
2012
Previous brain imaging studies investigating motor sequence complexity have mainly examined the effect of increasing the length of pre-learned sequences. The novel contribution of this research is that we varied the structure of complex visuo-motor sequences along two different dimensions using mxn paradigm. The complexity of sequences is increased from 12 movements (organized as a 2×6 task) to 24 movements (organized as 4×6 and 2×12 tasks). Behavioral results indicate that although the success rate attained was similar across the two complex tasks (2×12 and 4×6), a greater decrease in response times was observed for the 2×12 compared to the 4×6 condition at an intermediate learning stage. This decrease is possibly related to successful chunking across sets in the 2×12 task. In line with this, we observed a selective activation of the fronto-parietal network. Shifts of activation were observed from the ventral to dorsal prefrontal, lateral to medial premotor and inferior to superior parietal cortex from the early to intermediate learning stage concomitant with an increase in hyperset length. We suggest that these selective activations and shifts in activity during complex sequence learning are possibly related to chunking of motor sequences.
► Structure of complex motor sequences varied while controlling for sequence length. ► Chunking across several elements was observed with increase in long-range complexity. ► Concomitant shifts in fronto-parietal activation observed. ► Plausible neural correlates of chunking during motor sequence learning suggested.
Journal Article
Neural personalized response generation as domain adaptation
2019
One of the most crucial problem on training personalized response generation models for conversational robots is the lack of large scale personal conversation data. To address the problem, we propose a two-phase approach, namely initialization then adaptation, to first pre-train an optimized RNN encoder-decoder model (LTS model) in a large scale conversational data for general response generation and then fine-tune the model in a small scale personal conversation data to generate personalized responses. For evaluation, we propose a novel human aided method, which can be seen as a quasi-Turing test, to evaluate the performance of the personalized response generation models. Experimental results show that the proposed personalized response generation model outperforms the state-of-the-art approaches to language model personalization and persona-based neural conversation generation on the automatic evaluation, offline human judgment and the quasi-Turing test.
Journal Article
Machine translation using deep learning for universal networking language based on their structure
by
Rahman, Md. Lizur
,
Chaki, Jyotismita
,
Santosh, K. C.
in
Algorithms
,
Artificial Intelligence
,
Bilingualism
2021
This paper presents a deep learning-based machine translation (MT) system that translates a sentence of subject-object-verb (SOV) structured language into subject-verb-object (SVO) structured language. This system uses recurrent neural networks (RNNs) and Encodings. Encode embedded RNNs generate a set of numbers from the input sentence, where the second RNNs generate the output from these sets of numbers. Three popular datasets of SOV structured language i.e., EMILLE corpus, Prothom-Alo corpus and Punjabi Monolingual Text Corpus ILCI-II are used as two different case-study to validate. In our experimental case-study 1, for the EMILLE corpus and Prothom-Alo corpus dataset, we have achieved 0.742, 4.11 and 0.18, respectively as Bilingual Evaluation Understudy (BLEU), NIST (metric) and tertiary entrance rank scores. Another case-study for Punjabi Monolingual Text Corpus ILCI-II dataset achieved a BLEU score of 0.75. Our results can be compared with the state-of-the-art results.
Journal Article