Explore the vast range of titles available.

For cases in which a machine learning model needs to be adapted to a new task, various approaches have been developed, including model-agnostic meta-learning (MAML) and transfer learning. In this paper, we investigate how the differences in the data distributions between the old tasks and the new target task impact performance in regression problems. By performing experiments, we discover that these differences greatly affect the relative performance of different adaptation methods. Based on this observation, we develop ensemble schemes combining multiple adaptation methods that can handle a wide range of data distribution differences between the old and new tasks, thus offering more stable performance for a wide range of tasks. For evaluation, we consider three regression problems of sinusoidal fitting, virtual reality motion prediction, and temperature forecasting. The evaluation results demonstrate that the proposed ensemble schemes achieve the best performance among the considered methods in most cases.

Neural networks for fault diagnosis need enough samples for training, but in practical applications, there are often insufficient samples. In order to solve this problem, we propose a wavelet-prototypical network based on fusion of time and frequency domain (WPNF). The time domain and frequency domain information of the vibration signal can be sent to the model simultaneously to expand the characteristics of the data, a parallel two-channel convolutional structure is proposed to process the information of the signal. After that, a wavelet layer is designed to further extract features. Finally, a prototypical layer is applied to train this network. Experimental results show that the proposed method can accurately identify new classes that have never been used during the training phase when the number of samples in each class is very small, and it is far better than other traditional machine learning models in few-shot scenarios.

With the rapid emergence of the Internet of Things (IoT) devices, there were new vectors for attacking cyber, so there was a need for approachable intrusion detection systems (IDSs) with more innovative custom tactics. The traditional IDS models tend to find difficulties in generalization in the continuously changing and heterogeneous IoT environments. This paper contributes to an adaptive intrusion detection framework using Model-Agnostic Meta-Learning (MAML) and few-shot learning paradigms to quickly adapt to new tasks with little data. The goal of this research is to improve the security of IoT by developing a strong IDS that will perform well across assorted datasets and attack environments. Finally, we apply our proposed framework to two benchmark datasets, UNSW-NB15 and NSL-KDD99, which provide different attack scenarios and network behaviors. The methodology trains a base model with MAML to allow fast adaptation on specific tasks during fine-tuning. Our approach leads to experimental results with 99.98% accuracy, 99.5% precision, 99.0% recall, and 99.4% F1 score on the UNSW-NB15 dataset. The model achieved 99.1% accuracy, 97.3% precision, 98.2% recall, and 98.5% F1 score on the NSL-KDD99 dataset. That shows that MAML can detect many cyber threats in IoT environments. Based on this study, it is concluded that meta-learning-based intrusion detection could help build resilient IoT systems. Future works will move educated meta-learning to a federated setting and deploy it in real time in response to changing threats.

Despite the rapid expansion of smart grids and large volumes of data at the individual consumer level, there are still various cases where adequate data collection to train accurate load forecasting models is challenging or even impossible. This paper proposes adapting an established Model-Agnostic Meta-Learning algorithm for short-term load forecasting in the context of few-shot learning. Specifically, the proposed method can rapidly adapt and generalize within any unknown load time series of arbitrary length using only minimal training samples. In this context, the meta-learning model learns an optimal set of initial parameters for a base-level learner recurrent neural network. The proposed model is evaluated using a dataset of historical load consumption data from real-world consumers. Despite the examined load series’ short length, it produces accurate forecasts outperforming transfer learning and task-specific machine learning methods by 12.5%. To enhance robustness and fairness during model evaluation, a novel metric, mean average log percentage error, is proposed that alleviates the bias introduced by the commonly used MAPE metric. Finally, a series of studies to evaluate the model’s robustness under different hyperparameters and time series lengths is also conducted, demonstrating that the proposed approach consistently outperforms all other models.

The international organizations of education have already pointed out that the way students learn, what they learn, and the skills needed, will be radically transformed in the coming years. Smart technologies are ready to come into play, changing the conditions of learning, providing opportunities for transformative learning experiences, and promising more conscious, self-directed and self-motivated learning. Meta-learning refers to a set of mental meta-processes by which learners consciously create and manage personal models of learning. Meta-learning entails a cluster of meta-skills that are progressively and hierarchically transformed, ensuring the transition to the highest levels of understanding termed meta-comprehension. The current article aims to investigate the concept of meta-learning and describe the meta-levels of learning through the lens of metacognition. In addition, the potential of smart technologies to provide fertile ground for the implementation of meta-learning training strategies is examined. The results of this article provide a new meta-learning theoretical framework supported by smart devices capable of supporting future meta-learners or, more accurately, meta-thinkers, to transcend the usual states of knowing and move to the next meta-levels of human intelligence.

The performance of deep learning is heavily influenced by the size of the learning samples, whose labeling process is time consuming and laborious. Deep learning algorithms typically assume that the training and prediction data are independent and uniformly distributed, which is rarely the case given the attributes and properties of different data sources. In remote sensing images, representations of urban land surfaces can vary across regions and by season, demanding rapid generalization of these surfaces in remote sensing data. In this study, we propose Meta-FSEO, a novel model for improving the performance of few-shot remote sensing scene classification in varying urban scenes. The proposed Meta-FSEO model deploys self-supervised embedding optimization for adaptive generalization in new tasks such as classifying features in new urban regions that have never been encountered during the training phase, thus balancing the requirements for feature classification tasks between multiple images collected at different times and places. We also created a loss function by weighting the contrast losses and cross-entropy losses. The proposed Meta-FSEO demonstrates a great generalization capability in remote sensing scene classification among different cities. In a five-way one-shot classification experiment with the Sentinel-1/2 Multi-Spectral (SEN12MS) dataset, the accuracy reached 63.08%. In a five-way five-shot experiment on the same dataset, the accuracy reached 74.29%. These results indicated that the proposed Meta-FSEO model outperformed both the transfer learning-based algorithm and two popular meta-learning-based methods, i.e., MAML and Meta-SGD.

The global education develops competencies and skills necessary to operate in a global environment. These include intercultural communication skills, transnational collaboration, critical thinking and problem solving in a global context, as well as digital and global literacy skills. These skills are essential in the globalized world, where interactions and collaboration with people from various other cultures and countries are commonplace. For example, students and teachers have the opportunity to participate in exchange programs, international partnerships and joint projects, which allow them to understand and connect with other educational systems and cultures. These experiences enrich learning and promote the international cooperation. In this context, the purpose of this work is to carry out a theoretical analysis of the educational dimension in the context of supporting the idea of meta-learning. Such an image involves an epistemic analysis of the concept of \"meta-learning\" from the perspective of strategies for augmenting one’s autonomy in learning. Reported in the school environment, such an approach becomes significant in that we can talk about optimizing the school performance. The meta-learning improves the educational effectiveness and it is defined as a process of awareness on the part of learners of the need to monitor their own learning progress.

Deep learning has accomplished impressive excellence in many fields. However, its achievement relies on a vast amount of marker data and when there is insufficient labeled data, the phenomenon of over-fitting will occur. On the other hand, the real world tends to be so non-stationary that neural networks cannot learn continuously like humans. The specific manifestation is that learning new tasks leads to a significant decrease in its performance on old tasks. In responding to the above problem, this paper proposes a new algorithm CMLA (Continual Meta-Learning Algorithm) based on meta-learning. CMLA cannot only extract the key features of the sample, but also optimize the update method of the task gradient by introducing the cosine similarity judgment mechanism. The algorithm is tested on miniImageNet and Fewshot-CIFAR100 (Canadian Institute For Advanced Research), and the outcome clearly reveals the effectiveness and superiority of the CMLA in comparison with other advanced systems. Especially compared to MAML (Model-Agnostic Meta-Learning) with standard four-layer convolution, the accuracy of 1 shot and 5 shot is improved by 15.4% and 16.91% respectively under the setting of 5-way on miniImageNet. CMLA not only reduces the instability of the adaptation process, but also solves the stability-plasticity dilemma to a certain extent, achieving the goal of continual learning.

The artificial intelligence (AI) within the last decade has experienced a rapid development and has attained power to simulate human‐thinking in various situations. When the deep neural networks (DNNs) are trained with huge dataset and high computational resources it can bring out great outcomes. But the learning process of DNN is very much complicated and time‐consuming. In various circumstances, where there is a data‐scarcity, the algorithms are not capable of learning tasks at a faster rate and perform nearer to that of human intelligence. With advancements in deep meta‐learning in several research studies, this problem has been dealt. Meta‐learning has outspread range of applications where the meta‐data (data about data) of the either tasks, data or the models which were previously trained can be employed to optimise the learning. So in order to get an insight of all existing meta‐learning approaches for DNN model optimisation, the authors performed survey introducing different meta‐learning techniques and also the current optimisation‐based approaches, their merits and open challenges. In this research, the Reptile meta‐learning algorithm was chosen for the experiment. As Reptile uses first‐order derivatives during optimisation process, hence making it feasible to solve optimisation problems. The authors achieved a 5% increase in accuracy with the proposed version of Reptile meta‐learning algorithm.

Although few-shot learning (FSL) has achieved great progress, it is still an enormous challenge especially when the source and target set are from different domains, which is also known as cross-domain few-shot learning (CD-FSL). Utilizing more source domain data is an effective way to improve the performance of CD-FSL. However, knowledge from different source domains may entangle and confuse with each other, which hurts the performance on the target domain. Therefore, we propose team-knowledge distillation networks (TKD-Net) to tackle this problem, which explores a strategy to help the cooperation of multiple teachers. Specifically, we distill knowledge from the cooperation of teacher networks to a single student network in a meta-learning framework. It incorporates task-oriented knowledge distillation and multiple cooperation among teachers to train an efficient student with better generalization ability on unseen tasks. Moreover, our TKD-Net employs both response-based knowledge and relation-based knowledge to transfer more comprehensive and effective knowledge. Extensive experimental results on four fine-grained datasets have demonstrated the effectiveness and superiority of our proposed TKD-Net approach.