Journal Article

Domain Adaptation for Imitation Learning Using Generative Adversarial Network

Chanh Minh Tran, Phan Xuan Tan, Tho Nguyen Duc, Eiji Kamioka

2021

Overview

Imitation learning is an effective approach for an autonomous agent to learn control policies when an explicit reward function is unavailable, using demonstrations provided from an expert. However, standard imitation learning methods assume that the agents and the demonstrations provided by the expert are in the same domain configuration. Such an assumption has made the learned policies difficult to apply in another distinct domain. The problem is formalized as domain adaptive imitation learning, which is the process of learning how to perform a task optimally in a learner domain, given demonstrations of the task in a distinct expert domain. We address the problem by proposing a model based on Generative Adversarial Network. The model aims to learn both domain-shared and domain-specific features and utilizes it to find an optimal policy across domains. The experimental results show the effectiveness of our model in a number of tasks ranging from low to complex high-dimensional.

• Publisher: MDPI AG,MDPI
• Subject: Adaptation / Behavior / Chemical technology / domain adaptive imitation learning / generative adversarial network / imitation learning / Imitative Behavior / Learning / Performance evaluation / TP1-1185