Paper

A modeling framework for adaptive lifelong learning with transfer and savings through gating in the prefrontal cortex

Sejnowski, Terrence J, Tye, Kay M, Siegelmann, Hava T, Tsuda, Ben

2020

Overview

The prefrontal cortex encodes and stores numerous, often disparate, schemas and flexibly switches between them. Recent research on artificial neural networks trained by reinforcement learning has made it possible to model fundamental processes underlying schema encoding and storage. Yet how the brain is able to create new schemas while preserving and utilizing old schemas remains unclear. Here we propose a simple neural network framework based on a modification of the mixture of experts architecture to model the prefrontal cortex's ability to flexibly encode and use multiple disparate schemas. We show how incorporation of gating naturally leads to transfer learning and robust memory savings. We then show how phenotypic impairments observed in patients with prefrontal damage are mimicked by lesions of our network. Our architecture, which we call DynaMoE, provides a fundamental framework for how the prefrontal cortex may handle the abundance of schemas necessary to navigate the real world.

• Publisher: Cold Spring Harbor Laboratory Press,Cold Spring Harbor Laboratory
• Subject: Gating / Neural networks / Neuroscience / Prefrontal cortex / Transfer learning