Coadaptive brain-machine interface via reinforcement learning

Jack DiGiovanna, Babak Mahmoudi, Jose Fortes, Jose C. Principe, Justin C. Sanchez

Research output: Contribution to journalArticle

102 Scopus citations

Abstract

This paper introduces and demonstrates a novel brain-machine interface (BMI) architecture based on the concepts of reinforcement learning (RL), coadaptation, and shaping. RL allows the BMI control algorithm to learn to complete tasks from interactions with the environment, rather than an explicit training signal. Coadaption enables continuous, synergistic adaptation between the BMI control algorithm and BMI user working in changing environments. Shaping is designed to reduce the learning curve for BMI users attempting to control a prosthetic. Here, we present the theory and in vivo experimental paradigm to illustrate how this BMI learns to complete a reaching task using a prosthetic arm in a 3-D workspace based on the user's neuronal activity. This semisupervised learning framework does not require user movements. We quantify BMI performance in closed-loop brain control over six to ten days for three rats as a function of increasing task difficulty. All three subjects coadapted with their BMI control algorithms to control the prosthetic significantly above chance at each level of difficulty.

Original languageEnglish (US)
Pages (from-to)54-64
Number of pages11
JournalIEEE Transactions on Biomedical Engineering
Volume56
Issue number1
DOIs
StatePublished - Jan 1 2009

Keywords

  • Brain-machine interface (BMI)
  • Coadaptation
  • Neuroprosthetic
  • Reinforcement learning (RL)

ASJC Scopus subject areas

  • Biomedical Engineering

Fingerprint Dive into the research topics of 'Coadaptive brain-machine interface via reinforcement learning'. Together they form a unique fingerprint.

  • Cite this

    DiGiovanna, J., Mahmoudi, B., Fortes, J., Principe, J. C., & Sanchez, J. C. (2009). Coadaptive brain-machine interface via reinforcement learning. IEEE Transactions on Biomedical Engineering, 56(1), 54-64. https://doi.org/10.1109/TBME.2008.926699