Coadaptive brain-machine interface via reinforcement learning

Jack DiGiovanna, Babak Mahmoudi, Jose Fortes, Jose C. Principe, Justin C. Sanchez

Research output: Contribution to journalArticlepeer-review

112 Scopus citations


This paper introduces and demonstrates a novel brain-machine interface (BMI) architecture based on the concepts of reinforcement learning (RL), coadaptation, and shaping. RL allows the BMI control algorithm to learn to complete tasks from interactions with the environment, rather than an explicit training signal. Coadaption enables continuous, synergistic adaptation between the BMI control algorithm and BMI user working in changing environments. Shaping is designed to reduce the learning curve for BMI users attempting to control a prosthetic. Here, we present the theory and in vivo experimental paradigm to illustrate how this BMI learns to complete a reaching task using a prosthetic arm in a 3-D workspace based on the user's neuronal activity. This semisupervised learning framework does not require user movements. We quantify BMI performance in closed-loop brain control over six to ten days for three rats as a function of increasing task difficulty. All three subjects coadapted with their BMI control algorithms to control the prosthetic significantly above chance at each level of difficulty.

Original languageEnglish (US)
Pages (from-to)54-64
Number of pages11
JournalIEEE Transactions on Biomedical Engineering
Issue number1
StatePublished - Jan 2009
Externally publishedYes


  • Brain-machine interface (BMI)
  • Coadaptation
  • Neuroprosthetic
  • Reinforcement learning (RL)

ASJC Scopus subject areas

  • Biomedical Engineering


Dive into the research topics of 'Coadaptive brain-machine interface via reinforcement learning'. Together they form a unique fingerprint.

Cite this