Neuronal tuning in a brain-machine interface during Reinforcement Learning

Babak Mahmoudi, Jack Digiovanna, Jose C. Principe, Justin C. Sanchez

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

In this research, we have used neural tuning to quantify the neural representation of prosthetic arm's actions in a new framework of BMI, which is based on Reinforcement Learning (RLBMI). We observed that through closed-loop brain control, the neural representation has changed to encode robot actions that maximize rewards. This is an interesting result because in our paradigm robot actions are directly controlled by a Computer Agent (CA) with reward states compatible with the user's rewards. Through co-adaptation, neural modulation is used to establish the value of robot actions to achieve reward.

Original languageEnglish
Title of host publicationProceedings of the 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS'08 - "Personalized Healthcare through Technology"
Pages4491-4494
Number of pages4
StatePublished - Dec 1 2008
Externally publishedYes
Event30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS'08 - Vancouver, BC, Canada
Duration: Aug 20 2008Aug 25 2008

Other

Other30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS'08
CountryCanada
CityVancouver, BC
Period8/20/088/25/08

Fingerprint

Brain-Computer Interfaces
Reinforcement learning
Reward
Brain
Tuning
Learning
Robots
Prosthetics
Modulation
Reinforcement (Psychology)
Research

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition
  • Signal Processing
  • Biomedical Engineering
  • Health Informatics

Cite this

Mahmoudi, B., Digiovanna, J., Principe, J. C., & Sanchez, J. C. (2008). Neuronal tuning in a brain-machine interface during Reinforcement Learning. In Proceedings of the 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS'08 - "Personalized Healthcare through Technology" (pp. 4491-4494). [4650210]

Neuronal tuning in a brain-machine interface during Reinforcement Learning. / Mahmoudi, Babak; Digiovanna, Jack; Principe, Jose C.; Sanchez, Justin C.

Proceedings of the 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS'08 - "Personalized Healthcare through Technology". 2008. p. 4491-4494 4650210.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Mahmoudi, B, Digiovanna, J, Principe, JC & Sanchez, JC 2008, Neuronal tuning in a brain-machine interface during Reinforcement Learning. in Proceedings of the 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS'08 - "Personalized Healthcare through Technology"., 4650210, pp. 4491-4494, 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS'08, Vancouver, BC, Canada, 8/20/08.
Mahmoudi B, Digiovanna J, Principe JC, Sanchez JC. Neuronal tuning in a brain-machine interface during Reinforcement Learning. In Proceedings of the 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS'08 - "Personalized Healthcare through Technology". 2008. p. 4491-4494. 4650210
Mahmoudi, Babak ; Digiovanna, Jack ; Principe, Jose C. ; Sanchez, Justin C. / Neuronal tuning in a brain-machine interface during Reinforcement Learning. Proceedings of the 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS'08 - "Personalized Healthcare through Technology". 2008. pp. 4491-4494
@inproceedings{a5394807c6cd4445995f5d04f5458bb8,
title = "Neuronal tuning in a brain-machine interface during Reinforcement Learning",
abstract = "In this research, we have used neural tuning to quantify the neural representation of prosthetic arm's actions in a new framework of BMI, which is based on Reinforcement Learning (RLBMI). We observed that through closed-loop brain control, the neural representation has changed to encode robot actions that maximize rewards. This is an interesting result because in our paradigm robot actions are directly controlled by a Computer Agent (CA) with reward states compatible with the user's rewards. Through co-adaptation, neural modulation is used to establish the value of robot actions to achieve reward.",
author = "Babak Mahmoudi and Jack Digiovanna and Principe, {Jose C.} and Sanchez, {Justin C.}",
year = "2008",
month = "12",
day = "1",
language = "English",
isbn = "9781424418152",
pages = "4491--4494",
booktitle = "Proceedings of the 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS'08 - {"}Personalized Healthcare through Technology{"}",

}

TY - GEN

T1 - Neuronal tuning in a brain-machine interface during Reinforcement Learning

AU - Mahmoudi, Babak

AU - Digiovanna, Jack

AU - Principe, Jose C.

AU - Sanchez, Justin C.

PY - 2008/12/1

Y1 - 2008/12/1

N2 - In this research, we have used neural tuning to quantify the neural representation of prosthetic arm's actions in a new framework of BMI, which is based on Reinforcement Learning (RLBMI). We observed that through closed-loop brain control, the neural representation has changed to encode robot actions that maximize rewards. This is an interesting result because in our paradigm robot actions are directly controlled by a Computer Agent (CA) with reward states compatible with the user's rewards. Through co-adaptation, neural modulation is used to establish the value of robot actions to achieve reward.

AB - In this research, we have used neural tuning to quantify the neural representation of prosthetic arm's actions in a new framework of BMI, which is based on Reinforcement Learning (RLBMI). We observed that through closed-loop brain control, the neural representation has changed to encode robot actions that maximize rewards. This is an interesting result because in our paradigm robot actions are directly controlled by a Computer Agent (CA) with reward states compatible with the user's rewards. Through co-adaptation, neural modulation is used to establish the value of robot actions to achieve reward.

UR - http://www.scopus.com/inward/record.url?scp=61849120260&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=61849120260&partnerID=8YFLogxK

M3 - Conference contribution

SN - 9781424418152

SP - 4491

EP - 4494

BT - Proceedings of the 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS'08 - "Personalized Healthcare through Technology"

ER -