Neuronal tuning in a brain-machine interface during Reinforcement Learning

Babak Mahmoudi; Jack Digiovanna; Jose C. Principe; Justin C. Sanchez

doi:10.1109/iembs.2008.4650210

Neuronal tuning in a brain-machine interface during Reinforcement Learning

Babak Mahmoudi, Jack Digiovanna, Jose C. Principe, Justin C. Sanchez

Biomedical Engineering

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

2 Scopus citations

Abstract

In this research, we have used neural tuning to quantify the neural representation of prosthetic arm's actions in a new framework of BMI, which is based on Reinforcement Learning (RLBMI). We observed that through closed-loop brain control, the neural representation has changed to encode robot actions that maximize rewards. This is an interesting result because in our paradigm robot actions are directly controlled by a Computer Agent (CA) with reward states compatible with the user's rewards. Through co-adaptation, neural modulation is used to establish the value of robot actions to achieve reward.

Original language	English (US)
Title of host publication	Proceedings of the 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS'08
Publisher	IEEE Computer Society
Pages	4491-4494
Number of pages	4
ISBN (Print)	9781424418152
DOIs	https://doi.org/10.1109/iembs.2008.4650210
State	Published - Jan 1 2008
Event	30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS'08 - Vancouver, BC, Canada Duration: Aug 20 2008 → Aug 25 2008

Publication series

Name	Proceedings of the 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS'08 - "Personalized Healthcare through Technology"

Other

Other	30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS'08
Country/Territory	Canada
City	Vancouver, BC
Period	8/20/08 → 8/25/08

ASJC Scopus subject areas

Computer Vision and Pattern Recognition
Signal Processing
Biomedical Engineering
Health Informatics

Access to Document

10.1109/iembs.2008.4650210

Cite this

Mahmoudi, B., Digiovanna, J., Principe, J. C., & Sanchez, J. C. (2008). Neuronal tuning in a brain-machine interface during Reinforcement Learning. In Proceedings of the 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS'08 (pp. 4491-4494). [4650210] (Proceedings of the 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS'08 - "Personalized Healthcare through Technology"). IEEE Computer Society. https://doi.org/10.1109/iembs.2008.4650210

Neuronal tuning in a brain-machine interface during Reinforcement Learning. / Mahmoudi, Babak; Digiovanna, Jack; Principe, Jose C.; Sanchez, Justin C.

Proceedings of the 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS'08. IEEE Computer Society, 2008. p. 4491-4494 4650210 (Proceedings of the 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS'08 - "Personalized Healthcare through Technology").

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Mahmoudi, B, Digiovanna, J, Principe, JC & Sanchez, JC 2008, Neuronal tuning in a brain-machine interface during Reinforcement Learning. in Proceedings of the 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS'08., 4650210, Proceedings of the 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS'08 - "Personalized Healthcare through Technology", IEEE Computer Society, pp. 4491-4494, 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS'08, Vancouver, BC, Canada, 8/20/08. https://doi.org/10.1109/iembs.2008.4650210

Mahmoudi B, Digiovanna J, Principe JC, Sanchez JC. Neuronal tuning in a brain-machine interface during Reinforcement Learning. In Proceedings of the 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS'08. IEEE Computer Society. 2008. p. 4491-4494. 4650210. (Proceedings of the 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS'08 - "Personalized Healthcare through Technology"). https://doi.org/10.1109/iembs.2008.4650210

Mahmoudi, Babak ; Digiovanna, Jack ; Principe, Jose C. ; Sanchez, Justin C. / Neuronal tuning in a brain-machine interface during Reinforcement Learning. Proceedings of the 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS'08. IEEE Computer Society, 2008. pp. 4491-4494 (Proceedings of the 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS'08 - "Personalized Healthcare through Technology").

@inproceedings{a5394807c6cd4445995f5d04f5458bb8,

title = "Neuronal tuning in a brain-machine interface during Reinforcement Learning",

abstract = "In this research, we have used neural tuning to quantify the neural representation of prosthetic arm's actions in a new framework of BMI, which is based on Reinforcement Learning (RLBMI). We observed that through closed-loop brain control, the neural representation has changed to encode robot actions that maximize rewards. This is an interesting result because in our paradigm robot actions are directly controlled by a Computer Agent (CA) with reward states compatible with the user's rewards. Through co-adaptation, neural modulation is used to establish the value of robot actions to achieve reward.",

author = "Babak Mahmoudi and Jack Digiovanna and Principe, {Jose C.} and Sanchez, {Justin C.}",

year = "2008",

month = jan,

day = "1",

doi = "10.1109/iembs.2008.4650210",

language = "English (US)",

isbn = "9781424418152",

series = "Proceedings of the 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS'08 - {"}Personalized Healthcare through Technology{"}",

publisher = "IEEE Computer Society",

pages = "4491--4494",

booktitle = "Proceedings of the 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS'08",

note = "30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS'08 ; Conference date: 20-08-2008 Through 25-08-2008",

}

TY - GEN

T1 - Neuronal tuning in a brain-machine interface during Reinforcement Learning

AU - Mahmoudi, Babak

AU - Digiovanna, Jack

AU - Principe, Jose C.

AU - Sanchez, Justin C.

PY - 2008/1/1

Y1 - 2008/1/1

N2 - In this research, we have used neural tuning to quantify the neural representation of prosthetic arm's actions in a new framework of BMI, which is based on Reinforcement Learning (RLBMI). We observed that through closed-loop brain control, the neural representation has changed to encode robot actions that maximize rewards. This is an interesting result because in our paradigm robot actions are directly controlled by a Computer Agent (CA) with reward states compatible with the user's rewards. Through co-adaptation, neural modulation is used to establish the value of robot actions to achieve reward.

AB - In this research, we have used neural tuning to quantify the neural representation of prosthetic arm's actions in a new framework of BMI, which is based on Reinforcement Learning (RLBMI). We observed that through closed-loop brain control, the neural representation has changed to encode robot actions that maximize rewards. This is an interesting result because in our paradigm robot actions are directly controlled by a Computer Agent (CA) with reward states compatible with the user's rewards. Through co-adaptation, neural modulation is used to establish the value of robot actions to achieve reward.

UR - http://www.scopus.com/inward/record.url?scp=61849120260&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=61849120260&partnerID=8YFLogxK

U2 - 10.1109/iembs.2008.4650210

DO - 10.1109/iembs.2008.4650210

M3 - Conference contribution

C2 - 19163713

AN - SCOPUS:61849120260

SN - 9781424418152

T3 - Proceedings of the 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS'08 - "Personalized Healthcare through Technology"

SP - 4491

EP - 4494

BT - Proceedings of the 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS'08

PB - IEEE Computer Society

T2 - 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS'08

Y2 - 20 August 2008 through 25 August 2008

ER -

Neuronal tuning in a brain-machine interface during Reinforcement Learning

Abstract

Publication series

Other

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this