Control of a center-out reaching task using a reinforcement learning Brain-Machine Interface

Justin C. Sanchez; Aditya Tarigoppula; John S. Choi; Brandi T. Marsh; Pratik Y. Chhatbar; Babak Mahmoudi; Joseph T. Francis

doi:10.1109/NER.2011.5910601

Control of a center-out reaching task using a reinforcement learning Brain-Machine Interface

Justin C. Sanchez, Aditya Tarigoppula, John S. Choi, Brandi T. Marsh, Pratik Y. Chhatbar, Babak Mahmoudi, Joseph T. Francis

Biomedical Engineering

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

15 Scopus citations

Abstract

In this work, we develop an experimental primate test bed for a center-out reaching task to test the performance of reinforcement learning based decoders for Brain-Machine Interfaces. Neural recordings obtained from the primary motor cortex were used to adapt a decoder using only sequences of neuronal activation and reinforced interaction with the environment. From a nave state, the system was able to achieve 100% of the targets without any a priori knowledge of the correct neural-to-motor mapping. Results show that the coupling of motor and reward information in an adaptive BMI decoder has the potential to create more realistic and functional models necessary for future BMI control.

Original language	English (US)
Title of host publication	2011 5th International IEEE/EMBS Conference on Neural Engineering, NER 2011
Pages	525-528
Number of pages	4
DOIs	https://doi.org/10.1109/NER.2011.5910601
State	Published - Jul 20 2011
Event	2011 5th International IEEE/EMBS Conference on Neural Engineering, NER 2011 - Cancun, Mexico Duration: Apr 27 2011 → May 1 2011

Publication series

Name	2011 5th International IEEE/EMBS Conference on Neural Engineering, NER 2011

Other

Other	2011 5th International IEEE/EMBS Conference on Neural Engineering, NER 2011
Country	Mexico
City	Cancun
Period	4/27/11 → 5/1/11

Fingerprint

ASJC Scopus subject areas

Neuroscience(all)

Cite this

Sanchez, J. C., Tarigoppula, A., Choi, J. S., Marsh, B. T., Chhatbar, P. Y., Mahmoudi, B., & Francis, J. T. (2011). Control of a center-out reaching task using a reinforcement learning Brain-Machine Interface. In 2011 5th International IEEE/EMBS Conference on Neural Engineering, NER 2011 (pp. 525-528). [5910601] (2011 5th International IEEE/EMBS Conference on Neural Engineering, NER 2011). https://doi.org/10.1109/NER.2011.5910601

Control of a center-out reaching task using a reinforcement learning Brain-Machine Interface. / Sanchez, Justin C.; Tarigoppula, Aditya; Choi, John S.; Marsh, Brandi T.; Chhatbar, Pratik Y.; Mahmoudi, Babak; Francis, Joseph T.

2011 5th International IEEE/EMBS Conference on Neural Engineering, NER 2011. 2011. p. 525-528 5910601 (2011 5th International IEEE/EMBS Conference on Neural Engineering, NER 2011).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Sanchez, JC, Tarigoppula, A, Choi, JS, Marsh, BT, Chhatbar, PY, Mahmoudi, B & Francis, JT 2011, Control of a center-out reaching task using a reinforcement learning Brain-Machine Interface. in 2011 5th International IEEE/EMBS Conference on Neural Engineering, NER 2011., 5910601, 2011 5th International IEEE/EMBS Conference on Neural Engineering, NER 2011, pp. 525-528, 2011 5th International IEEE/EMBS Conference on Neural Engineering, NER 2011, Cancun, Mexico, 4/27/11. https://doi.org/10.1109/NER.2011.5910601

Sanchez JC, Tarigoppula A, Choi JS, Marsh BT, Chhatbar PY, Mahmoudi B et al. Control of a center-out reaching task using a reinforcement learning Brain-Machine Interface. In 2011 5th International IEEE/EMBS Conference on Neural Engineering, NER 2011. 2011. p. 525-528. 5910601. (2011 5th International IEEE/EMBS Conference on Neural Engineering, NER 2011). https://doi.org/10.1109/NER.2011.5910601

Sanchez, Justin C. ; Tarigoppula, Aditya ; Choi, John S. ; Marsh, Brandi T. ; Chhatbar, Pratik Y. ; Mahmoudi, Babak ; Francis, Joseph T. / Control of a center-out reaching task using a reinforcement learning Brain-Machine Interface. 2011 5th International IEEE/EMBS Conference on Neural Engineering, NER 2011. 2011. pp. 525-528 (2011 5th International IEEE/EMBS Conference on Neural Engineering, NER 2011).

@inproceedings{ff0a67cd96454ccbb4cb7b1fbb5de6a8,

title = "Control of a center-out reaching task using a reinforcement learning Brain-Machine Interface",

abstract = "In this work, we develop an experimental primate test bed for a center-out reaching task to test the performance of reinforcement learning based decoders for Brain-Machine Interfaces. Neural recordings obtained from the primary motor cortex were used to adapt a decoder using only sequences of neuronal activation and reinforced interaction with the environment. From a nave state, the system was able to achieve 100% of the targets without any a priori knowledge of the correct neural-to-motor mapping. Results show that the coupling of motor and reward information in an adaptive BMI decoder has the potential to create more realistic and functional models necessary for future BMI control.",

author = "Sanchez, {Justin C.} and Aditya Tarigoppula and Choi, {John S.} and Marsh, {Brandi T.} and Chhatbar, {Pratik Y.} and Babak Mahmoudi and Francis, {Joseph T.}",

year = "2011",

month = jul

day = "20",

doi = "10.1109/NER.2011.5910601",

language = "English (US)",

isbn = "9781424441402",

series = "2011 5th International IEEE/EMBS Conference on Neural Engineering, NER 2011",

pages = "525--528",

booktitle = "2011 5th International IEEE/EMBS Conference on Neural Engineering, NER 2011",

note = "2011 5th International IEEE/EMBS Conference on Neural Engineering, NER 2011 ; Conference date: 27-04-2011 Through 01-05-2011",

}

TY - GEN

T1 - Control of a center-out reaching task using a reinforcement learning Brain-Machine Interface

AU - Sanchez, Justin C.

AU - Tarigoppula, Aditya

AU - Choi, John S.

AU - Marsh, Brandi T.

AU - Chhatbar, Pratik Y.

AU - Mahmoudi, Babak

AU - Francis, Joseph T.

PY - 2011/7/20

Y1 - 2011/7/20

N2 - In this work, we develop an experimental primate test bed for a center-out reaching task to test the performance of reinforcement learning based decoders for Brain-Machine Interfaces. Neural recordings obtained from the primary motor cortex were used to adapt a decoder using only sequences of neuronal activation and reinforced interaction with the environment. From a nave state, the system was able to achieve 100% of the targets without any a priori knowledge of the correct neural-to-motor mapping. Results show that the coupling of motor and reward information in an adaptive BMI decoder has the potential to create more realistic and functional models necessary for future BMI control.

AB - In this work, we develop an experimental primate test bed for a center-out reaching task to test the performance of reinforcement learning based decoders for Brain-Machine Interfaces. Neural recordings obtained from the primary motor cortex were used to adapt a decoder using only sequences of neuronal activation and reinforced interaction with the environment. From a nave state, the system was able to achieve 100% of the targets without any a priori knowledge of the correct neural-to-motor mapping. Results show that the coupling of motor and reward information in an adaptive BMI decoder has the potential to create more realistic and functional models necessary for future BMI control.

UR - http://www.scopus.com/inward/record.url?scp=79960354527&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=79960354527&partnerID=8YFLogxK

U2 - 10.1109/NER.2011.5910601

DO - 10.1109/NER.2011.5910601

M3 - Conference contribution

AN - SCOPUS:79960354527

SN - 9781424441402

T3 - 2011 5th International IEEE/EMBS Conference on Neural Engineering, NER 2011

SP - 525

EP - 528

BT - 2011 5th International IEEE/EMBS Conference on Neural Engineering, NER 2011

T2 - 2011 5th International IEEE/EMBS Conference on Neural Engineering, NER 2011

Y2 - 27 April 2011 through 1 May 2011

ER -

Access to Document

10.1109/NER.2011.5910601