Predicting grades

Yannick Meier, Jie Xu, Onur Atan, Mihaela Van Der Schaar

Research output: Contribution to journalArticle

37 Citations (Scopus)

Abstract

To increase efficacy in traditional classroom courses as well as in Massive Open Online Courses (MOOCs), automated systems supporting the instructor are needed. One important problem is to automatically detect students that are going to do poorly in a course early enough to be able to take remedial actions. Existing grade prediction systems focus on maximizing the accuracy of the prediction while overseeing the importance of issuing timely and personalized predictions. This paper proposes an algorithm that predicts the final grade of each student in a class. It issues a prediction for each student individually, when the expected accuracy of the prediction is sufficient. The algorithm learns online what is the optimal prediction and time to issue a prediction based on past history of students' performance in a course. We derive a confidence estimate for the prediction accuracy and demonstrate the performance of our algorithm on a dataset obtained based on the performance of approximately 700 UCLA undergraduate students who have taken an introductory digital signal processing over the past seven years. We demonstrate that for 85% of the students we can predict with 76% accuracy whether they are going do well or poorly in the class after the fourth course week. Using data obtained from a pilot course, our methodology suggests that it is effective to perform early in-class assessments such as quizzes, which result in timely performance prediction for each student, thereby enabling timely interventions by the instructor (at the student or class level) when necessary.

Original languageEnglish (US)
Article number7313031
Pages (from-to)959-972
Number of pages14
JournalIEEE Transactions on Signal Processing
Volume64
Issue number4
DOIs
StatePublished - Feb 15 2016
Externally publishedYes

Fingerprint

Students
Digital signal processing

Keywords

  • data mining
  • digital signal processing education
  • Forecasting algorithms
  • grade prediction
  • online learning

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Signal Processing

Cite this

Meier, Y., Xu, J., Atan, O., & Van Der Schaar, M. (2016). Predicting grades. IEEE Transactions on Signal Processing, 64(4), 959-972. [7313031]. https://doi.org/10.1109/TSP.2015.2496278

Predicting grades. / Meier, Yannick; Xu, Jie; Atan, Onur; Van Der Schaar, Mihaela.

In: IEEE Transactions on Signal Processing, Vol. 64, No. 4, 7313031, 15.02.2016, p. 959-972.

Research output: Contribution to journalArticle

Meier, Y, Xu, J, Atan, O & Van Der Schaar, M 2016, 'Predicting grades', IEEE Transactions on Signal Processing, vol. 64, no. 4, 7313031, pp. 959-972. https://doi.org/10.1109/TSP.2015.2496278
Meier Y, Xu J, Atan O, Van Der Schaar M. Predicting grades. IEEE Transactions on Signal Processing. 2016 Feb 15;64(4):959-972. 7313031. https://doi.org/10.1109/TSP.2015.2496278
Meier, Yannick ; Xu, Jie ; Atan, Onur ; Van Der Schaar, Mihaela. / Predicting grades. In: IEEE Transactions on Signal Processing. 2016 ; Vol. 64, No. 4. pp. 959-972.
@article{3626d03ebbea43abb2ab554e8f32b908,
title = "Predicting grades",
abstract = "To increase efficacy in traditional classroom courses as well as in Massive Open Online Courses (MOOCs), automated systems supporting the instructor are needed. One important problem is to automatically detect students that are going to do poorly in a course early enough to be able to take remedial actions. Existing grade prediction systems focus on maximizing the accuracy of the prediction while overseeing the importance of issuing timely and personalized predictions. This paper proposes an algorithm that predicts the final grade of each student in a class. It issues a prediction for each student individually, when the expected accuracy of the prediction is sufficient. The algorithm learns online what is the optimal prediction and time to issue a prediction based on past history of students' performance in a course. We derive a confidence estimate for the prediction accuracy and demonstrate the performance of our algorithm on a dataset obtained based on the performance of approximately 700 UCLA undergraduate students who have taken an introductory digital signal processing over the past seven years. We demonstrate that for 85{\%} of the students we can predict with 76{\%} accuracy whether they are going do well or poorly in the class after the fourth course week. Using data obtained from a pilot course, our methodology suggests that it is effective to perform early in-class assessments such as quizzes, which result in timely performance prediction for each student, thereby enabling timely interventions by the instructor (at the student or class level) when necessary.",
keywords = "data mining, digital signal processing education, Forecasting algorithms, grade prediction, online learning",
author = "Yannick Meier and Jie Xu and Onur Atan and {Van Der Schaar}, Mihaela",
year = "2016",
month = "2",
day = "15",
doi = "10.1109/TSP.2015.2496278",
language = "English (US)",
volume = "64",
pages = "959--972",
journal = "IEEE Transactions on Signal Processing",
issn = "1053-587X",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "4",

}

TY - JOUR

T1 - Predicting grades

AU - Meier, Yannick

AU - Xu, Jie

AU - Atan, Onur

AU - Van Der Schaar, Mihaela

PY - 2016/2/15

Y1 - 2016/2/15

N2 - To increase efficacy in traditional classroom courses as well as in Massive Open Online Courses (MOOCs), automated systems supporting the instructor are needed. One important problem is to automatically detect students that are going to do poorly in a course early enough to be able to take remedial actions. Existing grade prediction systems focus on maximizing the accuracy of the prediction while overseeing the importance of issuing timely and personalized predictions. This paper proposes an algorithm that predicts the final grade of each student in a class. It issues a prediction for each student individually, when the expected accuracy of the prediction is sufficient. The algorithm learns online what is the optimal prediction and time to issue a prediction based on past history of students' performance in a course. We derive a confidence estimate for the prediction accuracy and demonstrate the performance of our algorithm on a dataset obtained based on the performance of approximately 700 UCLA undergraduate students who have taken an introductory digital signal processing over the past seven years. We demonstrate that for 85% of the students we can predict with 76% accuracy whether they are going do well or poorly in the class after the fourth course week. Using data obtained from a pilot course, our methodology suggests that it is effective to perform early in-class assessments such as quizzes, which result in timely performance prediction for each student, thereby enabling timely interventions by the instructor (at the student or class level) when necessary.

AB - To increase efficacy in traditional classroom courses as well as in Massive Open Online Courses (MOOCs), automated systems supporting the instructor are needed. One important problem is to automatically detect students that are going to do poorly in a course early enough to be able to take remedial actions. Existing grade prediction systems focus on maximizing the accuracy of the prediction while overseeing the importance of issuing timely and personalized predictions. This paper proposes an algorithm that predicts the final grade of each student in a class. It issues a prediction for each student individually, when the expected accuracy of the prediction is sufficient. The algorithm learns online what is the optimal prediction and time to issue a prediction based on past history of students' performance in a course. We derive a confidence estimate for the prediction accuracy and demonstrate the performance of our algorithm on a dataset obtained based on the performance of approximately 700 UCLA undergraduate students who have taken an introductory digital signal processing over the past seven years. We demonstrate that for 85% of the students we can predict with 76% accuracy whether they are going do well or poorly in the class after the fourth course week. Using data obtained from a pilot course, our methodology suggests that it is effective to perform early in-class assessments such as quizzes, which result in timely performance prediction for each student, thereby enabling timely interventions by the instructor (at the student or class level) when necessary.

KW - data mining

KW - digital signal processing education

KW - Forecasting algorithms

KW - grade prediction

KW - online learning

UR - http://www.scopus.com/inward/record.url?scp=84961994268&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84961994268&partnerID=8YFLogxK

U2 - 10.1109/TSP.2015.2496278

DO - 10.1109/TSP.2015.2496278

M3 - Article

VL - 64

SP - 959

EP - 972

JO - IEEE Transactions on Signal Processing

JF - IEEE Transactions on Signal Processing

SN - 1053-587X

IS - 4

M1 - 7313031

ER -