Accounting for Multiplicity in Inference on Economics Journal Rankings

William C. Horrace, Christopher Parmeter

Research output: Contribution to journalArticle

3 Citations (Scopus)

Abstract

Nearly all journal ranking analyses assume that rank statistics of journal quality are deterministic, yet they are clearly random. The only study to recognize ranking uncertainty is Stern (2013), which calculates standard errors for a ranking of five-year impact factors for 232 economics journals and performs inference using a series of univariate t-tests. We revisit the Stern study but perform multivariate inference to control the overall error rate of the testing procedure. The results are compared and differences highlighted.

Original languageEnglish (US)
Pages (from-to)337-347
Number of pages11
JournalSouthern Economic Journal
Volume84
Issue number1
DOIs
StatePublished - Jul 1 2017

Fingerprint

Multiplicity
Economic journals
Inference
Ranking
Journal ranking
Journal quality
Testing
Uncertainty
Impact factor
Statistics
Standard error
T-test

Keywords

  • A14
  • C12

ASJC Scopus subject areas

  • Economics and Econometrics

Cite this

Accounting for Multiplicity in Inference on Economics Journal Rankings. / Horrace, William C.; Parmeter, Christopher.

In: Southern Economic Journal, Vol. 84, No. 1, 01.07.2017, p. 337-347.

Research output: Contribution to journalArticle

@article{c1880ddc13b2435ea6bd55a5dcd9be0f,
title = "Accounting for Multiplicity in Inference on Economics Journal Rankings",
abstract = "Nearly all journal ranking analyses assume that rank statistics of journal quality are deterministic, yet they are clearly random. The only study to recognize ranking uncertainty is Stern (2013), which calculates standard errors for a ranking of five-year impact factors for 232 economics journals and performs inference using a series of univariate t-tests. We revisit the Stern study but perform multivariate inference to control the overall error rate of the testing procedure. The results are compared and differences highlighted.",
keywords = "A14, C12",
author = "Horrace, {William C.} and Christopher Parmeter",
year = "2017",
month = "7",
day = "1",
doi = "10.1002/soej.12219",
language = "English (US)",
volume = "84",
pages = "337--347",
journal = "Southern Economic Journal",
issn = "0038-4038",
publisher = "Southern Economic Association",
number = "1",

}

TY - JOUR

T1 - Accounting for Multiplicity in Inference on Economics Journal Rankings

AU - Horrace, William C.

AU - Parmeter, Christopher

PY - 2017/7/1

Y1 - 2017/7/1

N2 - Nearly all journal ranking analyses assume that rank statistics of journal quality are deterministic, yet they are clearly random. The only study to recognize ranking uncertainty is Stern (2013), which calculates standard errors for a ranking of five-year impact factors for 232 economics journals and performs inference using a series of univariate t-tests. We revisit the Stern study but perform multivariate inference to control the overall error rate of the testing procedure. The results are compared and differences highlighted.

AB - Nearly all journal ranking analyses assume that rank statistics of journal quality are deterministic, yet they are clearly random. The only study to recognize ranking uncertainty is Stern (2013), which calculates standard errors for a ranking of five-year impact factors for 232 economics journals and performs inference using a series of univariate t-tests. We revisit the Stern study but perform multivariate inference to control the overall error rate of the testing procedure. The results are compared and differences highlighted.

KW - A14

KW - C12

UR - http://www.scopus.com/inward/record.url?scp=85022196334&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85022196334&partnerID=8YFLogxK

U2 - 10.1002/soej.12219

DO - 10.1002/soej.12219

M3 - Article

VL - 84

SP - 337

EP - 347

JO - Southern Economic Journal

JF - Southern Economic Journal

SN - 0038-4038

IS - 1

ER -