Development and empirical verification of new response categories to increase the validity of multiple response alternative questionnaires

Research output: Contribution to journalArticle

27 Citations (Scopus)

Abstract

A number of scales, including the Ohio State leadership scales, use the response categories Always, Often, Occasionally, Seldom, and Never, and researchers administering these scales usually assume that the resultant data are interval in nature. Recently, however, the interval properties of such data have been questioned. This paper presents an attempt at clarifying the level of measurement provided by this particular set of response categories. Drawing on previous research concerning the frequency meanings of these adverbs, a study using two samples of 200 students was performed to determine whether the distances between the adverbs become reasonably equal when they are presented as a group ordered according to median frequency values. The results indicate that equal intervals between the adverbs are approached, but not achieved when they are ordered in this manner. A second study, designed to corroborate the first, employed Thurstone Case III pair-comparison of complete ranks. The results, which parallel those obtained from the earlier study, also indicate that the response category set of Always, Very often, About as often as not, Seldom, and Never provides reasonably interval measurement. Data obtained from a third study (using again the frequency estimation procedure of the first study) generally supported the results of the Thurstone Case III method for the new category set.

Original languageEnglish (US)
Pages (from-to)877-884
Number of pages8
JournalEducational and Psychological Measurement
Volume34
Issue number4
DOIs
StatePublished - 1974
Externally publishedYes

Fingerprint

Multiple Responses
Questionnaire
Frequency estimation
Interval
questionnaire
Alternatives
Research Personnel
Students
Frequency Estimation
Ordered Group
Leadership
estimation procedure
Research
leadership
Surveys and Questionnaires
Values
Group
student

ASJC Scopus subject areas

  • Developmental and Educational Psychology
  • Applied Psychology
  • Applied Mathematics
  • Education

Cite this

@article{022bcdefde77433a8da13287f9e241df,
title = "Development and empirical verification of new response categories to increase the validity of multiple response alternative questionnaires",
abstract = "A number of scales, including the Ohio State leadership scales, use the response categories Always, Often, Occasionally, Seldom, and Never, and researchers administering these scales usually assume that the resultant data are interval in nature. Recently, however, the interval properties of such data have been questioned. This paper presents an attempt at clarifying the level of measurement provided by this particular set of response categories. Drawing on previous research concerning the frequency meanings of these adverbs, a study using two samples of 200 students was performed to determine whether the distances between the adverbs become reasonably equal when they are presented as a group ordered according to median frequency values. The results indicate that equal intervals between the adverbs are approached, but not achieved when they are ordered in this manner. A second study, designed to corroborate the first, employed Thurstone Case III pair-comparison of complete ranks. The results, which parallel those obtained from the earlier study, also indicate that the response category set of Always, Very often, About as often as not, Seldom, and Never provides reasonably interval measurement. Data obtained from a third study (using again the frequency estimation procedure of the first study) generally supported the results of the Thurstone Case III method for the new category set.",
author = "Chester Schriesheim",
year = "1974",
doi = "10.1177/001316447403400416",
language = "English (US)",
volume = "34",
pages = "877--884",
journal = "Educational and Psychological Measurement",
issn = "0013-1644",
publisher = "SAGE Publications Inc.",
number = "4",

}

TY - JOUR

T1 - Development and empirical verification of new response categories to increase the validity of multiple response alternative questionnaires

AU - Schriesheim, Chester

PY - 1974

Y1 - 1974

N2 - A number of scales, including the Ohio State leadership scales, use the response categories Always, Often, Occasionally, Seldom, and Never, and researchers administering these scales usually assume that the resultant data are interval in nature. Recently, however, the interval properties of such data have been questioned. This paper presents an attempt at clarifying the level of measurement provided by this particular set of response categories. Drawing on previous research concerning the frequency meanings of these adverbs, a study using two samples of 200 students was performed to determine whether the distances between the adverbs become reasonably equal when they are presented as a group ordered according to median frequency values. The results indicate that equal intervals between the adverbs are approached, but not achieved when they are ordered in this manner. A second study, designed to corroborate the first, employed Thurstone Case III pair-comparison of complete ranks. The results, which parallel those obtained from the earlier study, also indicate that the response category set of Always, Very often, About as often as not, Seldom, and Never provides reasonably interval measurement. Data obtained from a third study (using again the frequency estimation procedure of the first study) generally supported the results of the Thurstone Case III method for the new category set.

AB - A number of scales, including the Ohio State leadership scales, use the response categories Always, Often, Occasionally, Seldom, and Never, and researchers administering these scales usually assume that the resultant data are interval in nature. Recently, however, the interval properties of such data have been questioned. This paper presents an attempt at clarifying the level of measurement provided by this particular set of response categories. Drawing on previous research concerning the frequency meanings of these adverbs, a study using two samples of 200 students was performed to determine whether the distances between the adverbs become reasonably equal when they are presented as a group ordered according to median frequency values. The results indicate that equal intervals between the adverbs are approached, but not achieved when they are ordered in this manner. A second study, designed to corroborate the first, employed Thurstone Case III pair-comparison of complete ranks. The results, which parallel those obtained from the earlier study, also indicate that the response category set of Always, Very often, About as often as not, Seldom, and Never provides reasonably interval measurement. Data obtained from a third study (using again the frequency estimation procedure of the first study) generally supported the results of the Thurstone Case III method for the new category set.

UR - http://www.scopus.com/inward/record.url?scp=84973810204&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84973810204&partnerID=8YFLogxK

U2 - 10.1177/001316447403400416

DO - 10.1177/001316447403400416

M3 - Article

AN - SCOPUS:84973810204

VL - 34

SP - 877

EP - 884

JO - Educational and Psychological Measurement

JF - Educational and Psychological Measurement

SN - 0013-1644

IS - 4

ER -