A Study of Human Performance in Computer-Aided Architectural Design

Donna L. Cuomo, Joseph Sharit

Research output: Contribution to journalArticle

10 Citations (Scopus)

Abstract

This paper describes the development and application of a cognitively-based performance methodology for assessing human performance on computer-aided architectural design (CAAD) tasks. Two CAAD tasks were employed that were hypothesized to be different in terms of the underlying cognitive processes required for these tasks to be performed. Methods of manipulating task complexity within each of these tasks were then developed. Six architectural graduate students were trained on a commercially available CAAD system. Each student performed the two experimental design tasks at one of three levels of complexity. The data collected included protocols, video recordings of the computer screen, and an interactive script (time-stamped record of every command input and the computers textual response). Performance measures and methods of analysis were developed which reflected the cognitive processes used by the human during design (including problem-solving techniques, planning times, heuristics employed, etc.) and the role of the computer as a design aid. The analysis techniques used included graphical techniques, Markov process analysis, protocol analysis, and error classification and analysis. The results of the study indicated that some measures more directly reflected human design activity while others more directly reflected the efficiency of interaction between the computer and the human. The discussion of the results focuses primarily on the usefulness of the various measures comprising the performance methodology, the usefulness of the tasks employed including methods for manipulating task complexity, and the effectiveness of this system as well as CAAD systems in general for aiding human design processes.

Original languageEnglish (US)
Pages (from-to)69-107
Number of pages39
JournalInternational Journal of Human-Computer Interaction
Volume1
Issue number1
DOIs
StatePublished - 1989
Externally publishedYes

Fingerprint

Architectural design
Computer aided design
performance
Students
Design aids
Video recording
Design of experiments
Markov processes
time planning
planning procedure
Planning
process analysis
video recording
methodology
heuristics
student
graduate
efficiency
interaction

ASJC Scopus subject areas

  • Computer Science Applications
  • Human-Computer Interaction
  • Human Factors and Ergonomics

Cite this

A Study of Human Performance in Computer-Aided Architectural Design. / Cuomo, Donna L.; Sharit, Joseph.

In: International Journal of Human-Computer Interaction, Vol. 1, No. 1, 1989, p. 69-107.

Research output: Contribution to journalArticle

@article{6a5174c52f904a669bdf3d8241487af1,
title = "A Study of Human Performance in Computer-Aided Architectural Design",
abstract = "This paper describes the development and application of a cognitively-based performance methodology for assessing human performance on computer-aided architectural design (CAAD) tasks. Two CAAD tasks were employed that were hypothesized to be different in terms of the underlying cognitive processes required for these tasks to be performed. Methods of manipulating task complexity within each of these tasks were then developed. Six architectural graduate students were trained on a commercially available CAAD system. Each student performed the two experimental design tasks at one of three levels of complexity. The data collected included protocols, video recordings of the computer screen, and an interactive script (time-stamped record of every command input and the computers textual response). Performance measures and methods of analysis were developed which reflected the cognitive processes used by the human during design (including problem-solving techniques, planning times, heuristics employed, etc.) and the role of the computer as a design aid. The analysis techniques used included graphical techniques, Markov process analysis, protocol analysis, and error classification and analysis. The results of the study indicated that some measures more directly reflected human design activity while others more directly reflected the efficiency of interaction between the computer and the human. The discussion of the results focuses primarily on the usefulness of the various measures comprising the performance methodology, the usefulness of the tasks employed including methods for manipulating task complexity, and the effectiveness of this system as well as CAAD systems in general for aiding human design processes.",
author = "Cuomo, {Donna L.} and Joseph Sharit",
year = "1989",
doi = "10.1080/10447318909525958",
language = "English (US)",
volume = "1",
pages = "69--107",
journal = "International Journal of Human-Computer Interaction",
issn = "1044-7318",
publisher = "Taylor and Francis Ltd.",
number = "1",

}

TY - JOUR

T1 - A Study of Human Performance in Computer-Aided Architectural Design

AU - Cuomo, Donna L.

AU - Sharit, Joseph

PY - 1989

Y1 - 1989

N2 - This paper describes the development and application of a cognitively-based performance methodology for assessing human performance on computer-aided architectural design (CAAD) tasks. Two CAAD tasks were employed that were hypothesized to be different in terms of the underlying cognitive processes required for these tasks to be performed. Methods of manipulating task complexity within each of these tasks were then developed. Six architectural graduate students were trained on a commercially available CAAD system. Each student performed the two experimental design tasks at one of three levels of complexity. The data collected included protocols, video recordings of the computer screen, and an interactive script (time-stamped record of every command input and the computers textual response). Performance measures and methods of analysis were developed which reflected the cognitive processes used by the human during design (including problem-solving techniques, planning times, heuristics employed, etc.) and the role of the computer as a design aid. The analysis techniques used included graphical techniques, Markov process analysis, protocol analysis, and error classification and analysis. The results of the study indicated that some measures more directly reflected human design activity while others more directly reflected the efficiency of interaction between the computer and the human. The discussion of the results focuses primarily on the usefulness of the various measures comprising the performance methodology, the usefulness of the tasks employed including methods for manipulating task complexity, and the effectiveness of this system as well as CAAD systems in general for aiding human design processes.

AB - This paper describes the development and application of a cognitively-based performance methodology for assessing human performance on computer-aided architectural design (CAAD) tasks. Two CAAD tasks were employed that were hypothesized to be different in terms of the underlying cognitive processes required for these tasks to be performed. Methods of manipulating task complexity within each of these tasks were then developed. Six architectural graduate students were trained on a commercially available CAAD system. Each student performed the two experimental design tasks at one of three levels of complexity. The data collected included protocols, video recordings of the computer screen, and an interactive script (time-stamped record of every command input and the computers textual response). Performance measures and methods of analysis were developed which reflected the cognitive processes used by the human during design (including problem-solving techniques, planning times, heuristics employed, etc.) and the role of the computer as a design aid. The analysis techniques used included graphical techniques, Markov process analysis, protocol analysis, and error classification and analysis. The results of the study indicated that some measures more directly reflected human design activity while others more directly reflected the efficiency of interaction between the computer and the human. The discussion of the results focuses primarily on the usefulness of the various measures comprising the performance methodology, the usefulness of the tasks employed including methods for manipulating task complexity, and the effectiveness of this system as well as CAAD systems in general for aiding human design processes.

UR - http://www.scopus.com/inward/record.url?scp=0039651031&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0039651031&partnerID=8YFLogxK

U2 - 10.1080/10447318909525958

DO - 10.1080/10447318909525958

M3 - Article

AN - SCOPUS:0039651031

VL - 1

SP - 69

EP - 107

JO - International Journal of Human-Computer Interaction

JF - International Journal of Human-Computer Interaction

SN - 1044-7318

IS - 1

ER -