User Perceptions of Decision Support Effectiveness: Two Production Planning Experiments

Fred D. Davis, Jeffrey E. Kottemann

Research output: Contribution to journalArticle

75 Scopus citations

Abstract

Decision support systems continue to be very popular in business, despite mixed research evidence as to their effectiveness. We hypothesize that what‐if analysis, a prominent feature of most decision support systems, creates an “illusion of control” causing users to overestimate its effectiveness. Two experiments involving a production planning task are reported which examine decision makers' perceptions of the effectiveness of what‐if analysis relative to the alternatives of unaided decision making, and quantitative decision rules. Experiment 1 found that almost all subjects believed what‐if analysis was superior to unaided decision making, although using what‐if analysis had no significant effect on performance. Experiment 2 found that decision makers were indifferent between what‐if analysis and a quantitative decision rule which, if used, would have led to significant cost savings. Thus, what‐if analysis did create an illusion of control: decision makers perceived performance differences where none existed, and did not detect large differences when they were present. In both experiments, decision makers exhibited difficulty realizing that their positive beliefs about what‐if analysis were exaggerated. Such misjudgments could lead people to continue using what‐if analysis even when it is not beneficial and to avoid potentially superior decision support technologies.

Original languageEnglish
Pages (from-to)57-76
Number of pages20
JournalDecision Sciences
Volume25
Issue number1
DOIs
StatePublished - Jan 1994

Keywords

  • Decision Support Systems and Production/Operations Management

Fingerprint Dive into the research topics of 'User Perceptions of Decision Support Effectiveness: Two Production Planning Experiments'. Together they form a unique fingerprint.

  • Cite this