Random error in holistic evaluations and additive decompositions of multiattribute utility — an empirical comparison

Research output: Contribution to journalArticle

13 Citations (Scopus)

Abstract

This paper details the results of an empirical investigation of the random errors associated with decomposition estimates of multiattribute utility. In a riskless setting, two groups of subjects were asked to evaluate multiattribute alternatives both holistically and with the use of an additive decomposition. For one group, the alternatives were described in terms of three attributes, and for the other in terms of five. Estimates of random error associated with the various elicitations (holistic, single‐attribute utility, scaling constants, or weights) were obtained using a test‐retest format. It was found for both groups that the additive decomposition had significantly smaller levels of random error than the holistic evaluation. However, the number of attributes did not seem to make a significant difference to the amount of random error associated with the decomposition estimates. The levels of error found in the various elicitations were consistent with theoretical bounds that have recently been proposed in the literature. These results show that the structure imposed on the problem through decomposition results in measurable improvement in quality of the multiattribute utility judgements, and contribute to a greater understanding of the decomposition method in decision analysis.

Original languageEnglish
Pages (from-to)155-167
Number of pages13
JournalJournal of Behavioral Decision Making
Volume5
Issue number3
DOIs
StatePublished - 1 Jan 1992

Fingerprint

Decision Support Techniques
Quality Improvement
Weights and Measures
evaluation
Group
scaling
Multi-attribute utility
Decomposition
Random error
Evaluation

Keywords

  • Additive multiattribute utility
  • Holistic utility
  • Random error

Cite this

@article{2beaab8b02a442968dab423e04cd7883,
title = "Random error in holistic evaluations and additive decompositions of multiattribute utility — an empirical comparison",
abstract = "This paper details the results of an empirical investigation of the random errors associated with decomposition estimates of multiattribute utility. In a riskless setting, two groups of subjects were asked to evaluate multiattribute alternatives both holistically and with the use of an additive decomposition. For one group, the alternatives were described in terms of three attributes, and for the other in terms of five. Estimates of random error associated with the various elicitations (holistic, single‐attribute utility, scaling constants, or weights) were obtained using a test‐retest format. It was found for both groups that the additive decomposition had significantly smaller levels of random error than the holistic evaluation. However, the number of attributes did not seem to make a significant difference to the amount of random error associated with the decomposition estimates. The levels of error found in the various elicitations were consistent with theoretical bounds that have recently been proposed in the literature. These results show that the structure imposed on the problem through decomposition results in measurable improvement in quality of the multiattribute utility judgements, and contribute to a greater understanding of the decomposition method in decision analysis.",
keywords = "Additive multiattribute utility, Holistic utility, Random error",
author = "Handanhal Ravinder",
year = "1992",
month = "1",
day = "1",
doi = "10.1002/bdm.3960050302",
language = "English",
volume = "5",
pages = "155--167",
journal = "Journal of Behavioral Decision Making",
issn = "0894-3257",
publisher = "John Wiley and Sons Ltd",
number = "3",

}

TY - JOUR

T1 - Random error in holistic evaluations and additive decompositions of multiattribute utility — an empirical comparison

AU - Ravinder, Handanhal

PY - 1992/1/1

Y1 - 1992/1/1

N2 - This paper details the results of an empirical investigation of the random errors associated with decomposition estimates of multiattribute utility. In a riskless setting, two groups of subjects were asked to evaluate multiattribute alternatives both holistically and with the use of an additive decomposition. For one group, the alternatives were described in terms of three attributes, and for the other in terms of five. Estimates of random error associated with the various elicitations (holistic, single‐attribute utility, scaling constants, or weights) were obtained using a test‐retest format. It was found for both groups that the additive decomposition had significantly smaller levels of random error than the holistic evaluation. However, the number of attributes did not seem to make a significant difference to the amount of random error associated with the decomposition estimates. The levels of error found in the various elicitations were consistent with theoretical bounds that have recently been proposed in the literature. These results show that the structure imposed on the problem through decomposition results in measurable improvement in quality of the multiattribute utility judgements, and contribute to a greater understanding of the decomposition method in decision analysis.

AB - This paper details the results of an empirical investigation of the random errors associated with decomposition estimates of multiattribute utility. In a riskless setting, two groups of subjects were asked to evaluate multiattribute alternatives both holistically and with the use of an additive decomposition. For one group, the alternatives were described in terms of three attributes, and for the other in terms of five. Estimates of random error associated with the various elicitations (holistic, single‐attribute utility, scaling constants, or weights) were obtained using a test‐retest format. It was found for both groups that the additive decomposition had significantly smaller levels of random error than the holistic evaluation. However, the number of attributes did not seem to make a significant difference to the amount of random error associated with the decomposition estimates. The levels of error found in the various elicitations were consistent with theoretical bounds that have recently been proposed in the literature. These results show that the structure imposed on the problem through decomposition results in measurable improvement in quality of the multiattribute utility judgements, and contribute to a greater understanding of the decomposition method in decision analysis.

KW - Additive multiattribute utility

KW - Holistic utility

KW - Random error

UR - http://www.scopus.com/inward/record.url?scp=84980134242&partnerID=8YFLogxK

U2 - 10.1002/bdm.3960050302

DO - 10.1002/bdm.3960050302

M3 - Article

AN - SCOPUS:84980134242

VL - 5

SP - 155

EP - 167

JO - Journal of Behavioral Decision Making

JF - Journal of Behavioral Decision Making

SN - 0894-3257

IS - 3

ER -