An enquiry into the method of paired comparison: reliability, scaling, and Thurstone's Law of Comparative Judgment

Thomas C. Brown; George L. Peterson

doi:10.2737/RMRS-GTR-216

Treesearch

An enquiry into the method of paired comparison: reliability, scaling, and Thurstone's Law of Comparative Judgment

Informally Refereed

Authors:

Thomas C. Brown, George L. Peterson

Year:

2009

Type:

General Technical Report

Station:

Rocky Mountain Research Station

DOI:

https://doi.org/10.2737/RMRS-GTR-216

Source:

Gen Tech. Rep. RMRS-GTR-216WWW. Fort Collins, CO: U.S. Department of Agriculture, Forest Service, Rocky Mountain Research Station. 98 p.

Download (PDF 3.14 MB)

Download (PDF 3.14 MB): https://research.fs.usda.gov/download/treesearch/31863.pdf

Abstract

The method of paired comparisons is used to measure individuals' preference orderings of items presented to them as discrete binary choices. This paper reviews the theory and application of the paired comparison method, describes a new computer program available for eliciting the choices, and presents an analysis of methods for scaling paired choice data to estimate an interval scale measure of preference. A new procedure for isolating an individual's inconsistent choices is described. Using data from five empirical studies, the reliability of respondents' paired choices is assessed using measures of internal reliability, choice consistency, and test-retest reliability.

Keywords

public judgments, random utility, reliability, consistency, scaling, response time, preference learning

Citation

Brown, Thomas C.; Peterson, George L. 2009. An enquiry into the method of paired comparison: reliability, scaling, and Thurstone''s Law of Comparative Judgment. Gen Tech. Rep. RMRS-GTR-216WWW. Fort Collins, CO: U.S. Department of Agriculture, Forest Service, Rocky Mountain Research Station. 98 p.