On the volatility of online ratings: An empirical study

Christopher Leberknight, Soumya Sen, Mung Chiang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

12 Citations (Scopus)

Abstract

Many online rating systems represent product quality using metrics such as the mean and the distribution of ratings. However, the mean usually becomes stable as reviews accumulate, and consequently, it does not reflect the trend emerging from the latest user ratings. Additionally, understanding whether any variation in the trend is truly significant requires accounting for the volatility of the product's rating history. Developing better rating aggregation techniques should focus on quantifying the volatility in ratings to appropriately weight or discount older ratings. We present a theoretical model based on stock market metrics, known as the Average Rating Volatility (ARV), which captures the fluctuation present in these ratings. Next, ARV is mapped to the discounting factor for weighting (aging) past ratings and used as the coefficient in Brown's Simple Exponential Smoothing to produce an aggregate mean rating. This proposed method represents the "true" quality of a product more accurately because it accounts for both volatility and trend in the product's rating history. Empirical findings on rating volatility for several product categories using data from Amazon further motivate the need and applicability of the proposed methodology.

Original languageEnglish
Title of host publicationE-Life
Subtitle of host publicationWeb-Enabled Convergence of Commerce, Work, and Social Life - 10th Workshop on E-Business, WEB 2011, Revised Selected Papers
PublisherSpringer Verlag
Pages77-86
Number of pages10
ISBN (Print)9783642298721
DOIs
StatePublished - 1 Jan 2012
Event10th Workshop on E-Business on E-Life: Web-Enabled Convergence of Commerce, Work, and Social Life, WEB 2011 - Shanghai, China
Duration: 4 Dec 20114 Dec 2011

Publication series

NameLecture Notes in Business Information Processing
Volume108 LNBIP
ISSN (Print)1865-1348

Other

Other10th Workshop on E-Business on E-Life: Web-Enabled Convergence of Commerce, Work, and Social Life, WEB 2011
CountryChina
CityShanghai
Period4/12/114/12/11

Fingerprint

Volatility
Empirical Study
Agglomeration
Aging of materials
Exponential Smoothing
Metric
Product Systems
Discounting
Discount
Accumulate
Stock Market
Theoretical Model
Weighting
Financial markets
Rating
Empirical study
Aggregation
Fluctuations
Model-based
Methodology

Keywords

  • Consumer confidence
  • decision support
  • e-commerce
  • online ratings
  • reputation systems

Cite this

Leberknight, C., Sen, S., & Chiang, M. (2012). On the volatility of online ratings: An empirical study. In E-Life: Web-Enabled Convergence of Commerce, Work, and Social Life - 10th Workshop on E-Business, WEB 2011, Revised Selected Papers (pp. 77-86). (Lecture Notes in Business Information Processing; Vol. 108 LNBIP). Springer Verlag. https://doi.org/10.1007/978-3-642-29873-8-8
Leberknight, Christopher ; Sen, Soumya ; Chiang, Mung. / On the volatility of online ratings : An empirical study. E-Life: Web-Enabled Convergence of Commerce, Work, and Social Life - 10th Workshop on E-Business, WEB 2011, Revised Selected Papers. Springer Verlag, 2012. pp. 77-86 (Lecture Notes in Business Information Processing).
@inproceedings{fa78c9cf71124e07a91e65a171fa4e35,
title = "On the volatility of online ratings: An empirical study",
abstract = "Many online rating systems represent product quality using metrics such as the mean and the distribution of ratings. However, the mean usually becomes stable as reviews accumulate, and consequently, it does not reflect the trend emerging from the latest user ratings. Additionally, understanding whether any variation in the trend is truly significant requires accounting for the volatility of the product's rating history. Developing better rating aggregation techniques should focus on quantifying the volatility in ratings to appropriately weight or discount older ratings. We present a theoretical model based on stock market metrics, known as the Average Rating Volatility (ARV), which captures the fluctuation present in these ratings. Next, ARV is mapped to the discounting factor for weighting (aging) past ratings and used as the coefficient in Brown's Simple Exponential Smoothing to produce an aggregate mean rating. This proposed method represents the {"}true{"} quality of a product more accurately because it accounts for both volatility and trend in the product's rating history. Empirical findings on rating volatility for several product categories using data from Amazon further motivate the need and applicability of the proposed methodology.",
keywords = "Consumer confidence, decision support, e-commerce, online ratings, reputation systems",
author = "Christopher Leberknight and Soumya Sen and Mung Chiang",
year = "2012",
month = "1",
day = "1",
doi = "10.1007/978-3-642-29873-8-8",
language = "English",
isbn = "9783642298721",
series = "Lecture Notes in Business Information Processing",
publisher = "Springer Verlag",
pages = "77--86",
booktitle = "E-Life",

}

Leberknight, C, Sen, S & Chiang, M 2012, On the volatility of online ratings: An empirical study. in E-Life: Web-Enabled Convergence of Commerce, Work, and Social Life - 10th Workshop on E-Business, WEB 2011, Revised Selected Papers. Lecture Notes in Business Information Processing, vol. 108 LNBIP, Springer Verlag, pp. 77-86, 10th Workshop on E-Business on E-Life: Web-Enabled Convergence of Commerce, Work, and Social Life, WEB 2011, Shanghai, China, 4/12/11. https://doi.org/10.1007/978-3-642-29873-8-8

On the volatility of online ratings : An empirical study. / Leberknight, Christopher; Sen, Soumya; Chiang, Mung.

E-Life: Web-Enabled Convergence of Commerce, Work, and Social Life - 10th Workshop on E-Business, WEB 2011, Revised Selected Papers. Springer Verlag, 2012. p. 77-86 (Lecture Notes in Business Information Processing; Vol. 108 LNBIP).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - On the volatility of online ratings

T2 - An empirical study

AU - Leberknight, Christopher

AU - Sen, Soumya

AU - Chiang, Mung

PY - 2012/1/1

Y1 - 2012/1/1

N2 - Many online rating systems represent product quality using metrics such as the mean and the distribution of ratings. However, the mean usually becomes stable as reviews accumulate, and consequently, it does not reflect the trend emerging from the latest user ratings. Additionally, understanding whether any variation in the trend is truly significant requires accounting for the volatility of the product's rating history. Developing better rating aggregation techniques should focus on quantifying the volatility in ratings to appropriately weight or discount older ratings. We present a theoretical model based on stock market metrics, known as the Average Rating Volatility (ARV), which captures the fluctuation present in these ratings. Next, ARV is mapped to the discounting factor for weighting (aging) past ratings and used as the coefficient in Brown's Simple Exponential Smoothing to produce an aggregate mean rating. This proposed method represents the "true" quality of a product more accurately because it accounts for both volatility and trend in the product's rating history. Empirical findings on rating volatility for several product categories using data from Amazon further motivate the need and applicability of the proposed methodology.

AB - Many online rating systems represent product quality using metrics such as the mean and the distribution of ratings. However, the mean usually becomes stable as reviews accumulate, and consequently, it does not reflect the trend emerging from the latest user ratings. Additionally, understanding whether any variation in the trend is truly significant requires accounting for the volatility of the product's rating history. Developing better rating aggregation techniques should focus on quantifying the volatility in ratings to appropriately weight or discount older ratings. We present a theoretical model based on stock market metrics, known as the Average Rating Volatility (ARV), which captures the fluctuation present in these ratings. Next, ARV is mapped to the discounting factor for weighting (aging) past ratings and used as the coefficient in Brown's Simple Exponential Smoothing to produce an aggregate mean rating. This proposed method represents the "true" quality of a product more accurately because it accounts for both volatility and trend in the product's rating history. Empirical findings on rating volatility for several product categories using data from Amazon further motivate the need and applicability of the proposed methodology.

KW - Consumer confidence

KW - decision support

KW - e-commerce

KW - online ratings

KW - reputation systems

UR - http://www.scopus.com/inward/record.url?scp=84879736333&partnerID=8YFLogxK

U2 - 10.1007/978-3-642-29873-8-8

DO - 10.1007/978-3-642-29873-8-8

M3 - Conference contribution

AN - SCOPUS:84879736333

SN - 9783642298721

T3 - Lecture Notes in Business Information Processing

SP - 77

EP - 86

BT - E-Life

PB - Springer Verlag

ER -

Leberknight C, Sen S, Chiang M. On the volatility of online ratings: An empirical study. In E-Life: Web-Enabled Convergence of Commerce, Work, and Social Life - 10th Workshop on E-Business, WEB 2011, Revised Selected Papers. Springer Verlag. 2012. p. 77-86. (Lecture Notes in Business Information Processing). https://doi.org/10.1007/978-3-642-29873-8-8