GPU-Accelerated computing with gibbs sampler for the 2PNO IRT model

Yanyan Sheng, William S. Welling, Michelle Zhu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Item response theory (IRT) is a popular approach used for addressing large-scale statistical problems in psychometrics as well as in other fields. The fully Bayesian approach for estimating IRT models is usually memory and computational expensive due to the large number of iterations. This limits the use of the procedure in many applications. In an effort to overcome such restrictions, previous studies proposed to tackle the problem using massive core-based graphic processing units (GPU), and demonstrated the advantage of this approach over the message passing interface (MPI) by showing that a single GPU card could achieve a speedup of up to 50×. Given that GPU is practical, cost-effective, and convenient, this study aims to seek further improvements using a single GPU card.

Original languageEnglish
Title of host publicationQuantitative Psychology Research - The 79th Annual Meeting of the Psychometric Society, 2014
Subtitle of host publicationThe 79th Annual Meeting of the Psychometric Society, Madison, Wisconsin, 2014
EditorsL. Andries van der Ark, Wen-Chung Wang, Jeffrey A. Douglas, Daniel M. Bolt, Sy-Miin Chow
PublisherSpringer New York LLC
Pages59-73
Number of pages15
Volume140
ISBN (Electronic)9783319199771
ISBN (Print)9783319199764
DOIs
StatePublished - 1 Jan 2015
Event79th Annual International Meeting of the Psychometric Society, IMPS 2014 - Madison, United States
Duration: 21 Jul 201425 Jul 2014

Publication series

NameSpringer Proceedings in Mathematics and Statistics
Volume140
ISSN (Print)2194-1009
ISSN (Electronic)2194-1017

Other

Other79th Annual International Meeting of the Psychometric Society, IMPS 2014
CountryUnited States
CityMadison
Period21/07/1425/07/14

Fingerprint

Gibbs Sampler
Graphics Processing Unit
Model Theory
Computing
Message Passing Interface
Psychometrics
Bayesian Approach
Speedup
Restriction
Iteration
Costs

Keywords

  • Bayesian estimation
  • CUDA
  • High performance computing
  • Item response theory
  • MCMC
  • Optimization
  • Two-parameter IRT model

Cite this

Sheng, Y., Welling, W. S., & Zhu, M. (2015). GPU-Accelerated computing with gibbs sampler for the 2PNO IRT model. In L. A. van der Ark, W-C. Wang, J. A. Douglas, D. M. Bolt, & S-M. Chow (Eds.), Quantitative Psychology Research - The 79th Annual Meeting of the Psychometric Society, 2014: The 79th Annual Meeting of the Psychometric Society, Madison, Wisconsin, 2014 (Vol. 140, pp. 59-73). (Springer Proceedings in Mathematics and Statistics; Vol. 140). Springer New York LLC. https://doi.org/10.1007/978-3-319-19977-1_5
Sheng, Yanyan ; Welling, William S. ; Zhu, Michelle. / GPU-Accelerated computing with gibbs sampler for the 2PNO IRT model. Quantitative Psychology Research - The 79th Annual Meeting of the Psychometric Society, 2014: The 79th Annual Meeting of the Psychometric Society, Madison, Wisconsin, 2014. editor / L. Andries van der Ark ; Wen-Chung Wang ; Jeffrey A. Douglas ; Daniel M. Bolt ; Sy-Miin Chow. Vol. 140 Springer New York LLC, 2015. pp. 59-73 (Springer Proceedings in Mathematics and Statistics).
@inproceedings{60bbc7ba31424468a37c93332f723c4c,
title = "GPU-Accelerated computing with gibbs sampler for the 2PNO IRT model",
abstract = "Item response theory (IRT) is a popular approach used for addressing large-scale statistical problems in psychometrics as well as in other fields. The fully Bayesian approach for estimating IRT models is usually memory and computational expensive due to the large number of iterations. This limits the use of the procedure in many applications. In an effort to overcome such restrictions, previous studies proposed to tackle the problem using massive core-based graphic processing units (GPU), and demonstrated the advantage of this approach over the message passing interface (MPI) by showing that a single GPU card could achieve a speedup of up to 50×. Given that GPU is practical, cost-effective, and convenient, this study aims to seek further improvements using a single GPU card.",
keywords = "Bayesian estimation, CUDA, High performance computing, Item response theory, MCMC, Optimization, Two-parameter IRT model",
author = "Yanyan Sheng and Welling, {William S.} and Michelle Zhu",
year = "2015",
month = "1",
day = "1",
doi = "10.1007/978-3-319-19977-1_5",
language = "English",
isbn = "9783319199764",
volume = "140",
series = "Springer Proceedings in Mathematics and Statistics",
publisher = "Springer New York LLC",
pages = "59--73",
editor = "{van der Ark}, {L. Andries} and Wen-Chung Wang and Douglas, {Jeffrey A.} and Bolt, {Daniel M.} and Sy-Miin Chow",
booktitle = "Quantitative Psychology Research - The 79th Annual Meeting of the Psychometric Society, 2014",

}

Sheng, Y, Welling, WS & Zhu, M 2015, GPU-Accelerated computing with gibbs sampler for the 2PNO IRT model. in LA van der Ark, W-C Wang, JA Douglas, DM Bolt & S-M Chow (eds), Quantitative Psychology Research - The 79th Annual Meeting of the Psychometric Society, 2014: The 79th Annual Meeting of the Psychometric Society, Madison, Wisconsin, 2014. vol. 140, Springer Proceedings in Mathematics and Statistics, vol. 140, Springer New York LLC, pp. 59-73, 79th Annual International Meeting of the Psychometric Society, IMPS 2014, Madison, United States, 21/07/14. https://doi.org/10.1007/978-3-319-19977-1_5

GPU-Accelerated computing with gibbs sampler for the 2PNO IRT model. / Sheng, Yanyan; Welling, William S.; Zhu, Michelle.

Quantitative Psychology Research - The 79th Annual Meeting of the Psychometric Society, 2014: The 79th Annual Meeting of the Psychometric Society, Madison, Wisconsin, 2014. ed. / L. Andries van der Ark; Wen-Chung Wang; Jeffrey A. Douglas; Daniel M. Bolt; Sy-Miin Chow. Vol. 140 Springer New York LLC, 2015. p. 59-73 (Springer Proceedings in Mathematics and Statistics; Vol. 140).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - GPU-Accelerated computing with gibbs sampler for the 2PNO IRT model

AU - Sheng, Yanyan

AU - Welling, William S.

AU - Zhu, Michelle

PY - 2015/1/1

Y1 - 2015/1/1

N2 - Item response theory (IRT) is a popular approach used for addressing large-scale statistical problems in psychometrics as well as in other fields. The fully Bayesian approach for estimating IRT models is usually memory and computational expensive due to the large number of iterations. This limits the use of the procedure in many applications. In an effort to overcome such restrictions, previous studies proposed to tackle the problem using massive core-based graphic processing units (GPU), and demonstrated the advantage of this approach over the message passing interface (MPI) by showing that a single GPU card could achieve a speedup of up to 50×. Given that GPU is practical, cost-effective, and convenient, this study aims to seek further improvements using a single GPU card.

AB - Item response theory (IRT) is a popular approach used for addressing large-scale statistical problems in psychometrics as well as in other fields. The fully Bayesian approach for estimating IRT models is usually memory and computational expensive due to the large number of iterations. This limits the use of the procedure in many applications. In an effort to overcome such restrictions, previous studies proposed to tackle the problem using massive core-based graphic processing units (GPU), and demonstrated the advantage of this approach over the message passing interface (MPI) by showing that a single GPU card could achieve a speedup of up to 50×. Given that GPU is practical, cost-effective, and convenient, this study aims to seek further improvements using a single GPU card.

KW - Bayesian estimation

KW - CUDA

KW - High performance computing

KW - Item response theory

KW - MCMC

KW - Optimization

KW - Two-parameter IRT model

UR - http://www.scopus.com/inward/record.url?scp=84950241800&partnerID=8YFLogxK

U2 - 10.1007/978-3-319-19977-1_5

DO - 10.1007/978-3-319-19977-1_5

M3 - Conference contribution

AN - SCOPUS:84955387097

SN - 9783319199764

VL - 140

T3 - Springer Proceedings in Mathematics and Statistics

SP - 59

EP - 73

BT - Quantitative Psychology Research - The 79th Annual Meeting of the Psychometric Society, 2014

A2 - van der Ark, L. Andries

A2 - Wang, Wen-Chung

A2 - Douglas, Jeffrey A.

A2 - Bolt, Daniel M.

A2 - Chow, Sy-Miin

PB - Springer New York LLC

ER -

Sheng Y, Welling WS, Zhu M. GPU-Accelerated computing with gibbs sampler for the 2PNO IRT model. In van der Ark LA, Wang W-C, Douglas JA, Bolt DM, Chow S-M, editors, Quantitative Psychology Research - The 79th Annual Meeting of the Psychometric Society, 2014: The 79th Annual Meeting of the Psychometric Society, Madison, Wisconsin, 2014. Vol. 140. Springer New York LLC. 2015. p. 59-73. (Springer Proceedings in Mathematics and Statistics). https://doi.org/10.1007/978-3-319-19977-1_5