Skip to main navigation Skip to search Skip to main content

A Sample Size Extractor for RCT Reports

  • Fengyang Lin
  • , Hao Liu
  • , Paul Moon
  • , Chunhua Weng

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Sample size is an important indicator of the power of randomized controlled trials (RCTs). In this paper, we designed a total sample size extractor using a combination of syntactic and machine learning methods, and evaluated it on 300 Covid-19 abstracts (Covid-Set) and 100 generic RCT abstracts (General-Set). To improve the performance, we applied transfer learning from a large public corpus of annotated abstracts. We achieved an average F1 score of 0.73 on the Covid-Set testing set, and 0.60 on the General-Set using exact matches. The F1 scores for loose matches on both datasets were over 0.74. Compared with the state-of-the-art tool, our extractor reports total sample sizes directly and improved F1 scores by at least 4% without transfer learning. We demonstrated that transfer learning improved the sample size extraction accuracy and minimized human labor on annotations.

Original languageEnglish
Title of host publicationMEDINFO 2021
Subtitle of host publicationOne World, One Health - Global Partnership for Digital Innovation - Proceedings of the 18th World Congress on Medical and Health Informatics
EditorsPaula Otero, Philip Scott, Susan Z. Martin, Elaine Huesing
PublisherIOS Press BV
Pages617-621
Number of pages5
ISBN (Electronic)9781643682648
DOIs
StatePublished - 6 Jun 2022
Event18th World Congress on Medical and Health Informatics: One World, One Health - Global Partnership for Digital Innovation, MEDINFO 2021 - Virtual, Online
Duration: 2 Oct 20214 Oct 2021

Publication series

NameStudies in Health Technology and Informatics
Volume290
ISSN (Print)0926-9630
ISSN (Electronic)1879-8365

Conference

Conference18th World Congress on Medical and Health Informatics: One World, One Health - Global Partnership for Digital Innovation, MEDINFO 2021
CityVirtual, Online
Period2/10/214/10/21

Keywords

  • Natural Language Processing
  • Randomized Controlled Trial
  • Sample Size

Fingerprint

Dive into the research topics of 'A Sample Size Extractor for RCT Reports'. Together they form a unique fingerprint.

Cite this