Semantic enrichment of text representation with wikipedia for text classification

Hiroki Yamakawa, Jing Peng, Anna Feldman

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

5 Scopus citations

Abstract

Text classification is a widely studied topic in the area of machine learning. A number of techniques have been developed to represent and classify text documents. Most of the techniques try to achieve good classification performance while taking a document only by its words (e.g. statistical analysis on word frequency and distribution patterns). One of the recent trends in text classification research is to incorporate more semantic interpretation in text classification, especially by using Wikipedia. This paper introduces a technique for incorporating the vast amount of human knowledge accumulated in Wikipedia into text representation and classification. The aim is to improve classification performance by transforming general terms into a set of related concepts grouped around semantic themes. In order to achieve this goal, this paper proposes a unique method for breaking the enormous amount of extracted Wikipedia knowledge (concepts) into smaller pieces (subsets of concepts). The subsets of concepts are separately used to represent the same set of documents in a number of different ways, from which an ensemble of classifiers is built. Experimental results show that an ensemble of classifiers individually trained on a different representation of the document set performs better with increased accuracy and stability than that of a classifier trained only on the original document set.

Original languageEnglish
Title of host publication2010 IEEE International Conference on Systems, Man and Cybernetics, SMC 2010
Pages4333-4340
Number of pages8
DOIs
StatePublished - 2010
Event2010 IEEE International Conference on Systems, Man and Cybernetics, SMC 2010 - Istanbul, Turkey
Duration: 10 Oct 201013 Oct 2010

Publication series

NameConference Proceedings - IEEE International Conference on Systems, Man and Cybernetics
ISSN (Print)1062-922X

Other

Other2010 IEEE International Conference on Systems, Man and Cybernetics, SMC 2010
Country/TerritoryTurkey
CityIstanbul
Period10/10/1013/10/10

Keywords

  • Ensemble
  • Semantics
  • Text classification
  • Text representation
  • Voting
  • Wikipedia

Fingerprint

Dive into the research topics of 'Semantic enrichment of text representation with wikipedia for text classification'. Together they form a unique fingerprint.

Cite this