Combining the advice of experts with randomized boosting for robust pattern recognition

Jing Peng, Guna Seetharaman

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

We have developed an algorithm, called ShareBoost, for combining mulitple classifiers from multiple information sources. The algorithm offer a number of advantages, such as increased confidence in decision-making, resulting from combined complementary data, good performance against noise, and the ability to exploit interplay between sensor subspaces.We have also developed a randomized version of ShareBoost, called rShare-Boost, by casting ShareBoost within an adversarial multi-armed bandit framework. This in turn allows us to show rShareBoost is efficient and convergent. Both algorithms have shown promise in a number of applications. The hallmark of these algorithms is a set of strategies for mining and exploiting the most informative sensor sources for a given situation. These strategies are computations performed by the algorithms. In this paper, we propose to consider strategies as advice given to an algorithm by 'experts' or 'Oracle.' In the context of pattern recognition, there can be several pattern recognition strategies. Each strategy makes different assumptions regarding the fidelity of each sensor source and uses different data to arrive at its estimates. Each strategy may place different trust in a sensor at different times, and each may be better in different situations. In this paper, we introduce a novel algorithm for combining the advice of the experts to achieve robust pattern recognition performance. We show that with high probability the algorithm seeks out the advice of the experts from decision relevant information sources for making optimal prediction. Finally, we provide experimental results using face and infrared image data that corroborate our theoretical analysis.

Original languageEnglish
Title of host publication2013 IEEE Applied Imagery Pattern Recognition Workshop
Subtitle of host publicationSensing for Control and Augmentation, AIPR 2013
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Print)9781479925407
DOIs
StatePublished - 1 Jan 2013
Event2013 IEEE Applied Imagery Pattern Recognition Workshop: Sensing for Control and Augmentation, AIPR 2013 - Washington, DC, United States
Duration: 23 Oct 201325 Oct 2013

Publication series

NameProceedings - Applied Imagery Pattern Recognition Workshop
ISSN (Print)1550-5219

Other

Other2013 IEEE Applied Imagery Pattern Recognition Workshop: Sensing for Control and Augmentation, AIPR 2013
CountryUnited States
CityWashington, DC
Period23/10/1325/10/13

Fingerprint

Pattern recognition
Sensors
Casting
Classifiers
Decision making
Infrared radiation

Cite this

Peng, J., & Seetharaman, G. (2013). Combining the advice of experts with randomized boosting for robust pattern recognition. In 2013 IEEE Applied Imagery Pattern Recognition Workshop: Sensing for Control and Augmentation, AIPR 2013 [6749332] (Proceedings - Applied Imagery Pattern Recognition Workshop). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/AIPR.2013.6749332
Peng, Jing ; Seetharaman, Guna. / Combining the advice of experts with randomized boosting for robust pattern recognition. 2013 IEEE Applied Imagery Pattern Recognition Workshop: Sensing for Control and Augmentation, AIPR 2013. Institute of Electrical and Electronics Engineers Inc., 2013. (Proceedings - Applied Imagery Pattern Recognition Workshop).
@inproceedings{483333ff5e014e62860f1f49c96dd44a,
title = "Combining the advice of experts with randomized boosting for robust pattern recognition",
abstract = "We have developed an algorithm, called ShareBoost, for combining mulitple classifiers from multiple information sources. The algorithm offer a number of advantages, such as increased confidence in decision-making, resulting from combined complementary data, good performance against noise, and the ability to exploit interplay between sensor subspaces.We have also developed a randomized version of ShareBoost, called rShare-Boost, by casting ShareBoost within an adversarial multi-armed bandit framework. This in turn allows us to show rShareBoost is efficient and convergent. Both algorithms have shown promise in a number of applications. The hallmark of these algorithms is a set of strategies for mining and exploiting the most informative sensor sources for a given situation. These strategies are computations performed by the algorithms. In this paper, we propose to consider strategies as advice given to an algorithm by 'experts' or 'Oracle.' In the context of pattern recognition, there can be several pattern recognition strategies. Each strategy makes different assumptions regarding the fidelity of each sensor source and uses different data to arrive at its estimates. Each strategy may place different trust in a sensor at different times, and each may be better in different situations. In this paper, we introduce a novel algorithm for combining the advice of the experts to achieve robust pattern recognition performance. We show that with high probability the algorithm seeks out the advice of the experts from decision relevant information sources for making optimal prediction. Finally, we provide experimental results using face and infrared image data that corroborate our theoretical analysis.",
author = "Jing Peng and Guna Seetharaman",
year = "2013",
month = "1",
day = "1",
doi = "10.1109/AIPR.2013.6749332",
language = "English",
isbn = "9781479925407",
series = "Proceedings - Applied Imagery Pattern Recognition Workshop",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
booktitle = "2013 IEEE Applied Imagery Pattern Recognition Workshop",

}

Peng, J & Seetharaman, G 2013, Combining the advice of experts with randomized boosting for robust pattern recognition. in 2013 IEEE Applied Imagery Pattern Recognition Workshop: Sensing for Control and Augmentation, AIPR 2013., 6749332, Proceedings - Applied Imagery Pattern Recognition Workshop, Institute of Electrical and Electronics Engineers Inc., 2013 IEEE Applied Imagery Pattern Recognition Workshop: Sensing for Control and Augmentation, AIPR 2013, Washington, DC, United States, 23/10/13. https://doi.org/10.1109/AIPR.2013.6749332

Combining the advice of experts with randomized boosting for robust pattern recognition. / Peng, Jing; Seetharaman, Guna.

2013 IEEE Applied Imagery Pattern Recognition Workshop: Sensing for Control and Augmentation, AIPR 2013. Institute of Electrical and Electronics Engineers Inc., 2013. 6749332 (Proceedings - Applied Imagery Pattern Recognition Workshop).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Combining the advice of experts with randomized boosting for robust pattern recognition

AU - Peng, Jing

AU - Seetharaman, Guna

PY - 2013/1/1

Y1 - 2013/1/1

N2 - We have developed an algorithm, called ShareBoost, for combining mulitple classifiers from multiple information sources. The algorithm offer a number of advantages, such as increased confidence in decision-making, resulting from combined complementary data, good performance against noise, and the ability to exploit interplay between sensor subspaces.We have also developed a randomized version of ShareBoost, called rShare-Boost, by casting ShareBoost within an adversarial multi-armed bandit framework. This in turn allows us to show rShareBoost is efficient and convergent. Both algorithms have shown promise in a number of applications. The hallmark of these algorithms is a set of strategies for mining and exploiting the most informative sensor sources for a given situation. These strategies are computations performed by the algorithms. In this paper, we propose to consider strategies as advice given to an algorithm by 'experts' or 'Oracle.' In the context of pattern recognition, there can be several pattern recognition strategies. Each strategy makes different assumptions regarding the fidelity of each sensor source and uses different data to arrive at its estimates. Each strategy may place different trust in a sensor at different times, and each may be better in different situations. In this paper, we introduce a novel algorithm for combining the advice of the experts to achieve robust pattern recognition performance. We show that with high probability the algorithm seeks out the advice of the experts from decision relevant information sources for making optimal prediction. Finally, we provide experimental results using face and infrared image data that corroborate our theoretical analysis.

AB - We have developed an algorithm, called ShareBoost, for combining mulitple classifiers from multiple information sources. The algorithm offer a number of advantages, such as increased confidence in decision-making, resulting from combined complementary data, good performance against noise, and the ability to exploit interplay between sensor subspaces.We have also developed a randomized version of ShareBoost, called rShare-Boost, by casting ShareBoost within an adversarial multi-armed bandit framework. This in turn allows us to show rShareBoost is efficient and convergent. Both algorithms have shown promise in a number of applications. The hallmark of these algorithms is a set of strategies for mining and exploiting the most informative sensor sources for a given situation. These strategies are computations performed by the algorithms. In this paper, we propose to consider strategies as advice given to an algorithm by 'experts' or 'Oracle.' In the context of pattern recognition, there can be several pattern recognition strategies. Each strategy makes different assumptions regarding the fidelity of each sensor source and uses different data to arrive at its estimates. Each strategy may place different trust in a sensor at different times, and each may be better in different situations. In this paper, we introduce a novel algorithm for combining the advice of the experts to achieve robust pattern recognition performance. We show that with high probability the algorithm seeks out the advice of the experts from decision relevant information sources for making optimal prediction. Finally, we provide experimental results using face and infrared image data that corroborate our theoretical analysis.

UR - http://www.scopus.com/inward/record.url?scp=84898401025&partnerID=8YFLogxK

U2 - 10.1109/AIPR.2013.6749332

DO - 10.1109/AIPR.2013.6749332

M3 - Conference contribution

AN - SCOPUS:84898401025

SN - 9781479925407

T3 - Proceedings - Applied Imagery Pattern Recognition Workshop

BT - 2013 IEEE Applied Imagery Pattern Recognition Workshop

PB - Institute of Electrical and Electronics Engineers Inc.

ER -

Peng J, Seetharaman G. Combining the advice of experts with randomized boosting for robust pattern recognition. In 2013 IEEE Applied Imagery Pattern Recognition Workshop: Sensing for Control and Augmentation, AIPR 2013. Institute of Electrical and Electronics Engineers Inc. 2013. 6749332. (Proceedings - Applied Imagery Pattern Recognition Workshop). https://doi.org/10.1109/AIPR.2013.6749332