Cross-modal interaction between vision and hearing

A speed-accuracy analysis

Yoav Arieh, Lawrence E. Marks

Research output: Contribution to journalArticleResearchpeer-review

15 Citations (Scopus)

Abstract

Cross-modal facilitation of response time (RT) is said to occur in a selective attention task when the introduction of an irrelevant sound increases the speed at which visual stimuli are detected and identified. To investigate the source of the facilitation in RT, we asked participants to rapidly identify the color of lights in the quiet and when accompanied by a pulse of noise. The resulting measures of accuracy and RT were used to derive speed-accuracy trade-off functions (SATFs) separately for the noise and the no-noise conditions. The two resulting SATFs have similar slopes and intercepts and, thus, can be treated as overlapping segments of a single function. That speeded identification of color with and without the presence of noise can be described by one SATF suggests, in turn, that cross-modal facilitation of RT represents a change in decision criterion induced by the auditory stimulus. Analogous changes in decision criteria might also underlie other measures of cross-modal interactions, such as auditory enhancement of brightness judgments.

Original languageEnglish
Pages (from-to)412-421
Number of pages10
JournalPerception and Psychophysics
Volume70
Issue number3
DOIs
StatePublished - 1 Apr 2008

Fingerprint

Hearing
Reaction Time
Noise
Color
Light

Cite this

@article{ba2bdeda236b40868fccbfa797ac2e68,
title = "Cross-modal interaction between vision and hearing: A speed-accuracy analysis",
abstract = "Cross-modal facilitation of response time (RT) is said to occur in a selective attention task when the introduction of an irrelevant sound increases the speed at which visual stimuli are detected and identified. To investigate the source of the facilitation in RT, we asked participants to rapidly identify the color of lights in the quiet and when accompanied by a pulse of noise. The resulting measures of accuracy and RT were used to derive speed-accuracy trade-off functions (SATFs) separately for the noise and the no-noise conditions. The two resulting SATFs have similar slopes and intercepts and, thus, can be treated as overlapping segments of a single function. That speeded identification of color with and without the presence of noise can be described by one SATF suggests, in turn, that cross-modal facilitation of RT represents a change in decision criterion induced by the auditory stimulus. Analogous changes in decision criteria might also underlie other measures of cross-modal interactions, such as auditory enhancement of brightness judgments.",
author = "Yoav Arieh and Marks, {Lawrence E.}",
year = "2008",
month = "4",
day = "1",
doi = "10.3758/PP.70.3.412",
language = "English",
volume = "70",
pages = "412--421",
journal = "Perception and Psychophysics",
issn = "0031-5117",
publisher = "Psychonomic Society Inc.",
number = "3",

}

Cross-modal interaction between vision and hearing : A speed-accuracy analysis. / Arieh, Yoav; Marks, Lawrence E.

In: Perception and Psychophysics, Vol. 70, No. 3, 01.04.2008, p. 412-421.

Research output: Contribution to journalArticleResearchpeer-review

TY - JOUR

T1 - Cross-modal interaction between vision and hearing

T2 - A speed-accuracy analysis

AU - Arieh, Yoav

AU - Marks, Lawrence E.

PY - 2008/4/1

Y1 - 2008/4/1

N2 - Cross-modal facilitation of response time (RT) is said to occur in a selective attention task when the introduction of an irrelevant sound increases the speed at which visual stimuli are detected and identified. To investigate the source of the facilitation in RT, we asked participants to rapidly identify the color of lights in the quiet and when accompanied by a pulse of noise. The resulting measures of accuracy and RT were used to derive speed-accuracy trade-off functions (SATFs) separately for the noise and the no-noise conditions. The two resulting SATFs have similar slopes and intercepts and, thus, can be treated as overlapping segments of a single function. That speeded identification of color with and without the presence of noise can be described by one SATF suggests, in turn, that cross-modal facilitation of RT represents a change in decision criterion induced by the auditory stimulus. Analogous changes in decision criteria might also underlie other measures of cross-modal interactions, such as auditory enhancement of brightness judgments.

AB - Cross-modal facilitation of response time (RT) is said to occur in a selective attention task when the introduction of an irrelevant sound increases the speed at which visual stimuli are detected and identified. To investigate the source of the facilitation in RT, we asked participants to rapidly identify the color of lights in the quiet and when accompanied by a pulse of noise. The resulting measures of accuracy and RT were used to derive speed-accuracy trade-off functions (SATFs) separately for the noise and the no-noise conditions. The two resulting SATFs have similar slopes and intercepts and, thus, can be treated as overlapping segments of a single function. That speeded identification of color with and without the presence of noise can be described by one SATF suggests, in turn, that cross-modal facilitation of RT represents a change in decision criterion induced by the auditory stimulus. Analogous changes in decision criteria might also underlie other measures of cross-modal interactions, such as auditory enhancement of brightness judgments.

UR - http://www.scopus.com/inward/record.url?scp=45549107272&partnerID=8YFLogxK

U2 - 10.3758/PP.70.3.412

DO - 10.3758/PP.70.3.412

M3 - Article

VL - 70

SP - 412

EP - 421

JO - Perception and Psychophysics

JF - Perception and Psychophysics

SN - 0031-5117

IS - 3

ER -