THE USE OF PUPILLOMETRY TO STUDY MENTAL DEMAND DURING SPEECH PRODUCTION IN NOISE

Keiko Ishikawa, Elisabeth Coster, Hannah Li, Diana Orbelo

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Understanding the cognitive demand required for implementing speech therapy techniques in real-world environments has significant clinical implications. This study used self-rating and pupillometry to investigate the mental demand associated with speaking differently in various noise conditions. Five speakers with healthy voices read aloud in casual and clear speech in quiet conditions and while listening to multi-talker (MT) noise, reversed two-talker (RevMT) noise, and speech-shaped (SS) noise. The speakers rated their perceived mental demand after each task using a modified NASA-TLX scale, while the change in their pupil size was monitored using an eye tracker. The results of this self-rating revealed that mental demand was highest in the MT noise condition, followed by RevMT noise. In contrast, SS noise did not significantly increase mental demand. Pupillometry data showed that the pupil dilation was greatest for the MT noise, for both casual and clear speech, corroborating the self-rating data. Interestingly, the dilation for clear speech was greater than for casual speech in quiet, but less in RevMT and SS noises. These findings illustrate a complex interaction between speech modification and acoustic environments and suggest the potential of pupillometry as an objective measure for quantifying mental demand in speech production.

Original languageEnglish
Title of host publicationForum Acusticum 2023 - 10th Convention of the European Acoustics Association, EAA 2023
ISBN (Electronic)9788888942674
StatePublished - 2023
Event10th Convention of the European Acoustics Association, EAA 2023 - Torino, Italy
Duration: Sep 11 2023Sep 15 2023

Publication series

NameProceedings of Forum Acusticum
ISSN (Print)2221-3767

Conference

Conference10th Convention of the European Acoustics Association, EAA 2023
Country/TerritoryItaly
CityTorino
Period9/11/239/15/23

Bibliographical note

Publisher Copyright:
© 2023 Ishikawa et al. This is an open-access article distributed under the terms of the Creative Commons Attribution 3.0 Unported License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

Funding

This project was funded by the University of Illinois Campus Research Board Pilot Grant, awarded to Keiko Ishikawa.

FundersFunder number
Campus Research Board

    Keywords

    • background noise
    • cognitive load
    • pupillometry
    • speech modification
    • speech production

    ASJC Scopus subject areas

    • Acoustics and Ultrasonics

    Fingerprint

    Dive into the research topics of 'THE USE OF PUPILLOMETRY TO STUDY MENTAL DEMAND DURING SPEECH PRODUCTION IN NOISE'. Together they form a unique fingerprint.

    Cite this