Skip to main navigation Skip to search Skip to main content

Voice and choice: Investigating the role of prosodic variation in request compliance and perceived politeness using conversational TTS

  • KTH Royal Institute of Technology
  • SUNY Buffalo
  • University of Groningen

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

2 Scopus citations

Abstract

As conversational Text-to-Speech (TTS) technologies become increasingly realistic and expressive, understanding the impact of prosodic variation on speech perception and social dynamics is crucial for enhancing conversational systems. This study explores the influence of prosodic features on listener responses to indirect requests using a specifically designed conversational TTS engine capable of controlling prosody, and generating speech across three different speaker profiles: female, male, and gender-ambiguous. We conducted two experiments to analyse how naturalistic variations in speech rate and vocal effort impact the likelihood of request compliance and perceived politeness. In the first experiment, we examined how prosodic modifications affect the perception of politeness in permission- and action requests. In the second experiment participants compared pairs of spoken requests, each rendered with different prosodic features, and chose which they were more likely to grant. Results indicate that both faster speech rate and higher vocal effort increased the willingness to comply, though the extent of this influence varied by speaker gender. Higher vocal effort in action requests increases the chance of being granted more than in permission requests. Politeness has a demonstrated positive impact on the likelihood of requests being granted, this effect is stronger for the male voice compared to female and gender-ambiguous voices.

Original languageEnglish
Title of host publicationSIGDIAL 2024 - 25th Annual Meeting of the Special Interest Group on Discourse and Dialogue, Proceedings of the Conference
EditorsTatsuya Kawahara, Vera Demberg, Stefan Ultes, Koji Inoue, Shikib Mehri, David Howcroft, Kazunori Komatani
PublisherAssociation for Computational Linguistics (ACL)
Pages466-476
Number of pages11
ISBN (Electronic)9798891761612
DOIs
StatePublished - 2024
Event25th Annual Meeting of the Special Interest Group on Discourse and Dialogue, SIGDIAL 2024 - Kyoto, Japan
Duration: Sep 18 2024Sep 20 2024

Publication series

NameSIGDIAL 2024 - 25th Annual Meeting of the Special Interest Group on Discourse and Dialogue, Proceedings of the Conference

Conference

Conference25th Annual Meeting of the Special Interest Group on Discourse and Dialogue, SIGDIAL 2024
Country/TerritoryJapan
CityKyoto
Period09/18/2409/20/24

Fingerprint

Dive into the research topics of 'Voice and choice: Investigating the role of prosodic variation in request compliance and perceived politeness using conversational TTS'. Together they form a unique fingerprint.

Cite this