Skip to main navigation Skip to search Skip to main content

EmoType-Zero: Adaptive Fonts to Render the Speech Emotion

  • Dong She
  • , Jinghe Yu
  • , Nuo Chen
  • , Yuting Bai
  • , Yang Gao
  • , Zhanpeng Jin
  • South China University of Technology

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Text messaging often lacks paralinguistic cues essential for interpreting emotional tone. To explore visual alternatives, we first conducted a co-design study with 9 participants to distill a design space mapping vocal intonations to visual parameters (Geometry, Texture, and Motion). We developed EmoType-Zero, a research probe to operationalize these concepts. We then deployed this probe in a user study with 25 participants to empirically evaluate user perceptions. Results reveal a critical design trade-off: while the Combo mode (combining geometry, texture, and motion) achieved the highest emotional fidelity (mean ranking: M = 1.60, rank 1=best), its visual complexity compromised text legibility (M = 4.56). Consequently, participants preferred the subtle Geometry mode (M = 2.24) for daily usage, prioritizing clarity over high-intensity effects. Subjective feedback validated the probe's utility, with 80% of participants agreeing that it improved emotional understanding and 72% expressing willingness to adopt the system for situational impairments and social modulation.

Original languageEnglish
Title of host publicationCHI 2026 - Extended Abtracts of the 2026 CHI Conference on Human Factors in Computing Systems
EditorsNuria Oliver, David A. Shamma, Heloisa Candello, Pablo Cesar, Pedro Lopes, Valentino Artizzu, Fiona Draxler, Gustavo Lopez, Anke V. Reinschluessel, Xin Tong, Phoebe O. Toups Dugas
PublisherAssociation for Computing Machinery
ISBN (Electronic)9798400722813
DOIs
StatePublished - Apr 13 2026
EventExtended Abtracts of the 2026 CHI Conference on Human Factors in Computing Systems, CHI 2026 - Barcelona, Spain
Duration: Apr 13 2026Apr 17 2026

Publication series

NameConference on Human Factors in Computing Systems - Proceedings

Conference

ConferenceExtended Abtracts of the 2026 CHI Conference on Human Factors in Computing Systems, CHI 2026
Country/TerritorySpain
CityBarcelona
Period04/13/2604/17/26

Keywords

  • Affective Computing
  • Emotional Kinetic Typography
  • Speech-to-Text
  • Voice Input

Fingerprint

Dive into the research topics of 'EmoType-Zero: Adaptive Fonts to Render the Speech Emotion'. Together they form a unique fingerprint.

Cite this