GEISTHuman-Centered Information Systems · TU Clausthal, home

ActiveKeio · TU Clausthal

Digitalized Emotion

Digitalisierte Emotionen

Making emotional states measurable, transferable and shareable, from audience physiology at live performances to digital empathy.

Dancers on stage during the Boiling Mind performance
TeaserGEIST / Embodied Media

Digitalized Emotion is about making emotional states measurable, transferable and shareable. Physiological signals change with what a person feels, and wearable sensors can pick these changes up outside the laboratory. In two projects, BoilingMind and Frisson Waves, the group recorded the physiology of audiences during live performances; performers and researchers could then work with the crowd’s collective response.

Methods. The main instruments are wearable sensors for electrodermal activity (EDA) and motion, built into prototypes that people can wear through a full concert or theatre evening. Because emotions rarely appear on command, studies take place in real settings such as live performances rather than only under controlled lab conditions. Quantitative signal data is combined with qualitative accounts of what the audience experienced.

Goals. Behind this line stands the chair’s third goal: sustainable, emotional interaction and digital empathy. Planned systems will capture emotional responses to environmental problems and show what these issues actually trigger in people, in support of sustainable behaviour.

Era: TU Clausthal, Human-Centered Information Systems (since April 2026), and GEIST lab, Graduate School of Media Design, Keio University.

Source: ifi-hcis.tu-clausthal.de.

Gallery

Publications

Papers from this project

All 275 publications
  1. Boiling Mind: Amplifying the Audience-Performer Connection through Sonification and Visualization of Heart and Electrodermal Activities

    Moe Sugawa, Taichi Furukawa, George Chernyshov, Danny Hynds, Jiawen Han, Marcelo Padovani, Dingding Zheng, Karola Marky, Kai Kunze, Kouta Minamizawa

    TEI 2021conference

  2. Boiling Mind-A Dataset of Physiological Signals during an Exploratory Dance Performance

    Zhuoqi Fu, Jiawen Han, Dingding Zheng, Moe Sugawa, Taichi Furukawa, Chernyshov George, Hynds Danny, Padovani Marcelo, Marky Karola, Kouta Minamizawa, Jamie A Ward, Kai Kunze

    AHs 2021conference

  3. Frisson Waves: Exploring Automatic Detection, Triggering and Sharing of Aesthetic Chills in Music Performances

    Yan He, George Chernyshov, Jiawen Han, Dingding Zheng, Ragnar Thomsen, Danny Hynds, Muyu Liu, Yuehui Yang, Yulan Ju, Yun Suen Pai, Kouta Minamizawa, Kai Kunze, Jamie A. Ward

    IMWUT 2022journal

  4. Innermost echoes: Integrating real-time physiology into live music performances

    Danny Hynds, George Chernyshov, Dingding Zheng, Aoi Uyama, Juling Li, Kozue Matsumoto, Michael Pogorzhelskiy, Kai Kunze, Jamie A Ward, Kouta Minamizawa

    TEI 2024conference

  5. Embodied Responses to Posthuman Performance: A Mixed-Methods Study of Physiological and Emotional Audience Reactions

    Kai Kunze, Mingyang Xu, Danyang Peng, Lucas Ogasawara de Oliveira, Rose Shao, Xiaru Meng, Matthias Hoppe, Giulia Barbareschi

    AHs 2026conference