GEISTHuman-Centered Information Systems · TU Clausthal, home

ArchiveKeio · GEIST

Boiling Mind

Linking audience physiology and choreography: dancers react to the heart and skin signals of 98 spectators across three performances.

Archived project. Current work is listed under Research.

Dancers on stage during the Boiling Mind performance
TeaserGEIST / Embodied Media

The role of the audience in stage performances is changing from passive spectators to contributors making the performance interactive by using different techniques. We investigate the connection of audience physiological data to the experienced performance in three performance events with a total of 98 participants. We identified memorable performance moments by assessing Electrodermal Activity (EDA) showing that the audience’s responses match the choreographer’s intention. Through Heart Rate Variability (HRV) features related to parasympathetic activity, we identified dramatic shifts that are connected to the choreographic development of the performance.

Each performance lives from the interplay between audience and artists. Even if performers follow a precise script, each rendition is different partly due to audience reactions. Performers often describe it as an invisible link between them and the spectators, involving the audience in co-creating art. The stage design and described setup came out of a collaboration between the performing artists, designers and researchers in a semi-democratic process.

Both researchers and artists contributed to developing the concept during the iterative process to balance research and artistic interests. This process was mainly led by artists, especially the choreographer. Besides the predetermined story and design, the choreographer also created some improvisational sections where dancers could interact with stage elements affected by audience physiological response.

Contributors

  • Project lead, artistic direction, dancer: 須川 萌 (Moe Sugawa)
  • Screenplay, dancers: Mademoiselle Cinema (竹之下たまみ, 蓮子奈津美, 古茂田梨乃, 中島詩織, 須川萌, 佐治静, 中込美加恵)
  • Stage direction: Session House (舞台演出・振付 伊藤直子, 舞台監督 鍋島俊介, 照明 石関美穂, 音響 宇野愛生)
  • Technical direction: 古川泰地
  • Wearable sensing: George Chernyshov, Karen Han, Lady Dingding Zheng, Kirill Ragozin, Jamie A. Ward
  • Sound design and composition: Danny Hynds
  • Interactive lighting system: Marcelo Padovani
  • Technical operation: 河﨑 勇斗
  • Stage design: Yurike Chandra
  • Videography: 有馬 俊
  • Technical supervision: Kai Kunze, 南澤 孝太 (Kouta Minamizawa)
  • Special thanks: ASADAMESH inc.

Era: GEIST lab, Graduate School of Media Design, Keio University (2015 to 2026).

Source: kaikunze.de (27 December 2020).

Publications

Papers from this project

All 275 publications
  1. Boiling Mind: Amplifying the Audience-Performer Connection through Sonification and Visualization of Heart and Electrodermal Activities

    Moe Sugawa, Taichi Furukawa, George Chernyshov, Danny Hynds, Jiawen Han, Marcelo Padovani, Dingding Zheng, Karola Marky, Kai Kunze, Kouta Minamizawa

    TEI 2021conference

  2. Boiling Mind-A Dataset of Physiological Signals during an Exploratory Dance Performance

    Zhuoqi Fu, Jiawen Han, Dingding Zheng, Moe Sugawa, Taichi Furukawa, Chernyshov George, Hynds Danny, Padovani Marcelo, Marky Karola, Kouta Minamizawa, Jamie A Ward, Kai Kunze

    AHs 2021conference