IConCMT (2024) Sankt Pölten, AS
Stellar Corpus: From live motion capture to immersive data visualisation in a CAVE2 uniting altered gravity-movement relationships.
6th International Conference on Creative\Media/Technologies
Sarah Jane Pell
Abstract
In the evolving landscape of performance art, the nexus between the performer and their biodata is being redefined by HCI. In this context, this paper presents an interactive work of art that explores the somatic relationship between gravity and movement by combining dance, philosophy, extreme performance, and immersive visualization. Stellar Corpus combines a motion capture suit to capture human movement in extreme environments, human pose estimation models to automatically analyse this data, and an immersive 330° ultra-scale visualisation system that projects the signature altered-gravity performance behaviors in 2D and 3D. The discussion consists of three parts. Firstly, to share the creative development and UX staging to deliver a preview showing new potentials for the CAVE2 (Cave audio visual experience). Secondly, the hack to technically reconfigure the CAVE2 (Cave Automatic Virtual Environment) as a live instrument for the cosmic installation. This enables multiple spectators to engage simultaneously with ‘seven muses’ in the round: celestial entities formed as clusters of light particles and gestures extracted from extreme performances for a transcendent experience. Thirdly, to introduce the possibility of an invisible CAVE (Corporeal Affective Visualization Ethics) probing ethics in PhysioHCI, the choreographed bio-signals' integrity, and the potential as a dramaturgical tool. What are the implications of submitting embodied knowledges and somatic data, for the pleasure of a live experience, and digital legacy? How does replicability serve to manipulate a narrative to reflect the current Zeitgeist, and through physio rituals, or HCI methodologies, affect truth-telling, where the aim is to imbue a magic and awe, to move another, in mind, body, and spirit?
Sarah Jane Pell 2024. Stellar Corpus: From live motion capture to immersive data visualisation in a CAVE2 uniting altered gravity-movement relationships. User Experience in Arts and Culture, The 6th International Conference on Creative\Media/Technologies, University of Applied Sciences, Nov 27 - 28 2024. St Pölten, AS.
The 6th International Conference on Creative/Media Technologies encourages interdisciplinary dialogue and collaboration among diverse disciplines within the broad spectrum of digital media. Focal points include participatory culture, cultural heritage, open data, and hybrid public spaces. This includes research and artistic interventions that explore the processes of digitalisation and hybridisation of culture, the technological and ethical issues, as well as regulatory practices. Another focal point is the intersection of visualisation, artificial intelligence (AI), state-of-the-art media production, and storytelling. Climate change communication patterns will also receive special attention during the conference. Finally, immersive education paradigms will be explored, recognising the transformative power of immersive technologies in revolutionising education. This interdisciplinary approach seeks to unravel the possibilities and implications arising from the integration of these fields, to inspire new soloutions, and create an environment to interact, share insights, and create novel synergies.