Abstract

With the project Endogeny the students created an interactive music experience in a virtual reality environment, which serves as a case study for the next stage in the development of the media concept of the music video, exploiting the full potential of the digital medium. In such a VR application, the audience finds itself in the midst of the audiovisual scenery where it can interact with the three-dimensional space to create music.

The immersive digital medium offers technical and creative possibilities that go far beyond conventional music videos and have not yet been exploited in conventional productions. The Endogeny project comprehensively explores these possibilities. The focus is therefore not only on examining the three-dimensional virtual world as a playground and the possibilities for multimodal interaction between the audience and the media content, but also, in particular, on examining the three-dimensional auditory scene as a performance space for music.

An essential question regarding the aesthetics of such a format is the visualization of music, the choice of visual expression. On an artistic level, the fields of visual arts, sound art/music/sound design, and gaming are very closely related in the context of VR. For visual and sound-based art, VR/AR is a new and often still undiscovered territory. Not only does it enable new visual and auditory presentation possibilities in virtual 3D space, but the interactivity that is also inherent here (e.g., by rotating the virtual camera using one's own head) can also be used artistically. This is where the interface with game design lies, which requires interactive use of virtual (3D) space and uses it creatively.

The cooperation between HAW and HfMT enables and strengthens collaboration between students from different disciplines and areas of expertise, particularly in the fields of audio spatialization, synesthesia, game design, immersion, haptics, and music.