Authors

Yevgeniya Sulema

Abstract

This course explores the integration of multiple sensory modalities into digital media systems to create immersive and interactive experiences. The course begins with an introduction to mulsemedia, outlining the concept of engaging multiple senses – sight, sound, touch, smell, and taste – in multimedia environments. Students will gain an in-depth understanding of mulsemedia hardware and techniques, including 3D visualization through 3D displays and 3D printing, and 3D image capturing techniques. The auditory aspects of mulsemedia are covered through surround sound recording and reproduction systems. The course presents ways of employing haptics that introduce the sense of touch into human-computer interaction. The course also delves into olfaction-based hardware for smell detection and smell reproduction, and gustatory technologies like taste detection, analysis, and taste simulation as well as food 3D printing. The course briefly covers mulsemedia standard MPEG-V and software that enable the integration of multisensory content in interactive systems. Finally, students will explore mulsemedia applications, ranging from entertainment, virtual reality, and gaming, to healthcare, education, and marketing. This course provides a comprehensive foundation in the design, development, and application of multisensory media technologies, preparing students to create immersive experiences that engage all human senses.

license

Creative Commons BY-SA 4.0