Publicação

When the Elephant Trumps": A Comparative Study on Spatial Audio for Orientation in 360◦ Videos

Ver documento

Detalhes bibliográficos
Resumo:Orientation is an emerging issue in cinematic Virtual Reality (VR), as viewers may fail in locating points of interest. Recent strategies to tackle this research problem have investigated the role of cues, specifically diegetic sound effects. In this paper, we examine the use of sound spatialization for orien tation purposes, namely by studying different spatialization conditions ("none", "partial", and "full" spatial manipulation) of multitrack soundtracks. We performed a between-subject mixed-methods study with 36 participants, aided by Cue Control, a tool we developed for dynamic spatial sound edit ing and data collection/analysis. Based on existing literature on orientation cues in 360◦ and theories on human listening, we discuss situations in which the spatialization was more ef fective (namely, "full" spatial manipulation both when using only music and when combining music and diegetic effects), and how this can be used by creators of 360◦ videos.
Autores principais:Bala, Paulo
Outros Autores:Masu, Raul; Nisi, Valentina; Nunes, Nuno
Assunto:360◦ video Spatial audio Cinematic virtual reality Orientation Virtual audio space . Faculdade de Ciências Exatas e da Engenharia
Ano:2019
País:Portugal
Tipo de documento:documento de conferência
Tipo de acesso:acesso aberto
Instituição associada:Universidade da Madeira
Idioma:inglês
Origem:DigitUMa - Repositório da Universidade da Madeira
Descrição
Resumo:Orientation is an emerging issue in cinematic Virtual Reality (VR), as viewers may fail in locating points of interest. Recent strategies to tackle this research problem have investigated the role of cues, specifically diegetic sound effects. In this paper, we examine the use of sound spatialization for orien tation purposes, namely by studying different spatialization conditions ("none", "partial", and "full" spatial manipulation) of multitrack soundtracks. We performed a between-subject mixed-methods study with 36 participants, aided by Cue Control, a tool we developed for dynamic spatial sound edit ing and data collection/analysis. Based on existing literature on orientation cues in 360◦ and theories on human listening, we discuss situations in which the spatialization was more ef fective (namely, "full" spatial manipulation both when using only music and when combining music and diegetic effects), and how this can be used by creators of 360◦ videos.

Atividades financiadas

Carregando projetos financiados...