Publicação
Action recognition of point-light displays presented with semantically (in)congruent auditory stimuli: behavioral correlates
| Resumo: | Humans are experts in identifying and understanding others' movements and visual information is often enough to successfully accomplish such tasks. Action-related sounds are also fastly associated and recognized. Still, many studies have demonstrated that the concurrent presentation of these two modalities benefits perception. Herein, we evaluated if congruent/ incongruent action sounds improve/impair recognition of Point-Light Displays (PLD) depicting human actions and if non-human moving PLDs accompanied by action sounds would bias participants into a false perception of human action, as a control, we also presented human and scrambled PLDs accompanied by white noise sound. After each video, participants should answer if it depicted a human figure and as a follow up for affirmative answers they should also name what action the human was performing. Results showed a significantly higher human identification for audiovisual biological congruent when compared to the visual biological paired to auditory noise and to unimodal visual stimuli. Similarly, performance on action recognition was better for the audiovisual biological congruent condition when compared to the unimodal visual stimuli. Lastly, considering the scramble stimuli we found a significant bias towards the identification of a human figure for the visual stimuli paired to auditory noise when compared to the unimodal visual scramble condition. Our findings suggest that adding coincident sounds to a human action visual display impacts human figure identification and action perception in biological PLDs and further, that insignificant sounds might lead to confound perception of non-biological PLDs. |
|---|---|
| Autores principais: | Senra, Catarina Carvalho |
| Outros Autores: | Sampaio, Adriana; Lapenta, Olivia Morgan |
| Assunto: | Action recognition Multisensory integration Semantic congruence Point-light displays |
| Ano: | 2022 |
| País: | Portugal |
| Tipo de documento: | outro |
| Tipo de acesso: | acesso aberto |
| Instituição associada: | Universidade do Minho |
| Idioma: | inglês |
| Origem: | RepositóriUM - Universidade do Minho |
Registos relacionados
school Action recognition of point-light displays presented with semantically (in)congruent auditory stimuli: behavioral correlates
por: Senra, Catarina Carvalho
Publicado em: (2021)
por: Senra, Catarina Carvalho
Publicado em: (2021)
school Sensory marketing: the role of sensory stimuli in consumer behaviour in retail environment
por: Viegas, Carina Cristina Santos
Publicado em: (2022)
por: Viegas, Carina Cristina Santos
Publicado em: (2022)
school A model of experiential shopping for the automotive industry: Integrating the concepts of point of sale and multisensory marketing
por: Knaul, Philip
Publicado em: (2013)
por: Knaul, Philip
Publicado em: (2013)
article Reading point-light walkers and amorphous—A TMS study
por: Lapenta, Olivia Morgan
Publicado em: (2022)
por: Lapenta, Olivia Morgan
Publicado em: (2022)
school Where did I leave my glasses? : the relationship between semantic and episodic memory in healthy aging
por: Almeida, Ana Luísa Nogueira Barros
Publicado em: (2020)
por: Almeida, Ana Luísa Nogueira Barros
Publicado em: (2020)
article Visual noise mask for human point-light displays: A coding-free approach
por: Senra, Catarina Carvalho
Publicado em: (2025)
por: Senra, Catarina Carvalho
Publicado em: (2025)
article The effect of simultaneously presented words and auditory tones on visuomotor performance
por: Mendonça, R.
Publicado em: (2021)
por: Mendonça, R.
Publicado em: (2021)
article Situatedness for global display web apps
por: Taivan, Constantin
Publicado em: (2013)
por: Taivan, Constantin
Publicado em: (2013)
article The effect of multisensory stimuli on path selection in virtual reality environments
por: Gonçalves, Guilherme
Publicado em: (2019)
por: Gonçalves, Guilherme
Publicado em: (2019)
school O impacto do marketing sensorial na experiência de "test drive"
por: Vaz, Daniela Cruz
Publicado em: (2018)
por: Vaz, Daniela Cruz
Publicado em: (2018)
article Mobile applications for open display networks : common design considerations
por: José, Rui
Publicado em: (2013)
por: José, Rui
Publicado em: (2013)
article Open display networks: a communications medium for the 21st century
por: Davies, Nigel
Publicado em: (2012)
por: Davies, Nigel
Publicado em: (2012)
book Opportunities and challenges of interactive public displays as an advertising medium
por: José, Rui
Publicado em: (2011)
por: José, Rui
Publicado em: (2011)
article Beyond application-led research in pervasive display systems
por: José, Rui
Publicado em: (2006)
por: José, Rui
Publicado em: (2006)
article Dimensions of situatedness for digital public displays
por: José, Rui
Publicado em: (2014)
por: José, Rui
Publicado em: (2014)
article Beyond interaction : tools and practices for situated publication in display networks
por: José, Rui
Publicado em: (2012)
por: José, Rui
Publicado em: (2012)
article Electrophysiological correlates of semantic processing in Williams syndrome
por: Pinheiro, Ana P.
Publicado em: (2010)
por: Pinheiro, Ana P.
Publicado em: (2010)
article Proactive scheduling for situated displays
por: Ribeiro, Fernando Reinaldo
Publicado em: (2007)
por: Ribeiro, Fernando Reinaldo
Publicado em: (2007)
article Display-centred applications in ubiquitous computing
por: José, Rui
Publicado em: (2006)
por: José, Rui
Publicado em: (2006)
article Understanding media situatedness and publication practices in place-based digital displays
por: Coutinho, Pedro
Publicado em: (2016)
por: Coutinho, Pedro
Publicado em: (2016)
category Scalability of pervasive displays networks
por: Ferreira, Luís A. A.
Publicado em: (2012)
por: Ferreira, Luís A. A.
Publicado em: (2012)
article Reasoning about time in dynamic information displays
por: Campos, J. Creissac
Publicado em: (2001)
por: Campos, J. Creissac
Publicado em: (2001)
article Application diversity in open display networks
por: Taivan, Constantin
Publicado em: (2014)
por: Taivan, Constantin
Publicado em: (2014)
article A comprehensive taxonomy for three-dimensional displays
por: Pimenta, Waldir
Publicado em: (2012)
por: Pimenta, Waldir
Publicado em: (2012)
article Key challenges in application and content scheduling for Open Pervasive Display Networks
por: Elhart, Ivan
Publicado em: (2013)
por: Elhart, Ivan
Publicado em: (2013)
article Multi-purpose place-based display systems: implications from current practices in place-based communication
por: Coutinho, Pedro
Publicado em: (2017)
por: Coutinho, Pedro
Publicado em: (2017)
article Review of trends in automatic human activity recognition in vehicle based in synthetic data
por: Coimbra, Ana Cecília Sousa Rocha
Publicado em: (2020)
por: Coimbra, Ana Cecília Sousa Rocha
Publicado em: (2020)
article Design considerations for application selection and control in multi-user public displays
por: Taivan, Constantin
Publicado em: (2013)
por: Taivan, Constantin
Publicado em: (2013)
article Design considerations for application selection and control in multi-user public displays
por: Taivan, Constantin
Publicado em: (2013)
por: Taivan, Constantin
Publicado em: (2013)
article User expectations for media sharing practices in open display networks
por: José, Rui
Publicado em: (2015)
por: José, Rui
Publicado em: (2015)
article Review of trends in automatic human activity recognition using synthetic audio-visual data
por: Jesus, Tiago Rafael Andrade
Publicado em: (2020)
por: Jesus, Tiago Rafael Andrade
Publicado em: (2020)
article Development challenges in web apps for public displays
por: Taivan, Constantin
Publicado em: (2013)
por: Taivan, Constantin
Publicado em: (2013)
article MOOCs to Semantic Web Education
por: Gonçalves, Vitor
Publicado em: (2019)
por: Gonçalves, Vitor
Publicado em: (2019)
groups MOOCs to Semantic Web Education
por: Gonçalves, Vitor
Publicado em: (2019)
por: Gonçalves, Vitor
Publicado em: (2019)
book Interaction Abstractions for Public Display Applications
por: Cardoso, Jorge C. S.
Publicado em: (2015)
por: Cardoso, Jorge C. S.
Publicado em: (2015)
groups A runtime lifecycle for interactive public display applications
por: Perpétua, Alice
Publicado em: (2014)
por: Perpétua, Alice
Publicado em: (2014)
category Development of visual noise mask for human point-light displays
por: Senra, Catarina Carvalho
Publicado em: (2022)
por: Senra, Catarina Carvalho
Publicado em: (2022)
school Os principais objetivos da publicidade display online e as métricas adequadas na sua avaliação
por: Lameira, Margarida Alexandra Matos
Publicado em: (2017)
por: Lameira, Margarida Alexandra Matos
Publicado em: (2017)
article IoT Semantic Interoperability: A Systematic Mapping Study
por: Venceslau, Amanda
Publicado em: (2019)
por: Venceslau, Amanda
Publicado em: (2019)
article Media sharing in an open network of place-based displays
por: José, Rui
Publicado em: (2016)
por: José, Rui
Publicado em: (2016)
Registos relacionados
-
school Action recognition of point-light displays presented with semantically (in)congruent auditory stimuli: behavioral correlates
por: Senra, Catarina Carvalho
Publicado em: (2021) -
school Sensory marketing: the role of sensory stimuli in consumer behaviour in retail environment
por: Viegas, Carina Cristina Santos
Publicado em: (2022) -
school A model of experiential shopping for the automotive industry: Integrating the concepts of point of sale and multisensory marketing
por: Knaul, Philip
Publicado em: (2013) -
article Reading point-light walkers and amorphous—A TMS study
por: Lapenta, Olivia Morgan
Publicado em: (2022) -
school Where did I leave my glasses? : the relationship between semantic and episodic memory in healthy aging
por: Almeida, Ana Luísa Nogueira Barros
Publicado em: (2020)