Publicação
Behavioural attentiveness patterns analysis – detecting distraction behaviours
| Resumo: | The capacity of remaining focused on a task can be crucial in some circumstances. In general, this ability is intrinsic in a human social interaction and it is naturally used in any social context. Nevertheless, some individuals have difficulties in remaining concentrated in an activity, resulting in a short attention span. Children with Autism Spectrum Disorder (ASD) are a special example of such individuals. ASD is a group of complex developmental disorders of the brain. Individuals affected by this disorder are characterized by repetitive patterns of behaviour, restricted activities or interests, and impairments in social communication. The use of robots has already proved to encourage the developing of social interaction skills lacking in children with ASD. However, most of these systems are controlled remotely and cannot adapt automatically to the situation, and even those who are more autonomous still cannot perceive whether or not the user is paying attention to the instructions and actions of the robot. Following this trend, this dissertation is part of a research project that has been under development for some years. In this project, the Robot ZECA (Zeno Engaging Children with Autism) from Hanson Robotics is used to promote the interaction with children with ASD helping them to recognize emotions, and to acquire new knowledge in order to promote social interaction and communication with the others. The main purpose of this dissertation is to know whether the user is distracted during an activity. In the future, the objective is to interface this system with ZECA to consequently adapt its behaviour taking into account the individual affective state during an emotion imitation activity. In order to recognize human distraction behaviours and capture the user attention, several patterns of distraction, as well as systems to automatically detect them, have been developed. One of the most used distraction patterns detection methods is based on the measurement of the head pose and eye gaze. The present dissertation proposes a system based on a Red Green Blue (RGB) camera, capable of detecting the distraction patterns, head pose, eye gaze, blinks frequency, and the user to position towards the camera, during an activity, and then classify the user's state using a machine learning algorithm. Finally, the proposed system is evaluated in a laboratorial and controlled environment in order to verify if it is capable to detect the patterns of distraction. The results of these preliminary tests allowed to detect some system constraints, as well as to validate its adequacy to later use it in an intervention setting. |
|---|---|
| Autores principais: | Amaro, Bruno Filipe Viana |
| Assunto: | Human-robot interaction Zeca robot Distraction patterns Emotional states Machine learning Interação humano-robô Robô zeca Padrões de distração Estado emocional Aprendizagem da máquina |
| Ano: | 2018 |
| País: | Portugal |
| Tipo de documento: | dissertação de mestrado |
| Tipo de acesso: | acesso aberto |
| Instituição associada: | Universidade do Minho |
| Idioma: | inglês |
| Origem: | RepositóriUM - Universidade do Minho |
| _version_ | 1866270461909794816 |
|---|---|
| author | Amaro, Bruno Filipe Viana |
| author_facet | Amaro, Bruno Filipe Viana |
| author_role | author |
| contributor_name_str_mv | Soares, Filomena Universidade do Minho |
| country_str | PT |
| creators_json_txt | [{\"Person.name\":\"Amaro, Bruno Filipe Viana\"}] |
| datacite.contributors.contributor.contributorName.fl_str_mv | Soares, Filomena Universidade do Minho |
| datacite.creators.creator.creatorName.fl_str_mv | Amaro, Bruno Filipe Viana |
| datacite.date.Accepted.fl_str_mv | 2018-10-22T00:00:00Z |
| datacite.date.available.fl_str_mv | 2020-07-16T06:00:18Z |
| datacite.date.embargoed.fl_str_mv | 2020-07-16T06:00:18Z |
| datacite.rights.fl_str_mv | http://purl.org/coar/access_right/c_abf2 |
| datacite.subjects.subject.fl_str_mv | Human-robot interaction Zeca robot Distraction patterns Emotional states Machine learning Interação humano-robô Robô zeca Padrões de distração Estado emocional Aprendizagem da máquina |
| datacite.titles.title.fl_str_mv | Behavioural attentiveness patterns analysis – detecting distraction behaviours |
| dc.contributor.none.fl_str_mv | Soares, Filomena Universidade do Minho |
| dc.creator.none.fl_str_mv | Amaro, Bruno Filipe Viana |
| dc.date.Accepted.fl_str_mv | 2018-10-22T00:00:00Z |
| dc.date.available.fl_str_mv | 2020-07-16T06:00:18Z |
| dc.date.embargoed.fl_str_mv | 2020-07-16T06:00:18Z |
| dc.format.none.fl_str_mv | application/pdf |
| dc.identifier.none.fl_str_mv | https://hdl.handle.net/1822/66009 |
| dc.language.none.fl_str_mv | eng |
| dc.rights.none.fl_str_mv | http://purl.org/coar/access_right/c_abf2 |
| dc.subject.none.fl_str_mv | Human-robot interaction Zeca robot Distraction patterns Emotional states Machine learning Interação humano-robô Robô zeca Padrões de distração Estado emocional Aprendizagem da máquina |
| dc.title.fl_str_mv | Behavioural attentiveness patterns analysis – detecting distraction behaviours |
| dc.type.none.fl_str_mv | http://purl.org/coar/resource_type/c_bdcc |
| description | The capacity of remaining focused on a task can be crucial in some circumstances. In general, this ability is intrinsic in a human social interaction and it is naturally used in any social context. Nevertheless, some individuals have difficulties in remaining concentrated in an activity, resulting in a short attention span. Children with Autism Spectrum Disorder (ASD) are a special example of such individuals. ASD is a group of complex developmental disorders of the brain. Individuals affected by this disorder are characterized by repetitive patterns of behaviour, restricted activities or interests, and impairments in social communication. The use of robots has already proved to encourage the developing of social interaction skills lacking in children with ASD. However, most of these systems are controlled remotely and cannot adapt automatically to the situation, and even those who are more autonomous still cannot perceive whether or not the user is paying attention to the instructions and actions of the robot. Following this trend, this dissertation is part of a research project that has been under development for some years. In this project, the Robot ZECA (Zeno Engaging Children with Autism) from Hanson Robotics is used to promote the interaction with children with ASD helping them to recognize emotions, and to acquire new knowledge in order to promote social interaction and communication with the others. The main purpose of this dissertation is to know whether the user is distracted during an activity. In the future, the objective is to interface this system with ZECA to consequently adapt its behaviour taking into account the individual affective state during an emotion imitation activity. In order to recognize human distraction behaviours and capture the user attention, several patterns of distraction, as well as systems to automatically detect them, have been developed. One of the most used distraction patterns detection methods is based on the measurement of the head pose and eye gaze. The present dissertation proposes a system based on a Red Green Blue (RGB) camera, capable of detecting the distraction patterns, head pose, eye gaze, blinks frequency, and the user to position towards the camera, during an activity, and then classify the user's state using a machine learning algorithm. Finally, the proposed system is evaluated in a laboratorial and controlled environment in order to verify if it is capable to detect the patterns of distraction. The results of these preliminary tests allowed to detect some system constraints, as well as to validate its adequacy to later use it in an intervention setting. |
| dirty | 0 |
| eu_rights_str_mv | openAccess |
| format | masterThesis |
| fulltext.url.fl_str_mv | https://prod-dspace.uminho.pt/bitstreams/10bcf6c4-2953-4158-b840-8773df7a0895/download |
| id | rum_108fd30a1938618a7d8ea4e2ec880dd2 |
| identifier.url.fl_str_mv | https://hdl.handle.net/1822/66009 |
| instacron_str | repositorium |
| institution | Universidade do Minho |
| instname_str | Universidade do Minho |
| language | eng |
| network_acronym_str | rum |
| network_name_str | RepositóriUM - Universidade do Minho |
| oai_identifier_str | oai:repositorium.uminho.pt:1822/66009 |
| organization_str_mv | urn:organizationAcronym:repositorium |
| person_str_mv | Amaro, Bruno Filipe Viana |
| publishDate | 2018 |
| reponame_str | RepositóriUM - Universidade do Minho |
| repository_id_str | urn:repositoryAcronym:rum |
| service_str_mv | urn:repositoryAcronym:rum |
| spelling | engporThe capacity of remaining focused on a task can be crucial in some circumstances. In general, this ability is intrinsic in a human social interaction and it is naturally used in any social context. Nevertheless, some individuals have difficulties in remaining concentrated in an activity, resulting in a short attention span. Children with Autism Spectrum Disorder (ASD) are a special example of such individuals. ASD is a group of complex developmental disorders of the brain. Individuals affected by this disorder are characterized by repetitive patterns of behaviour, restricted activities or interests, and impairments in social communication. The use of robots has already proved to encourage the developing of social interaction skills lacking in children with ASD. However, most of these systems are controlled remotely and cannot adapt automatically to the situation, and even those who are more autonomous still cannot perceive whether or not the user is paying attention to the instructions and actions of the robot. Following this trend, this dissertation is part of a research project that has been under development for some years. In this project, the Robot ZECA (Zeno Engaging Children with Autism) from Hanson Robotics is used to promote the interaction with children with ASD helping them to recognize emotions, and to acquire new knowledge in order to promote social interaction and communication with the others. The main purpose of this dissertation is to know whether the user is distracted during an activity. In the future, the objective is to interface this system with ZECA to consequently adapt its behaviour taking into account the individual affective state during an emotion imitation activity. In order to recognize human distraction behaviours and capture the user attention, several patterns of distraction, as well as systems to automatically detect them, have been developed. One of the most used distraction patterns detection methods is based on the measurement of the head pose and eye gaze. The present dissertation proposes a system based on a Red Green Blue (RGB) camera, capable of detecting the distraction patterns, head pose, eye gaze, blinks frequency, and the user to position towards the camera, during an activity, and then classify the user's state using a machine learning algorithm. Finally, the proposed system is evaluated in a laboratorial and controlled environment in order to verify if it is capable to detect the patterns of distraction. The results of these preliminary tests allowed to detect some system constraints, as well as to validate its adequacy to later use it in an intervention setting.application/pdfporBehavioural attentiveness patterns analysis – detecting distraction behavioursAmaro, Bruno Filipe VianaSoares, FilomenaHostingInstitutionOrganizationalUniversidade do Minhoe-mailmailto:repositorium@usdb.uminho.ptrepositorium@usdb.uminho.ptURNurn:tid:2022842552020-07-16T06:00:18Z2018-10-222018-102018-10-22T00:00:00ZHandlehttps://hdl.handle.net/1822/66009http://purl.org/coar/access_right/c_abf2open accessHuman-robot interactionZeca robotDistraction patternsEmotional statesMachine learningInteração humano-robôRobô zecaPadrões de distraçãoEstado emocionalAprendizagem da máquina7591775 bytesliteraturehttp://purl.org/coar/resource_type/c_bdccmaster thesishttp://purl.org/coar/access_right/c_abf2application/pdffulltexthttps://prod-dspace.uminho.pt/bitstreams/10bcf6c4-2953-4158-b840-8773df7a0895/download |
| spellingShingle | Behavioural attentiveness patterns analysis – detecting distraction behaviours Amaro, Bruno Filipe Viana Human-robot interaction Zeca robot Distraction patterns Emotional states Machine learning Interação humano-robô Robô zeca Padrões de distração Estado emocional Aprendizagem da máquina |
| status | SINGLETON |
| subject.fl_str_mv | Human-robot interaction Zeca robot Distraction patterns Emotional states Machine learning Interação humano-robô Robô zeca Padrões de distração Estado emocional Aprendizagem da máquina |
| title | Behavioural attentiveness patterns analysis – detecting distraction behaviours |
| title_full | Behavioural attentiveness patterns analysis – detecting distraction behaviours |
| title_fullStr | Behavioural attentiveness patterns analysis – detecting distraction behaviours |
| title_full_unstemmed | Behavioural attentiveness patterns analysis – detecting distraction behaviours |
| title_short | Behavioural attentiveness patterns analysis – detecting distraction behaviours |
| title_sort | Behavioural attentiveness patterns analysis – detecting distraction behaviours |
| topic | Human-robot interaction Zeca robot Distraction patterns Emotional states Machine learning Interação humano-robô Robô zeca Padrões de distração Estado emocional Aprendizagem da máquina |
| topic_facet | Human-robot interaction Zeca robot Distraction patterns Emotional states Machine learning Interação humano-robô Robô zeca Padrões de distração Estado emocional Aprendizagem da máquina |
| url | https://hdl.handle.net/1822/66009 |
| visible | 1 |