Publicação

Super-resolution face recognition: an approach using generative adversarial networks and joint-learn

Ver documento

Detalhes bibliográficos
Resumo:Face Recognition is a challenging task present in different applications and systems. An existing challenge is to recognize faces when imaging conditions are adverse, for example when images come from low-quality cameras or when the subject and the camera are far apart, thus impacting the accuracy of these recognizing systems. Super-Resolution techniques can be used to improve both image resolution and quality, hopefully improving the accuracy of the face recognition task. Among these techniques, the actual state-of-the-art uses Generative Adversarial Networks. One promising option is to train Super-Resolution and Face Recognition as one single network, conducting the network to learn super resolution features that will improve its capability when recognizing faces. In the present work, we trained a super resolution face recognition model using a jointly-learn approach, combining a generative network for super resolution and a ResNet50 for Face Recognition. The model was trained with a discriminator network, following the generative adversarial training. The images generated by the network were convincing, but we could not converge the face recognition model. We hope that our contributions could help future works on this topic. Code is publicly available at https://github.com/OliRafa/SRFR-GAN.
Autores principais:Oliveira, Rafael Augusto de
Outros Autores:Scheeren, Michel Hanzen; Rodrigues, Pedro João; Junior, Arnaldo Candido; Paula Filho, Pedro Luiz
Assunto:Deep learning Super resolution
Ano:2022
País:Portugal
Tipo de documento:comunicação em conferência
Tipo de acesso:acesso restrito
Instituição associada:Instituto Politécnico de Bragança
Idioma:inglês
Origem:Biblioteca Digital do IPB
Descrição
Resumo:Face Recognition is a challenging task present in different applications and systems. An existing challenge is to recognize faces when imaging conditions are adverse, for example when images come from low-quality cameras or when the subject and the camera are far apart, thus impacting the accuracy of these recognizing systems. Super-Resolution techniques can be used to improve both image resolution and quality, hopefully improving the accuracy of the face recognition task. Among these techniques, the actual state-of-the-art uses Generative Adversarial Networks. One promising option is to train Super-Resolution and Face Recognition as one single network, conducting the network to learn super resolution features that will improve its capability when recognizing faces. In the present work, we trained a super resolution face recognition model using a jointly-learn approach, combining a generative network for super resolution and a ResNet50 for Face Recognition. The model was trained with a discriminator network, following the generative adversarial training. The images generated by the network were convincing, but we could not converge the face recognition model. We hope that our contributions could help future works on this topic. Code is publicly available at https://github.com/OliRafa/SRFR-GAN.