Enriching Portuguese Word Embeddings with Visual Information

• Author(s): Consoli, Bernardo ; Vieira, Renata
• Date: 2021
• Persistent ID: http://hdl.handle.net/10174/30390
• Origin: Repositório Científico da Universidade de Évora
• Subject(s): multimodality; word embeddings
• Document Type: Journal article
• Language: English

Description

This work focuses on the enrichment of existing Portuguese word embeddings with visual information in the form of visual embeddings. This information was extracted from images portraying given vocabulary terms and imagined visual embeddings learned for terms with no image data. These enriched embeddings were tested against their text-only counterparts in common NLP tasks. The results show an increase in performance for several tasks, which indicates that visual information fusion for word embeddings can be useful for word embedding based NLP tasks.

FCT CEECIND/01997/2017, UIDB/00057/2020