Publicação
Enhancing big data warehousing for efficient, integrated and advanced analytics visionary paper
| Resumo: | The existing capacity to collect, store, process and analyze huge amounts of data that is rapidly generated, i.e., Big Data, is characterized by fast technological developments and by a limited set of conceptual advances that guide researchers and practitioners in the implementation of Big Data systems. New data stores or processing tools frequently appear, proposing new (and usually more efficient) ways to store and query data (like SQL-on-Hadoop). Although very relevant, the lack of common methodological guidelines or practices has motivated the implementation of Big Data systems based on use-case driven approaches. This is also the case for one of the most valuable organizational data assets, the Data Warehouse, which needs to be rethought in the way it is designed, modeled, implemented, managed and monitored. This paper addresses some of the research challenges in Big Data Warehousing systems, proposing a vision that looks into: (i) the integration of new business processes and data sources; (ii) the proper way to achieve this integration; (iii) the management of these complex data systems and the enhancement of their performance; (iv) the automation of some of their analytical capabilities with Complex Event Processing and Machine Learning; and, (v) the flexible and highly customizable visualization of their data, providing an advanced decision-making support environment. |
|---|---|
| Autores principais: | Santos, Maribel Yasmina |
| Outros Autores: | Costa, Carlos A. P.; Galvão, João Rui Magalhães Velho da Cunha; Andrade, Carina; Pastor, Oscar; Cristina Marcen, Ana |
| Assunto: | Big data warehouse Data governance Data profiling Event processing Performance |
| Ano: | 2019 |
| País: | Portugal |
| Tipo de documento: | comunicação em conferência |
| Tipo de acesso: | acesso restrito |
| Instituição associada: | Universidade do Minho |
| Idioma: | inglês |
| Origem: | RepositóriUM - Universidade do Minho |
Registos relacionados
article Data warehousing in big data: from multidimensional to tabular data models
por: Santos, Maribel Yasmina
Publicado em: (2016)
por: Santos, Maribel Yasmina
Publicado em: (2016)
article Evaluating partitioning and bucketing strategies for Hive-based Big Data Warehousing systems
por: Costa, Eduarda
Publicado em: (2019)
por: Costa, Eduarda
Publicado em: (2019)
article Data requirements elicitation in big data warehousing
por: Vieira, António Amaro Costa
Publicado em: (2019)
por: Vieira, António Amaro Costa
Publicado em: (2019)
article Big Data Analytics for vehicle multisensory anomalies detection
por: Fernandes, Ana Xavier Silva Gomes
Publicado em: (2022)
por: Fernandes, Ana Xavier Silva Gomes
Publicado em: (2022)
school Advancing the design and implementation of Big Data Warehousing Systems
por: Costa, Carlos Filipe Machado Silva
Publicado em: (2019)
por: Costa, Carlos Filipe Machado Silva
Publicado em: (2019)
article Evaluating SQL-on-Hadoop for Big Data warehousing on not-so-good hardware
por: Santos, Maribel Yasmina
Publicado em: (2017)
por: Santos, Maribel Yasmina
Publicado em: (2017)
article Modelling and implementing big data warehouses for decision support
por: Santos, Maribel Yasmina
Publicado em: (2017)
por: Santos, Maribel Yasmina
Publicado em: (2017)
article A big data analytics architecture for industry 4.0
por: Santos, Maribel Yasmina
Publicado em: (2017)
por: Santos, Maribel Yasmina
Publicado em: (2017)
article Evaluating several design patterns and trends in big data warehousing systems
por: Costa, Carlos A.
Publicado em: (2018)
por: Costa, Carlos A.
Publicado em: (2018)
article The SusCity big data warehousing approach for smart cities
por: Costa, Carlos
Publicado em: (2017)
por: Costa, Carlos
Publicado em: (2017)
school Abordagem semântica para a integração de dados em Big Data Warehouses
por: Magalhães, José Fernando Pereira
Publicado em: (2019)
por: Magalhães, José Fernando Pereira
Publicado em: (2019)
article An architecture for data warehousing in big data environments
por: Bruno Martinho
Publicado em: (2016)
por: Bruno Martinho
Publicado em: (2016)
article Partitioning and bucketing in hive-based big data warehouses
por: Costa, Eduarda
Publicado em: (2018)
por: Costa, Eduarda
Publicado em: (2018)
school Big Data Warehousing em tempo real: da recolha ao processamento de dados
por: Lima, Francisca Leitão Gonçalves do Vale
Publicado em: (2017)
por: Lima, Francisca Leitão Gonçalves do Vale
Publicado em: (2017)
school Data warehousing em contexto big data: dos conceitos à implementação
por: Martinho, Bruno Augusto Ferreira
Publicado em: (2016)
por: Martinho, Bruno Augusto Ferreira
Publicado em: (2016)
article A Big Data system supporting Bosch Braga Industry 4.0 strategy
por: Santos, Maribel Yasmina
Publicado em: (2017)
por: Santos, Maribel Yasmina
Publicado em: (2017)
school Modelação ágil para sistemas de Big Data Warehousing
por: Nogueira, Marta Susete Carvalho Batista
Publicado em: (2019)
por: Nogueira, Marta Susete Carvalho Batista
Publicado em: (2019)
article Modelação evolutiva de big data warehouses em automação industrial para o desenvolvimento sustentável de produto
por: Oliveira, Mafalda
Publicado em: (2022)
por: Oliveira, Mafalda
Publicado em: (2022)
article Experimental evaluation of big data analytical tools
por: Rodrigues, Mário
Publicado em: (2019)
por: Rodrigues, Mário
Publicado em: (2019)
article Fast online analytical processing for Big Data warehousing
por: Correia, José
Publicado em: (2018)
por: Correia, José
Publicado em: (2018)
school Cloud data warehousing solution in the banking sector
por: Silvestre, João Diogo Miguel
Publicado em: (2023)
por: Silvestre, João Diogo Miguel
Publicado em: (2023)
article Challenging SQL-on-Hadoop performance with Apache Druid
por: Correia, José
Publicado em: (2019)
por: Correia, José
Publicado em: (2019)
school Clinical big data
por: Dias, Cristiana Filipa Rodrigues
Publicado em: (2020)
por: Dias, Cristiana Filipa Rodrigues
Publicado em: (2020)
school Data Warehousing - (a informação ao serviço da empresa).
por: Viana, Joaquim Mesquita da Cunha
Publicado em: (1997)
por: Viana, Joaquim Mesquita da Cunha
Publicado em: (1997)
article Big data analytics and firm performance in the hotel sector
por: Carneiro, Tiago
Publicado em: (2023)
por: Carneiro, Tiago
Publicado em: (2023)
article Building data warehouses in the era of big data: an approach for scalable and flexible big data warehouses
por: Costa, Carlos Filipe Machado Silva
Publicado em: (2019)
por: Costa, Carlos Filipe Machado Silva
Publicado em: (2019)
article Big data warehouse framework for smart revenue management
por: Ramos, Célia M. Q.
Publicado em: (2015)
por: Ramos, Célia M. Q.
Publicado em: (2015)
school Processamento analítico de dados em contextos de Big Data com o Druid
por: Correia, José Manuel da Silva
Publicado em: (2018)
por: Correia, José Manuel da Silva
Publicado em: (2018)
article A multi-dimensional model for the design and development of analytical information systems
por: Santos, Maribel Yasmina
Publicado em: (2024)
por: Santos, Maribel Yasmina
Publicado em: (2024)
article Big data: business, technology, education, and science
por: Johnson, Jeffrey
Publicado em: (2018)
por: Johnson, Jeffrey
Publicado em: (2018)
school Big Data analytics e performance organizacional : o papel mediador da inovação ambidestra e o efeito moderador do ambiente
por: Abreu, Sérgio Gil Pires
Publicado em: (2021)
por: Abreu, Sérgio Gil Pires
Publicado em: (2021)
article Data models in NoSQL databases for big data contexts
por: Santos, Maribel Yasmina
Publicado em: (2016)
por: Santos, Maribel Yasmina
Publicado em: (2016)
article Conceptual formalization of massive storage for advancing decision-making with data analytics
por: Sousa, Vânia
Publicado em: (2023)
por: Sousa, Vânia
Publicado em: (2023)
article Can we use big data analytics to leverage tourism in rural tourism destinations?
por: Cunha, Carlos R.
Publicado em: (2018)
por: Cunha, Carlos R.
Publicado em: (2018)
school Big data analytics : an implementation framework for the portuguese financial sector
por: Guimarães, Francisco Macedo Grijó Nieto
Publicado em: (2025)
por: Guimarães, Francisco Macedo Grijó Nieto
Publicado em: (2025)
article Researching Culture through Big Data: Computational Engineering and the Human and Social Sciences
por: Martinho, Teresa Duarte
Publicado em: (2018)
por: Martinho, Teresa Duarte
Publicado em: (2018)
groups Runtime object lifetime profiler for latency sensitive big data applications
por: Rodrigo, Bruno
Publicado em: (2019)
por: Rodrigo, Bruno
Publicado em: (2019)
article Big data processing tools: An experimental performance evaluation
por: Rodrigues, Mário
Publicado em: (2019)
por: Rodrigues, Mário
Publicado em: (2019)
article Model for the identification of students at risk of dropout using big data analytics
por: Franco, Tiago
Publicado em: (2019)
por: Franco, Tiago
Publicado em: (2019)
article An immersive web visualization platform for a big data context in bosch’s industry 4.0 movement
por: Rebelo, João
Publicado em: (2020)
por: Rebelo, João
Publicado em: (2020)
Registos relacionados
-
article Data warehousing in big data: from multidimensional to tabular data models
por: Santos, Maribel Yasmina
Publicado em: (2016) -
article Evaluating partitioning and bucketing strategies for Hive-based Big Data Warehousing systems
por: Costa, Eduarda
Publicado em: (2019) -
article Data requirements elicitation in big data warehousing
por: Vieira, António Amaro Costa
Publicado em: (2019) -
article Big Data Analytics for vehicle multisensory anomalies detection
por: Fernandes, Ana Xavier Silva Gomes
Publicado em: (2022) -
school Advancing the design and implementation of Big Data Warehousing Systems
por: Costa, Carlos Filipe Machado Silva
Publicado em: (2019)