Publicação
ETL patterns on YAWL: towards to the specification of platform-independent data warehousing populating processes
| Resumo: | The implementation of data warehouse populating processes (ETL) is considered a complex task, not only in terms of the amount of data processed but also in the complexity of the tasks involved. The implementation and maintenance of such processes faces various design drawbacks, such as the change of business requirements, which consequently leads to adapting existing data structures and reusing existing parts of ETL system. We consider that a more abstract view of the ETL processes and its data structures is need as well as a more effective mapping to real execution primitives, providing its validation before conducting an ETL solution to its final implementation. With this work we propose the use of standard solutions, which already has proven very useful in software developing, for the implementation of standard ETL processes. In this paper we approach ETL modelling in a new perspective, using YAWL, a Workflow language, as the mean to get ETL models platform-independent. |
|---|---|
| Autores principais: | Oliveira, Bruno |
| Outros Autores: | Belo, O. |
| Assunto: | Data Warehousing Systems ETL Modelling ETL Validation and Testing ETL Patterns YAWL And YAWL Data warehousing |
| Ano: | 2014 |
| País: | Portugal |
| Tipo de documento: | comunicação em conferência |
| Tipo de acesso: | acesso restrito |
| Instituição associada: | Universidade do Minho |
| Idioma: | inglês |
| Origem: | RepositóriUM - Universidade do Minho |
Registos relacionados
article Modeling an opportunistic ETL agent based system using YAWL
por: Gomes, Nuno André Barbosa
Publicado em: (2016)
por: Gomes, Nuno André Barbosa
Publicado em: (2016)
article A pattern-oriented approach for supporting ETL conceptual modelling and its YAWL-based implementation
por: Oliveira, Bruno
Publicado em: (2014)
por: Oliveira, Bruno
Publicado em: (2014)
article Modeling agents working on ETL processes
por: Gomes, Nuno André Barbosa
Publicado em: (2016)
por: Gomes, Nuno André Barbosa
Publicado em: (2016)
school Transformação de especificações ETL em YAWL para processos Kettle
por: Freitas, Janine Marlene Duarte Silva
Publicado em: (2019)
por: Freitas, Janine Marlene Duarte Silva
Publicado em: (2019)
article Modeling and supporting ETL processes via a pattern-oriented, task-reusable framework
por: Belo, Orlando
Publicado em: (2014)
por: Belo, Orlando
Publicado em: (2014)
article ETL logs under a pattern-oriented approach
por: Oliveira, Bruno
Publicado em: (2021)
por: Oliveira, Bruno
Publicado em: (2021)
article A domain-specific language for ETL patterns specification in Data Warehousing Systems
por: Oliveira, Bruno
Publicado em: (2015)
por: Oliveira, Bruno
Publicado em: (2015)
article ETL development using patterns: A service-oriented approach
por: Oliveira, Bruno
Publicado em: (2019)
por: Oliveira, Bruno
Publicado em: (2019)
article Pattern-based ETL conceptual modelling
por: Oliveira, Bruno
Publicado em: (2013)
por: Oliveira, Bruno
Publicado em: (2013)
article Approaching ETL processes specification using a pattern-based ontology
por: Oliveira, Bruno
Publicado em: (2017)
por: Oliveira, Bruno
Publicado em: (2017)
article An ontology for describing ETL patterns behavior
por: Oliveira, Bruno
Publicado em: (2016)
por: Oliveira, Bruno
Publicado em: (2016)
article An ETL pattern for log configuration and analysis
por: Oliveira, Bruno
Publicado em: (2019)
por: Oliveira, Bruno
Publicado em: (2019)
article Approaching ETL conceptual modelling and validation using BPMN and BPEL
por: Oliveira, Bruno
Publicado em: (2013)
por: Oliveira, Bruno
Publicado em: (2013)
article Towards a low cost ETL system
por: Santos, Vasco
Publicado em: (2014)
por: Santos, Vasco
Publicado em: (2014)
article BPMN patterns for ETL conceptual modelling and validation
por: Oliveira, Bruno
Publicado em: (2012)
por: Oliveira, Bruno
Publicado em: (2012)
article Using reo on ETL conceptual modelling: a first approach
por: Oliveira, Bruno
Publicado em: (2013)
por: Oliveira, Bruno
Publicado em: (2013)
article Task clustering on ETL systems – A pattern-oriented approach
por: Oliveira, Bruno
Publicado em: (2015)
por: Oliveira, Bruno
Publicado em: (2015)
article On the specification of extract, transform, and load patterns behavior: A domain-specific language approach
por: Oliveira, Bruno
Publicado em: (2017)
por: Oliveira, Bruno
Publicado em: (2017)
school Especificação e validação de processos ETL em Alloy
por: Capelo, Mariana Almeida Brandão
Publicado em: (2018)
por: Capelo, Mariana Almeida Brandão
Publicado em: (2018)
article Especificação do comportamento de padrões ETL
por: Gomes, Cláudia
Publicado em: (2014)
por: Gomes, Cláudia
Publicado em: (2014)
article A process mining approach for discovering ETL black points
por: Belo, Orlando
Publicado em: (2017)
por: Belo, Orlando
Publicado em: (2017)
article Using relational algebra on the specification of real world ETL processes
por: Santos, Vasco
Publicado em: (2015)
por: Santos, Vasco
Publicado em: (2015)
article Using relational algebra on the specification of real world ETL processes
por: Santos, Vasco
Publicado em: (2015)
por: Santos, Vasco
Publicado em: (2015)
article Using BPMN for ETL conceptual modelling: A case study
por: Oliveira, Bruno
Publicado em: (2021)
por: Oliveira, Bruno
Publicado em: (2021)
article On the conceptualization of ETL patterns: a Reo approach
por: Oliveira, Bruno
Publicado em: (2014)
por: Oliveira, Bruno
Publicado em: (2014)
article Configuring and executing ETL tasks on GRID environments - requirements and specificities
por: Santos, Vasco
Publicado em: (2011)
por: Santos, Vasco
Publicado em: (2011)
article Determining the quality of execution of a data warehousing populating system
por: Dias, Nuno
Publicado em: (2017)
por: Dias, Nuno
Publicado em: (2017)
school A relational algebra approach to ETL modeling
por: Santos, Vasco Nuno Caio dos
Publicado em: (2015)
por: Santos, Vasco Nuno Caio dos
Publicado em: (2015)
article Colored Petri nets in the simulation of ETL standard tasks: the surrogate key pipelining case
por: Silva, Diogo
Publicado em: (2012)
por: Silva, Diogo
Publicado em: (2012)
article Using a domain-specific language to enrich ETL schemas
por: Belo, O.
Publicado em: (2015)
por: Belo, O.
Publicado em: (2015)
article ETL standard processes modelling: a novel BPMN approach
por: Oliveira, Bruno
Publicado em: (2013)
por: Oliveira, Bruno
Publicado em: (2013)
article Modeling ETL data quality enforcement tasks using relational algebra operators
por: Santos, Vasco
Publicado em: (2013)
por: Santos, Vasco
Publicado em: (2013)
article Automatic generation of ETL physical systems from BPMN conceptual models
por: Belo, O.
Publicado em: (2015)
por: Belo, O.
Publicado em: (2015)
article Adaptive OLAP caching, towards a better quality of service in analytical systems
por: Marques, Pedro
Publicado em: (2012)
por: Marques, Pedro
Publicado em: (2012)
article Modelling ETL conciliation tasks using relational algebra operators
por: Santos, Vasco
Publicado em: (2014)
por: Santos, Vasco
Publicado em: (2014)
article Designing safe and reliable ETL systems using alloy
por: Capelo, Mariana
Publicado em: (2018)
por: Capelo, Mariana
Publicado em: (2018)
article From ETL conceptual design to ETL physical sketching using patterns
por: Oliveira, Bruno
Publicado em: (2018)
por: Oliveira, Bruno
Publicado em: (2018)
article O processo ETL em sistemas data warehouse
por: Ferreira, João Tiago Antunes
Publicado em: (2010)
por: Ferreira, João Tiago Antunes
Publicado em: (2010)
school Captura de dados em tempo real em sistemas de data warehousing
por: Dias, Miguel Gonçalves
Publicado em: (2013)
por: Dias, Miguel Gonçalves
Publicado em: (2013)
article A service-oriented framework for ETL implementation
por: Oliveira, Bruno
Publicado em: (2022)
por: Oliveira, Bruno
Publicado em: (2022)
Registos relacionados
-
article Modeling an opportunistic ETL agent based system using YAWL
por: Gomes, Nuno André Barbosa
Publicado em: (2016) -
article A pattern-oriented approach for supporting ETL conceptual modelling and its YAWL-based implementation
por: Oliveira, Bruno
Publicado em: (2014) -
article Modeling agents working on ETL processes
por: Gomes, Nuno André Barbosa
Publicado em: (2016) -
school Transformação de especificações ETL em YAWL para processos Kettle
por: Freitas, Janine Marlene Duarte Silva
Publicado em: (2019) -
article Modeling and supporting ETL processes via a pattern-oriented, task-reusable framework
por: Belo, Orlando
Publicado em: (2014)