Publicação
Modeling an opportunistic ETL agent based system using YAWL
| Resumo: | ETL systems are responsible for populating data warehouses' storage structures with historical subject-oriented business data. To do that in the most appropriated manner ETL systems require special computational means, involving frequently the manipulation of large amounts of data that come usually from disparate information sources. Planning and designing ETL systems are very complex tasks, where the occurrence of errors is not rare. In some particular situations, this may jeopardize the successful implementation of the entire system. Therefore, ETL systems modeling is a very important activity in an ETL project, since it allows for sketching and validating different kinds of implementations accordingly all operational requirements defined. This will reduce significantly project costs originated by misinterpreted or badly mapped specifications. In this work we propose a different approach for modeling ETL systems, using ETL patterns as main systems components of an ETL system that will be used and tested in a standard simulation environment using the workflow language YAWL. The system is supported by a cooperative community of agents that are in charge to put in practice the tasks specified of a specific ETL pattern and, together, execute the entire set of tasks required by a particular ETL system package. |
|---|---|
| Autores principais: | Gomes, Nuno André Barbosa |
| Outros Autores: | Belo, Orlando |
| Assunto: | Multi-agent systems Software agents Data warehousing ETL systems modeling ETL patterns design YAWL |
| Ano: | 2016 |
| País: | Portugal |
| Tipo de documento: | comunicação em conferência |
| Tipo de acesso: | acesso restrito |
| Instituição associada: | Universidade do Minho |
| Idioma: | inglês |
| Origem: | RepositóriUM - Universidade do Minho |
Registos relacionados
article Modeling agents working on ETL processes
por: Gomes, Nuno André Barbosa
Publicado em: (2016)
por: Gomes, Nuno André Barbosa
Publicado em: (2016)
article ETL patterns on YAWL: towards to the specification of platform-independent data warehousing populating processes
por: Oliveira, Bruno
Publicado em: (2014)
por: Oliveira, Bruno
Publicado em: (2014)
school Transformação de especificações ETL em YAWL para processos Kettle
por: Freitas, Janine Marlene Duarte Silva
Publicado em: (2019)
por: Freitas, Janine Marlene Duarte Silva
Publicado em: (2019)
article A pattern-oriented approach for supporting ETL conceptual modelling and its YAWL-based implementation
por: Oliveira, Bruno
Publicado em: (2014)
por: Oliveira, Bruno
Publicado em: (2014)
article Towards a formal validation of ETL patterns behaviour
por: Oliveira, Bruno
Publicado em: (2016)
por: Oliveira, Bruno
Publicado em: (2016)
article ETL development using patterns: A service-oriented approach
por: Oliveira, Bruno
Publicado em: (2019)
por: Oliveira, Bruno
Publicado em: (2019)
article An ontology for describing ETL patterns behavior
por: Oliveira, Bruno
Publicado em: (2016)
por: Oliveira, Bruno
Publicado em: (2016)
article Validating ETL patterns feasability using alloy
por: Oliveira, Bruno
Publicado em: (2017)
por: Oliveira, Bruno
Publicado em: (2017)
article Approaching ETL processes specification using a pattern-based ontology
por: Oliveira, Bruno
Publicado em: (2017)
por: Oliveira, Bruno
Publicado em: (2017)
article Modeling and supporting ETL processes via a pattern-oriented, task-reusable framework
por: Belo, Orlando
Publicado em: (2014)
por: Belo, Orlando
Publicado em: (2014)
article A process mining approach for discovering ETL black points
por: Belo, Orlando
Publicado em: (2017)
por: Belo, Orlando
Publicado em: (2017)
article Pattern-based ETL conceptual modelling
por: Oliveira, Bruno
Publicado em: (2013)
por: Oliveira, Bruno
Publicado em: (2013)
article Using relational algebra on the specification of real world ETL processes
por: Santos, Vasco
Publicado em: (2015)
por: Santos, Vasco
Publicado em: (2015)
article ETL logs under a pattern-oriented approach
por: Oliveira, Bruno
Publicado em: (2021)
por: Oliveira, Bruno
Publicado em: (2021)
article An ETL pattern for log configuration and analysis
por: Oliveira, Bruno
Publicado em: (2019)
por: Oliveira, Bruno
Publicado em: (2019)
article Towards a low cost ETL system
por: Santos, Vasco
Publicado em: (2014)
por: Santos, Vasco
Publicado em: (2014)
article Task clustering on ETL systems – A pattern-oriented approach
por: Oliveira, Bruno
Publicado em: (2015)
por: Oliveira, Bruno
Publicado em: (2015)
article Colored Petri nets in the simulation of ETL standard tasks: the surrogate key pipelining case
por: Silva, Diogo
Publicado em: (2012)
por: Silva, Diogo
Publicado em: (2012)
article Using reo on ETL conceptual modelling: a first approach
por: Oliveira, Bruno
Publicado em: (2013)
por: Oliveira, Bruno
Publicado em: (2013)
article A domain-specific language for ETL patterns specification in Data Warehousing Systems
por: Oliveira, Bruno
Publicado em: (2015)
por: Oliveira, Bruno
Publicado em: (2015)
article On the specification of extract, transform, and load patterns behavior: A domain-specific language approach
por: Oliveira, Bruno
Publicado em: (2017)
por: Oliveira, Bruno
Publicado em: (2017)
article Approaching ETL conceptual modelling and validation using BPMN and BPEL
por: Oliveira, Bruno
Publicado em: (2013)
por: Oliveira, Bruno
Publicado em: (2013)
article BPMN patterns for ETL conceptual modelling and validation
por: Oliveira, Bruno
Publicado em: (2012)
por: Oliveira, Bruno
Publicado em: (2012)
school A relational algebra approach to ETL modeling
por: Santos, Vasco Nuno Caio dos
Publicado em: (2015)
por: Santos, Vasco Nuno Caio dos
Publicado em: (2015)
school Especificação e validação de processos ETL em Alloy
por: Capelo, Mariana Almeida Brandão
Publicado em: (2018)
por: Capelo, Mariana Almeida Brandão
Publicado em: (2018)
article Especificação do comportamento de padrões ETL
por: Gomes, Cláudia
Publicado em: (2014)
por: Gomes, Cláudia
Publicado em: (2014)
article Using relational algebra on the specification of real world ETL processes
por: Santos, Vasco
Publicado em: (2015)
por: Santos, Vasco
Publicado em: (2015)
article Designing safe and reliable ETL systems using alloy
por: Capelo, Mariana
Publicado em: (2018)
por: Capelo, Mariana
Publicado em: (2018)
article Automatic generation of ETL physical systems from BPMN conceptual models
por: Belo, O.
Publicado em: (2015)
por: Belo, O.
Publicado em: (2015)
article ETL standard processes modelling: a novel BPMN approach
por: Oliveira, Bruno
Publicado em: (2013)
por: Oliveira, Bruno
Publicado em: (2013)
article From ETL conceptual design to ETL physical sketching using patterns
por: Oliveira, Bruno
Publicado em: (2018)
por: Oliveira, Bruno
Publicado em: (2018)
article Determining the quality of execution of a data warehousing populating system
por: Dias, Nuno
Publicado em: (2017)
por: Dias, Nuno
Publicado em: (2017)
article Using a domain-specific language to enrich ETL schemas
por: Belo, O.
Publicado em: (2015)
por: Belo, O.
Publicado em: (2015)
article On the conceptualization of ETL patterns: a Reo approach
por: Oliveira, Bruno
Publicado em: (2014)
por: Oliveira, Bruno
Publicado em: (2014)
article A service-oriented framework for ETL implementation
por: Oliveira, Bruno
Publicado em: (2022)
por: Oliveira, Bruno
Publicado em: (2022)
article Overcoming traditional ETL systems architectural problems using a service-oriented approach
por: Oliveira, Bruno
Publicado em: (2023)
por: Oliveira, Bruno
Publicado em: (2023)
article O processo ETL em sistemas data warehouse
por: Ferreira, João Tiago Antunes
Publicado em: (2010)
por: Ferreira, João Tiago Antunes
Publicado em: (2010)
article Modeling ETL data quality enforcement tasks using relational algebra operators
por: Santos, Vasco
Publicado em: (2013)
por: Santos, Vasco
Publicado em: (2013)
article Using BPMN for ETL conceptual modelling: A case study
por: Oliveira, Bruno
Publicado em: (2021)
por: Oliveira, Bruno
Publicado em: (2021)
article Modelling ETL conciliation tasks using relational algebra operators
por: Santos, Vasco
Publicado em: (2014)
por: Santos, Vasco
Publicado em: (2014)
Registos relacionados
-
article Modeling agents working on ETL processes
por: Gomes, Nuno André Barbosa
Publicado em: (2016) -
article ETL patterns on YAWL: towards to the specification of platform-independent data warehousing populating processes
por: Oliveira, Bruno
Publicado em: (2014) -
school Transformação de especificações ETL em YAWL para processos Kettle
por: Freitas, Janine Marlene Duarte Silva
Publicado em: (2019) -
article A pattern-oriented approach for supporting ETL conceptual modelling and its YAWL-based implementation
por: Oliveira, Bruno
Publicado em: (2014) -
article Towards a formal validation of ETL patterns behaviour
por: Oliveira, Bruno
Publicado em: (2016)