Publicação
A service-oriented framework for ETL implementation
| Resumo: | The development of analytical systems imposes several challenges related not only to the amount and heterogeneity of the involved data but also to the constant need to readapt and evolve to overcome new business challenges. The data modelling layer represents the mapping between the domain and technical knowledge, however, to organize raw data into a form that can be used for analytics, specific Extract, Transform and Load (ETL) processes should be applied. ETL systems are recognized as a critical and tightly coupled system component that encapsulates data-level requirements that are hard to implement and maintain. In a Big Data era, adaptability and extensibility are important characteristics to hold when developing analytical systems. Thus, to provide more consistent, reliable, flexible, and reusable ETL processes, a service-oriented implementation for ETL development is proposed. |
|---|---|
| Autores principais: | Oliveira, Bruno |
| Outros Autores: | Leite, Mario; Oliveira, Oscar; Belo, Orlando |
| Assunto: | Analytical systems ETL patterns Service-oriented approach ETL as a service Engenharia e Tecnologia::Engenharia Eletrotécnica, Eletrónica e Informática |
| Ano: | 2022 |
| País: | Portugal |
| Tipo de documento: | comunicação em conferência |
| Tipo de acesso: | acesso restrito |
| Instituição associada: | Universidade do Minho |
| Idioma: | inglês |
| Origem: | RepositóriUM - Universidade do Minho |
| Resumo: | The development of analytical systems imposes several challenges related not only to the amount and heterogeneity of the involved data but also to the constant need to readapt and evolve to overcome new business challenges. The data modelling layer represents the mapping between the domain and technical knowledge, however, to organize raw data into a form that can be used for analytics, specific Extract, Transform and Load (ETL) processes should be applied. ETL systems are recognized as a critical and tightly coupled system component that encapsulates data-level requirements that are hard to implement and maintain. In a Big Data era, adaptability and extensibility are important characteristics to hold when developing analytical systems. Thus, to provide more consistent, reliable, flexible, and reusable ETL processes, a service-oriented implementation for ETL development is proposed. |
|---|