Author(s): Ramos, Isabel ; Santos, Maribel Yasmina ; Joshi, Divya ; Pratik, Sheetal
Date: 2024
Persistent ID: https://hdl.handle.net/1822/95882
Origin: RepositóriUM - Universidade do Minho
Subject(s): Data Architectures; Data Mesh; Technology Adoption
Data Warehousing systems have been used to support Business Intelligence applications by ingesting operational data and providing analytical data. As data volume, variety, and velocity increased in Big Data contexts, this data architecture needed to be modernised, and Big Data Warehouses emerged as scalable, high-performance, and highly flexible processing systems capable of handling ever-increasing volumes of data. These monolithic techniques, however, create major challenges to data engineering teams in terms of design, development, management, and evolution. Data Mesh emerged as a novel and disruptive concept aimed at data-driven businesses. The research detailed in this paper seeks to characterise Data Mesh readiness by examining the elements that influence the adoption choice using the technology-organization- environment (TOE) paradigm. A survey and a set of interviews were used in a multi-case and multi-method approach. Researchers and data triangulation were implemented to ensure rigour and arrive at a comprehensive understanding of Data Mesh adoption. The obtained results demonstrate the successful adoption of Data Mesh once its benefits are well understood, with increased teams’ creativity, data accuracy, data security, data governance and interoperability.
