Publicação
Distributed exact deduplication for primary storage infrastructures
| Resumo: | Deduplication of primary storage volumes in a cloud computing environment is increasingly desirable, as the resulting space savings contribute to the cost effectiveness of a large scale multi-tenant infrastructure. However, traditional archival and backup deduplication systems impose prohibitive overhead for latency-sensitive applications deployed at these infrastructures while, current primary deduplication systems rely on special cluster filesystems, centralized components, or restrictive workload assumptions. We present DEDIS, a fully-distributed and dependable system that performs exact and cluster-wide background deduplication of primary storage. DEDIS does not depend on data locality and works on top of any unsophisticated storage backend, centralized or distributed, that exports a basic shared block device interface. The evaluation of an open-source prototype shows that DEDIS scales out and adds negligible overhead even when deduplication and intensive storage I/O run simultaneously. |
|---|---|
| Autores principais: | Paulo, João |
| Outros Autores: | Pereira, José |
| Assunto: | Deduplication Storage systems Distributed systems Cloud computing |
| Ano: | 2014 |
| País: | Portugal |
| Tipo de documento: | comunicação em conferência |
| Tipo de acesso: | acesso aberto |
| Instituição associada: | Universidade do Minho |
| Idioma: | inglês |
| Origem: | RepositóriUM - Universidade do Minho |
Registos relacionados
article Efficient Deduplication in a Distributed Primary Storage Infrastructure
por: Paulo, Joao
Publicado em: (2016)
por: Paulo, Joao
Publicado em: (2016)
article DEDISbench: a benchmark for deduplicated storage systems
por: Paulo, João
Publicado em: (2012)
por: Paulo, João
Publicado em: (2012)
article Towards an accurate evaluation of deduplicated storage systems
por: Paulo, João
Publicado em: (2013)
por: Paulo, João
Publicado em: (2013)
article A survey and classification of storage deduplication systems
por: Pereira, José
Publicado em: (2014)
por: Pereira, José
Publicado em: (2014)
article DEDIS: distributed exact deduplication for primary storage infrastructures
por: Paulo, João
Publicado em: (2013)
por: Paulo, João
Publicado em: (2013)
school HIODS: hybrid inline and offline deduplication system
por: Pedrosa, Carlos Pinto
Publicado em: (2021)
por: Pedrosa, Carlos Pinto
Publicado em: (2021)
school S2Dedup: SGX-enabled secure deduplication system
por: Miranda, Mariana Martins de Sá
Publicado em: (2020)
por: Miranda, Mariana Martins de Sá
Publicado em: (2020)
article Brief announcement: efficient causality tracking in distributed storage systems with dotted version vectors
por: Preguiça, Nuno
Publicado em: (2012)
por: Preguiça, Nuno
Publicado em: (2012)
article About the feasibility of transactional support in cloud computing (fast abstract)
por: Maia, Francisco
Publicado em: (2010)
por: Maia, Francisco
Publicado em: (2010)
article Scalable transactions in the cloud: partitioning revisited
por: Maia, Francisco António Ferraz Martins Almeida
Publicado em: (2010)
por: Maia, Francisco António Ferraz Martins Almeida
Publicado em: (2010)
school Efficient, Dependable Storage of Human Genome Sequencing Data
por: Cogo, Vinicius
Publicado em: (2020)
por: Cogo, Vinicius
Publicado em: (2020)
article Towards cloud storage services characterization
por: Oliveira, Daniela
Publicado em: (2015)
por: Oliveira, Daniela
Publicado em: (2015)
assignment Consistency Anchor Formalization and Correctness Proofs
por: Miguel, Correia
Publicado em: (2014)
por: Miguel, Correia
Publicado em: (2014)
groups Architecture for the 15-Minute City
por: Melo, Leonardo
Publicado em: (2021)
por: Melo, Leonardo
Publicado em: (2021)
groups Mobile device-to-device distributed computing using data sets
por: Remédios, Diogo
Publicado em: (2015)
por: Remédios, Diogo
Publicado em: (2015)
article Cloud collaborative broker for Distributed Energy Resources
por: Ferreira, João C.
Publicado em: (2013)
por: Ferreira, João C.
Publicado em: (2013)
article A survey and classification of software-defined storage systems
por: Macedo, Ricardo
Publicado em: (2020)
por: Macedo, Ricardo
Publicado em: (2020)
school Availability and confidentiality in storage clouds
por: André, Fernando Martins
Publicado em: (2010)
por: André, Fernando Martins
Publicado em: (2010)
school LockyCloudCore - CTT locker management infrastructure
por: Seleiro, Miguel Moreira Lopes
Publicado em: (2024)
por: Seleiro, Miguel Moreira Lopes
Publicado em: (2024)
article Distributed and decentralized orchestration of containers on edge clouds
por: Pires, André
Publicado em: (2021)
por: Pires, André
Publicado em: (2021)
article Assessing NoSQL databases for telecom applications
por: Cruz, Francisco
Publicado em: (2011)
por: Cruz, Francisco
Publicado em: (2011)
article A case for dynamically programmable storage background tasks
por: Macedo, Ricardo
Publicado em: (2019)
por: Macedo, Ricardo
Publicado em: (2019)
article Computational shelf-life dating : complex systems approaches to food quality and safety
por: Martins, Rui C.
Publicado em: (2008)
por: Martins, Rui C.
Publicado em: (2008)
article Uma arquitetura moderna de dados: um caso de teste
por: Martins, César Silva
Publicado em: (2014)
por: Martins, César Silva
Publicado em: (2014)
article The future of power systems: Challenges, trends, and upcoming paradigms
por: Lopes, João Abel Peças
Publicado em: (2020)
por: Lopes, João Abel Peças
Publicado em: (2020)
school Rain Computing : orquestração de ações executadas por grupos de dispositivos IoT
por: Santos, António Peixoto de Assunção
Publicado em: (2020)
por: Santos, António Peixoto de Assunção
Publicado em: (2020)
school Agnostic cloud services with kubernetes
por: Bonacho, João Gonçalo Martins
Publicado em: (2023)
por: Bonacho, João Gonçalo Martins
Publicado em: (2023)
category FEW : file management for portable devices
por: Preguiça, Nuno
Publicado em: (2005)
por: Preguiça, Nuno
Publicado em: (2005)
article DATAFLASKS: epidemic store for massive scale systems
por: Maia, Francisco
Publicado em: (2014)
por: Maia, Francisco
Publicado em: (2014)
article Experimental performability evaluation of middleware for large-scale distributed systems
por: Pereira, José
Publicado em: (2005)
por: Pereira, José
Publicado em: (2005)
article Big data in cloud: a data architecture
por: Sá, Jorge Vaz de Oliveira e
Publicado em: (2015)
por: Sá, Jorge Vaz de Oliveira e
Publicado em: (2015)
school Consensus in high performance computing
por: Sobral, Diogo José Cruz
Publicado em: (2022)
por: Sobral, Diogo José Cruz
Publicado em: (2022)
article Cloud terminals for ticketing systems
por: Ferreira, João C.
Publicado em: (2013)
por: Ferreira, João C.
Publicado em: (2013)
article Autonomic workflow activities: the award framework
por: Assunção, Luis
Publicado em: (2014)
por: Assunção, Luis
Publicado em: (2014)
article Model checking a decentralized storage deduplication protocol
por: Paulo, João
Publicado em: (2011)
por: Paulo, João
Publicado em: (2011)
groups Bidirectional boost/buck quadratic converter for distributed generation systems with electrochemical storage systems
por: Pires, V. Fernão
Publicado em: (2017)
por: Pires, V. Fernão
Publicado em: (2017)
groups Management of an electric vehicle charging system supported by RES and storage systems
por: Fernao Pires, Vitor
Publicado em: (2018)
por: Fernao Pires, Vitor
Publicado em: (2018)
article Process-based information systems: a component-based systems development infrastructure
por: Pereira, José Luís Mota
Publicado em: (2014)
por: Pereira, José Luís Mota
Publicado em: (2014)
article A multidimensional model for monitoring cloud services
por: Palhares, Nuno
Publicado em: (2013)
por: Palhares, Nuno
Publicado em: (2013)
school Big Data and real-time knowledge discovery in healthcare institutions
por: Sousa, Regina
Publicado em: (2023)
por: Sousa, Regina
Publicado em: (2023)
Registos relacionados
-
article Efficient Deduplication in a Distributed Primary Storage Infrastructure
por: Paulo, Joao
Publicado em: (2016) -
article DEDISbench: a benchmark for deduplicated storage systems
por: Paulo, João
Publicado em: (2012) -
article Towards an accurate evaluation of deduplicated storage systems
por: Paulo, João
Publicado em: (2013) -
article A survey and classification of storage deduplication systems
por: Pereira, José
Publicado em: (2014) -
article DEDIS: distributed exact deduplication for primary storage infrastructures
por: Paulo, João
Publicado em: (2013)