Publicação
Scalable eventually consistent counters over unreliable networks
| Resumo: | Counters are an important abstraction in distributed computing, and play a central role in large scale geo-replicated systems, counting events such as web page impressions or social network “likes”. Classic distributed counters, strongly consistent via linearisability or sequential consistency, cannot be made both available and partition-tolerant, due to the CAP Theorem, being unsuitable to large scale scenarios. This paper defines Eventually Consistent Distributed Counters (ECDCs) and presents an implementation of the concept, Handoff Counters, that is scalable and works over unreliable networks. By giving up the total operation ordering in classic distributed counters, ECDC implementations can be made AP in the CAP design space, while retaining the essence of counting. Handoff Counters are the first Conflict-free Replicated Data Type (CRDT) based mechanism that overcomes the identity explosion problem in naive CRDTs, such as G-Counters (where state size is linear in the number of independent actors that ever incremented the counter), by managing identities towards avoiding global propagation and garbage collecting temporary entries. The approach used in Handoff Counters is not restricted to counters, being more generally applicable to other data types with associative and commutative operations. |
|---|---|
| Autores principais: | Almeida, Paulo Sérgio |
| Outros Autores: | Baquero, Carlos |
| Assunto: | Conflict-free replicated data types Distributed counters Eventual consistency |
| Ano: | 2019 |
| País: | Portugal |
| Tipo de documento: | artigo |
| Tipo de acesso: | acesso aberto |
| Instituição associada: | Universidade do Minho |
| Idioma: | inglês |
| Origem: | RepositóriUM - Universidade do Minho |
Registos relacionados
article Delta state replicated data types
por: Almeida, Paulo Sérgio
Publicado em: (2018)
por: Almeida, Paulo Sérgio
Publicado em: (2018)
school Probabilistic data types
por: Fernandes, Pedro Henrique Moreira Gomes
Publicado em: (2021)
por: Fernandes, Pedro Henrique Moreira Gomes
Publicado em: (2021)
article Eventually consistent register revisited
por: Zawirski, Marek
Publicado em: (2016)
por: Zawirski, Marek
Publicado em: (2016)
article Borrowing an identity for a distributed counter
por: Enes, Vitor
Publicado em: (2017)
por: Enes, Vitor
Publicado em: (2017)
article An oblivious observed-reset embeddable replicated counter
por: Weidner, Matthew
Publicado em: (2022)
por: Weidner, Matthew
Publicado em: (2022)
article Compact resettable counters through causal stability
por: Younes, Georges
Publicado em: (2017)
por: Younes, Georges
Publicado em: (2017)
article The problem with embedded CRDT counters and a solution
por: Baquero, Carlos
Publicado em: (2016)
por: Baquero, Carlos
Publicado em: (2016)
article As secure as possible eventual consistency: Work in progress
por: Shoker, Ali
Publicado em: (2017)
por: Shoker, Ali
Publicado em: (2017)
article Concise server-wide causality management for eventually consistent data stores
por: Gonçalves, Ricardo Jorge Tomé
Publicado em: (2015)
por: Gonçalves, Ricardo Jorge Tomé
Publicado em: (2015)
article Making Operation-based CRDTs Operation-based
por: Baquero, Carlos
Publicado em: (2014)
por: Baquero, Carlos
Publicado em: (2014)
article Integration challenges of pure operation-based CRDTs in redis
por: Younes, Georges
Publicado em: (2016)
por: Younes, Georges
Publicado em: (2016)
school Extending conflict free replicated datatypes fault models
por: Yactine, Houssam
Publicado em: (2025)
por: Yactine, Houssam
Publicado em: (2025)
article Evaluating dotted version vectors in Riak
por: Gonçalves, Ricardo Jorge Tomé
Publicado em: (2011)
por: Gonçalves, Ricardo Jorge Tomé
Publicado em: (2011)
article Scalable and accurate causality tracking for eventually consistent stores
por: Almeida, Paulo Sérgio
Publicado em: (2014)
por: Almeida, Paulo Sérgio
Publicado em: (2014)
assignment Coerência num sistema transaccional de replicação de objectos em grande-escala
por: Martins, João
Publicado em: (2001)
por: Martins, João
Publicado em: (2001)
article Efficient state-based CRDTs by delta-mutation
por: Almeida, Paulo Sérgio
Publicado em: (2015)
por: Almeida, Paulo Sérgio
Publicado em: (2015)
article Tree sign pattern that permit eventual positivity
por: Johnson, C. R
Publicado em: (2022)
por: Johnson, C. R
Publicado em: (2022)
school Mobile Development – Offline Persistence
por: Andrade, António Eduardo Moita
Publicado em: (2024)
por: Andrade, António Eduardo Moita
Publicado em: (2024)
article Fusion of overlapped result sets
por: Macedo, Joaquim
Publicado em: (2000)
por: Macedo, Joaquim
Publicado em: (2000)
article Consistency one-to-many: an analysis of crossplatform visual consistency in the most accessed global sites
por: Antunes, Ana Cristina
Publicado em: (2021)
por: Antunes, Ana Cristina
Publicado em: (2021)
article Loop-free construction of counter-models for intuitionistic propositional logic
por: Pinto, Luís F.
Publicado em: (1995)
por: Pinto, Luís F.
Publicado em: (1995)
article Transparent cross-system consistency
por: Loff, João
Publicado em: (2017)
por: Loff, João
Publicado em: (2017)
article Using structural characteristics for autonomous operation
por: Moura, Francisco
Publicado em: (1999)
por: Moura, Francisco
Publicado em: (1999)
assignment Consistency Anchor Formalization and Correctness Proofs
por: Miguel, Correia
Publicado em: (2014)
por: Miguel, Correia
Publicado em: (2014)
article The heteroskedasticity-consistent covariance estimator in accounting
por: Curto, José Dias
Publicado em: (2010)
por: Curto, José Dias
Publicado em: (2010)
article The Finitistic Consistency of Heck’s Predicative Fregean System
por: Cruz-Filipe, L.
Publicado em: (2015)
por: Cruz-Filipe, L.
Publicado em: (2015)
school Dynamic end-to-end reliable causal delivery middleware for geo-replicated services
por: Younes, Georges
Publicado em: (2023)
por: Younes, Georges
Publicado em: (2023)
school Improving data consistency in official statistics: application in the central bank of Portugal
por: Castor, Ana Beatriz Rodrigues
Publicado em: (2025)
por: Castor, Ana Beatriz Rodrigues
Publicado em: (2025)
article Loom: a closed-box disaggregated database system
por: Coelho, Fábio
Publicado em: (2023)
por: Coelho, Fábio
Publicado em: (2023)
article Do mutual funds have consistency in their performance?
por: Rao, Zia-ur-Rehman
Publicado em: (2020)
por: Rao, Zia-ur-Rehman
Publicado em: (2020)
article Teaching PLC timers and counters programming using MIT app-inventor
por: Oliveira, P. B. de Moura
Publicado em: (2018)
por: Oliveira, P. B. de Moura
Publicado em: (2018)
groups Fine-grained consistency upgrades for online services
por: Freitas, Filipe
Publicado em: (2017)
por: Freitas, Filipe
Publicado em: (2017)
article Proof search and counter-model construction for bi-intuitionistic propositional logic with labelled sequents
por: Pinto, Luís F.
Publicado em: (2009)
por: Pinto, Luís F.
Publicado em: (2009)
draft Monetary poverty, material deprivation and consistent poverty in Portugal
por: Rodrigues, Carlos Farinha
Publicado em: (2010)
por: Rodrigues, Carlos Farinha
Publicado em: (2010)
article Scalable bloom filters
por: Baquero, Carlos
Publicado em: (2007)
por: Baquero, Carlos
Publicado em: (2007)
article Evaluating certification protocols in the partial database state machine
por: Sousa, António Luís Pinto Ferreira de
Publicado em: (2006)
por: Sousa, António Luís Pinto Ferreira de
Publicado em: (2006)
article Consistency of toddler engagement across two settings
por: Aguiar, Cecília
Publicado em: (2013)
por: Aguiar, Cecília
Publicado em: (2013)
school Matching consistency effects in persuasion: distinguishing between consistent and mixed framed messages
por: Costa, João Rodrigo Robalo da
Publicado em: (2023)
por: Costa, João Rodrigo Robalo da
Publicado em: (2023)
article PHYLOViZ 2.0: providing scalable data integration and visualization for multiple phylogenetic inference methods
por: Nascimento, Marta
Publicado em: (2017)
por: Nascimento, Marta
Publicado em: (2017)
assignment Separating the WHEAT from the Chaff: An Empirical Design for Geo-Replicated State Machines
por: Sousa, João
Publicado em: (2015)
por: Sousa, João
Publicado em: (2015)
Registos relacionados
-
article Delta state replicated data types
por: Almeida, Paulo Sérgio
Publicado em: (2018) -
school Probabilistic data types
por: Fernandes, Pedro Henrique Moreira Gomes
Publicado em: (2021) -
article Eventually consistent register revisited
por: Zawirski, Marek
Publicado em: (2016) -
article Borrowing an identity for a distributed counter
por: Enes, Vitor
Publicado em: (2017) -
article An oblivious observed-reset embeddable replicated counter
por: Weidner, Matthew
Publicado em: (2022)