Publicação
Scalable eventually consistent counters over unreliable networks
| Resumo: | Counters are an important abstraction in distributed computing, and play a central role in large scale geo-replicated systems, counting events such as web page impressions or social network “likes”. Classic distributed counters, strongly consistent via linearisability or sequential consistency, cannot be made both available and partition-tolerant, due to the CAP Theorem, being unsuitable to large scale scenarios. This paper defines Eventually Consistent Distributed Counters (ECDCs) and presents an implementation of the concept, Handoff Counters, that is scalable and works over unreliable networks. By giving up the total operation ordering in classic distributed counters, ECDC implementations can be made AP in the CAP design space, while retaining the essence of counting. Handoff Counters are the first Conflict-free Replicated Data Type (CRDT) based mechanism that overcomes the identity explosion problem in naive CRDTs, such as G-Counters (where state size is linear in the number of independent actors that ever incremented the counter), by managing identities towards avoiding global propagation and garbage collecting temporary entries. The approach used in Handoff Counters is not restricted to counters, being more generally applicable to other data types with associative and commutative operations. |
|---|---|
| Autores principais: | Almeida, Paulo Sérgio |
| Outros Autores: | Baquero, Carlos |
| Assunto: | Conflict-free replicated data types Distributed counters Eventual consistency |
| Ano: | 2019 |
| País: | Portugal |
| Tipo de documento: | artigo |
| Tipo de acesso: | acesso aberto |
| Instituição associada: | Universidade do Minho |
| Idioma: | inglês |
| Origem: | RepositóriUM - Universidade do Minho |
| _version_ | 1866875868243034112 |
|---|---|
| author | Almeida, Paulo Sérgio |
| author2 | Baquero, Carlos |
| author2_role | author |
| author_facet | Almeida, Paulo Sérgio Baquero, Carlos |
| author_role | author |
| contributor_name_str_mv | Universidade do Minho |
| country_str | PT |
| creators_json_txt | [{\"Person.name\":\"Almeida, Paulo Sérgio\"},{\"Person.name\":\"Baquero, Carlos\"}] |
| datacite.contributors.contributor.contributorName.fl_str_mv | Universidade do Minho |
| datacite.creators.creator.creatorName.fl_str_mv | Almeida, Paulo Sérgio Baquero, Carlos |
| datacite.date.Accepted.fl_str_mv | 2019-01-01T00:00:00Z |
| datacite.rights.fl_str_mv | http://purl.org/coar/access_right/c_abf2 |
| datacite.subjects.subject.fl_str_mv | Conflict-free replicated data types Distributed counters Eventual consistency |
| datacite.titles.title.fl_str_mv | Scalable eventually consistent counters over unreliable networks |
| dc.contributor.none.fl_str_mv | Universidade do Minho |
| dc.creator.none.fl_str_mv | Almeida, Paulo Sérgio Baquero, Carlos |
| dc.date.Accepted.fl_str_mv | 2019-01-01T00:00:00Z |
| dc.format.none.fl_str_mv | application/pdf |
| dc.identifier.none.fl_str_mv | https://hdl.handle.net/1822/53777 |
| dc.language.none.fl_str_mv | eng |
| dc.publisher.none.fl_str_mv | Springer Verlag |
| dc.rights.none.fl_str_mv | http://purl.org/coar/access_right/c_abf2 |
| dc.subject.none.fl_str_mv | Conflict-free replicated data types Distributed counters Eventual consistency |
| dc.title.fl_str_mv | Scalable eventually consistent counters over unreliable networks |
| dc.type.none.fl_str_mv | http://purl.org/coar/resource_type/c_6501 |
| description | Counters are an important abstraction in distributed computing, and play a central role in large scale geo-replicated systems, counting events such as web page impressions or social network “likes”. Classic distributed counters, strongly consistent via linearisability or sequential consistency, cannot be made both available and partition-tolerant, due to the CAP Theorem, being unsuitable to large scale scenarios. This paper defines Eventually Consistent Distributed Counters (ECDCs) and presents an implementation of the concept, Handoff Counters, that is scalable and works over unreliable networks. By giving up the total operation ordering in classic distributed counters, ECDC implementations can be made AP in the CAP design space, while retaining the essence of counting. Handoff Counters are the first Conflict-free Replicated Data Type (CRDT) based mechanism that overcomes the identity explosion problem in naive CRDTs, such as G-Counters (where state size is linear in the number of independent actors that ever incremented the counter), by managing identities towards avoiding global propagation and garbage collecting temporary entries. The approach used in Handoff Counters is not restricted to counters, being more generally applicable to other data types with associative and commutative operations. |
| dirty | 0 |
| eu_rights_str_mv | openAccess |
| format | article |
| fulltext.url.fl_str_mv | https://prod-dspace.uminho.pt/bitstreams/0d56512d-020c-484f-83fb-2bea47afb383/download |
| id | rum_9103e00a187f1bed934d1f22feb78f47 |
| identifier.url.fl_str_mv | https://hdl.handle.net/1822/53777 |
| instacron_str | repositorium |
| institution | Universidade do Minho |
| instname_str | Universidade do Minho |
| language | eng |
| network_acronym_str | rum |
| network_name_str | RepositóriUM - Universidade do Minho |
| oai_identifier_str | oai:repositorium.uminho.pt:1822/53777 |
| organization_str_mv | urn:organizationAcronym:repositorium |
| person_str_mv | Almeida, Paulo Sérgio Baquero, Carlos |
| publishDate | 2019 |
| publisher.none.fl_str_mv | Springer Verlag |
| reponame_str | RepositóriUM - Universidade do Minho |
| repository_id_str | urn:repositoryAcronym:rum |
| service_str_mv | urn:repositoryAcronym:rum |
| spelling | engSpringer VerlagporCounters are an important abstraction in distributed computing, and play a central role in large scale geo-replicated systems, counting events such as web page impressions or social network “likes”. Classic distributed counters, strongly consistent via linearisability or sequential consistency, cannot be made both available and partition-tolerant, due to the CAP Theorem, being unsuitable to large scale scenarios. This paper defines Eventually Consistent Distributed Counters (ECDCs) and presents an implementation of the concept, Handoff Counters, that is scalable and works over unreliable networks. By giving up the total operation ordering in classic distributed counters, ECDC implementations can be made AP in the CAP design space, while retaining the essence of counting. Handoff Counters are the first Conflict-free Replicated Data Type (CRDT) based mechanism that overcomes the identity explosion problem in naive CRDTs, such as G-Counters (where state size is linear in the number of independent actors that ever incremented the counter), by managing identities towards avoiding global propagation and garbage collecting temporary entries. The approach used in Handoff Counters is not restricted to counters, being more generally applicable to other data types with associative and commutative operations.application/pdfporScalable eventually consistent counters over unreliable networksAlmeida, Paulo SérgioBaquero, CarlosHostingInstitutionOrganizationalUniversidade do Minhoe-mailmailto:repositorium@usdb.uminho.ptrepositorium@usdb.uminho.ptISSNIsPartOf0178-2770DOIIsPartOf10.1007/s00446-017-0322-220192018-02-14T14:28:06Z2019-01-01T00:00:00ZHandlehttps://hdl.handle.net/1822/53777http://purl.org/coar/access_right/c_abf2open accessConflict-free replicated data typesDistributed countersEventual consistency1017110 bytesliteraturehttp://purl.org/coar/resource_type/c_6501journal articlehttp://purl.org/coar/access_right/c_abf2application/pdffulltexthttps://prod-dspace.uminho.pt/bitstreams/0d56512d-020c-484f-83fb-2bea47afb383/download |
| spellingShingle | Scalable eventually consistent counters over unreliable networks Almeida, Paulo Sérgio Conflict-free replicated data types Distributed counters Eventual consistency |
| status | SINGLETON |
| subject.fl_str_mv | Conflict-free replicated data types Distributed counters Eventual consistency |
| title | Scalable eventually consistent counters over unreliable networks |
| title_full | Scalable eventually consistent counters over unreliable networks |
| title_fullStr | Scalable eventually consistent counters over unreliable networks |
| title_full_unstemmed | Scalable eventually consistent counters over unreliable networks |
| title_short | Scalable eventually consistent counters over unreliable networks |
| title_sort | Scalable eventually consistent counters over unreliable networks |
| topic | Conflict-free replicated data types Distributed counters Eventual consistency |
| topic_facet | Conflict-free replicated data types Distributed counters Eventual consistency |
| url | https://hdl.handle.net/1822/53777 |
| visible | 1 |