Publicação
The Challenges of Replicating Volatile Platform-Data Studies: Replicating Schatto-Eckrodt et al. (2020)
| Resumo: | Replication studies in computational communication science (CCS) play a vital role in upholding research validity, ensuring reliability, and promoting transparency. However, conducting such studies in CCS often proves challenging due to the data environments’ dynamic nature and the complexities surrounding data and software sharing. To shed light on these challenges, we examine the replication process with CCS studies by computationally reproducing and replicating Schatto-Eckrodt et al.’s (2020) computational analysis of the X (formerly Twitter) debate about the term “gaming disorder” being added to the International Classification of Diseases 11. Our results indicate a reproduction success rate of 88.46% of the original findings. Replicating the analysis presents several obstacles, particularly in data access and availability. Five years after the original data collection, we were able to recollect only 55.08% of the initial sample, primarily due to user and platform activities, including account deletions, user suspensions, and privacy settings. Our reproduction and replication efforts revealed intricate challenges in conducting CCS research, particularly concerning data access and third-party platforms. To enhance replication in CCS, we emphasize the crucial role of data sharing, increased transparency, extensive documentation, and regulatory processes. Thus, our analysis underscores replications’ critical role in enhancing CCS research validity and reliability. |
|---|---|
| Autores principais: | Knöpfle, Philipp |
| Outros Autores: | Schatto-Eckrodt, Tim |
| Assunto: | computational communication science; replicability; replication; reproducibility; Twitter |
| Ano: | 2024 |
| País: | Portugal |
| Tipo de documento: | artigo |
| Tipo de acesso: | unknown |
| Instituição associada: | Cogitatio Press |
| Idioma: | inglês |
| Origem: | Media and Communication |
| _version_ | 1869074039685775360 |
|---|---|
| author | Knöpfle, Philipp |
| author2 | Schatto-Eckrodt, Tim |
| author2_role | author |
| author_facet | Knöpfle, Philipp Schatto-Eckrodt, Tim |
| author_role | author |
| country_str | PT |
| creators_json_txt | [{\"Person.name\":\"Knöpfle, Philipp\"},{\"Person.name\":\"Schatto-Eckrodt, Tim\"}] |
| datacite.creators.creator.creatorName.fl_str_mv | Knöpfle, Philipp Schatto-Eckrodt, Tim |
| datacite.rights.fl_str_mv | http://purl.org/coar/access_right/c_abf2 |
| datacite.subjects.subject.fl_str_mv | computational communication science; replicability; replication; reproducibility; Twitter |
| datacite.titles.title.fl_str_mv | The Challenges of Replicating Volatile Platform-Data Studies: Replicating Schatto-Eckrodt et al. (2020) |
| dc.creator.none.fl_str_mv | Knöpfle, Philipp Schatto-Eckrodt, Tim |
| dc.format.none.fl_str_mv | application/pdf |
| dc.identifier.none.fl_str_mv | https://doi.org/10.17645/mac.7789 |
| dc.language.none.fl_str_mv | eng |
| dc.publisher.none.fl_str_mv | Cogitatio Press |
| dc.rights.none.fl_str_mv | http://purl.org/coar/access_right/c_abf2 |
| dc.rights.rights.copyright.fl_str_mv | https://creativecommons.org/licenses/by/4.0 |
| dc.source.none.fl_str_mv | Media and Communication; Vol 12 (2024): Reproducibility and Replicability in Communication Research 2183-2439 10.17645/mac.i429 |
| dc.subject.none.fl_str_mv | computational communication science; replicability; replication; reproducibility; Twitter |
| dc.title.fl_str_mv | The Challenges of Replicating Volatile Platform-Data Studies: Replicating Schatto-Eckrodt et al. (2020) |
| dc.type.none.fl_str_mv | http://purl.org/coar/resource_type/c_6501 |
| description | Replication studies in computational communication science (CCS) play a vital role in upholding research validity, ensuring reliability, and promoting transparency. However, conducting such studies in CCS often proves challenging due to the data environments’ dynamic nature and the complexities surrounding data and software sharing. To shed light on these challenges, we examine the replication process with CCS studies by computationally reproducing and replicating Schatto-Eckrodt et al.’s (2020) computational analysis of the X (formerly Twitter) debate about the term “gaming disorder” being added to the International Classification of Diseases 11. Our results indicate a reproduction success rate of 88.46% of the original findings. Replicating the analysis presents several obstacles, particularly in data access and availability. Five years after the original data collection, we were able to recollect only 55.08% of the initial sample, primarily due to user and platform activities, including account deletions, user suspensions, and privacy settings. Our reproduction and replication efforts revealed intricate challenges in conducting CCS research, particularly concerning data access and third-party platforms. To enhance replication in CCS, we emphasize the crucial role of data sharing, increased transparency, extensive documentation, and regulatory processes. Thus, our analysis underscores replications’ critical role in enhancing CCS research validity and reliability. |
| dirty | 0 |
| eu_rights_str_mv | unknown |
| format | article |
| id | mc_cefeba2ef6e6db5fa957d100dd97dd6e |
| identifier.doi.fl_str_mv | https://doi.org/10.17645/mac.7789 |
| inst_facet_str | urn:organizationAcronym:cp{{{_:::_}}}Cogitatio Press |
| instacron_str | cp |
| institution | Cogitatio Press |
| instname_str | Cogitatio Press |
| language | eng |
| network_acronym_str | mc |
| network_name_str | Media and Communication |
| oai_identifier_str | oai:ojs.cogitatiopress.com:article/7789 |
| organization_str_mv | urn:organizationAcronym:cp |
| person_str_mv | Knöpfle, Philipp Schatto-Eckrodt, Tim |
| publishDate | 2024 |
| publisher.none.fl_str_mv | Cogitatio Press |
| repo_facet_str | urn:repositoryAcronym:mc{{{_:::_}}}Media and Communication |
| reponame_str | Media and Communication |
| repository_id_str | urn:repositoryAcronym:mc |
| service_str_mv | urn:repositoryAcronym:mc |
| spelling | en-USThe Challenges of Replicating Volatile Platform-Data Studies: Replicating Schatto-Eckrodt et al. (2020)Knöpfle, PhilippSchatto-Eckrodt, Timcomputational communication science; replicability; replication; reproducibility; TwitterCopyright (c) 2024 Philipp Knöpfle, Tim Schatto-Eckrodthttp://purl.org/coar/access_right/c_abf2https://doi.org/10.17645/mac.7789DOIhttps://www.cogitatiopress.com/mediaandcommunication/article/view/7789URLHasVersionhttps://www.cogitatiopress.com/mediaandcommunication/article/view/7789/3726URLHasVersionhttps://doi.org/10.17645/mac.7789DOI2024-04-15en-USReplication studies in computational communication science (CCS) play a vital role in upholding research validity, ensuring reliability, and promoting transparency. However, conducting such studies in CCS often proves challenging due to the data environments’ dynamic nature and the complexities surrounding data and software sharing. To shed light on these challenges, we examine the replication process with CCS studies by computationally reproducing and replicating Schatto-Eckrodt et al.’s (2020) computational analysis of the X (formerly Twitter) debate about the term “gaming disorder” being added to the International Classification of Diseases 11. Our results indicate a reproduction success rate of 88.46% of the original findings. Replicating the analysis presents several obstacles, particularly in data access and availability. Five years after the original data collection, we were able to recollect only 55.08% of the initial sample, primarily due to user and platform activities, including account deletions, user suspensions, and privacy settings. Our reproduction and replication efforts revealed intricate challenges in conducting CCS research, particularly concerning data access and third-party platforms. To enhance replication in CCS, we emphasize the crucial role of data sharing, increased transparency, extensive documentation, and regulatory processes. Thus, our analysis underscores replications’ critical role in enhancing CCS research validity and reliability.Cogitatio Pressapplication/pdfen-USMedia and Communication; Vol 12 (2024): Reproducibility and Replicability in Communication Research2183-243910.17645/mac.i429engjournal articlehttp://purl.org/coar/resource_type/c_6501literatureVoRhttp://purl.org/coar/version/c_970fb48d4fbd8a85https://creativecommons.org/licenses/by/4.0 |
| spellingShingle | The Challenges of Replicating Volatile Platform-Data Studies: Replicating Schatto-Eckrodt et al. (2020) Knöpfle, Philipp computational communication science; replicability; replication; reproducibility; Twitter |
| status | SINGLETON |
| status_str | VoR |
| subject.fl_str_mv | computational communication science; replicability; replication; reproducibility; Twitter |
| title | The Challenges of Replicating Volatile Platform-Data Studies: Replicating Schatto-Eckrodt et al. (2020) |
| title_full | The Challenges of Replicating Volatile Platform-Data Studies: Replicating Schatto-Eckrodt et al. (2020) |
| title_fullStr | The Challenges of Replicating Volatile Platform-Data Studies: Replicating Schatto-Eckrodt et al. (2020) |
| title_full_unstemmed | The Challenges of Replicating Volatile Platform-Data Studies: Replicating Schatto-Eckrodt et al. (2020) |
| title_short | The Challenges of Replicating Volatile Platform-Data Studies: Replicating Schatto-Eckrodt et al. (2020) |
| title_sort | The Challenges of Replicating Volatile Platform-Data Studies: Replicating Schatto-Eckrodt et al. (2020) |
| topic | computational communication science; replicability; replication; reproducibility; Twitter |
| topic_facet | computational communication science; replicability; replication; reproducibility; Twitter |
| url | https://doi.org/10.17645/mac.7789 |
| visible | 1 |