crowdsourcing; fact-checking; Misinformation; moral outrage; online emotions; social media; Community-based; Experimental methods; Fact-checking; Large-scales; Moral emotions; Moral outrage; Online emotion; Social media; Social norm; Human-Computer Interaction; Computer Graphics and Computer-Aided Design; Software; cs.SI; Computer Science - Human-Computer Interaction
Résumé :
[en] Displaying community fact-checks is a promising approach to reduce engagement with misinformation on social media. However, how users respond to misleading content emotionally after community fact-checks are displayed on posts is unclear. Here, we employ quasi-experimental methods to causally analyze changes in sentiments and (moral) emotions in replies to misleading posts following the display of community fact-checks. Our evaluation is based on a large-scale panel dataset comprising N = 2225260 replies across 1841 source posts from X's Community Notes platform. We find that informing users about falsehoods through community fact-checks significantly increases negativity (by 7.3%), anger (by 13.2%), disgust (by 4.7%), and moral outrage (by 16.0%) in the corresponding replies. These results indicate that users perceive spreading misinformation as a violation of social norms and that those who spread misinformation should expect negative reactions once their content is debunked. We derive important implications for the design of community-based fact-checking systems.
Centre de recherche :
Interdisciplinary Centre for Security, Reliability and Trust (SnT) > IRiSC - Socio-Technical Cybersecurity
Disciplines :
Sciences informatiques
Auteur, co-auteur :
CHUAI, Yuwei ; University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > IRiSC
SERGEEVA, Anastasia ; University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > IRiSC
LENZINI, Gabriele ; University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > IRiSC
Pröllochs, Nicolas ; Jlu Giessen, Giessen, Germany
Co-auteurs externes :
yes
Langue du document :
Anglais
Titre :
Community Fact-Checks Trigger Moral Outrage in Replies to Misleading Posts on Social Media
Date de publication/diffusion :
26 avril 2025
Nom de la manifestation :
Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems
Lieu de la manifestation :
Yokohama, Jpn
Date de la manifestation :
26-04-2025 => 01-05-2025
Sur invitation :
Oui
Titre de l'ouvrage principal :
CHI 2025 - Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems
This research is supported by the Luxembourg National Research Fund (FNR) and Belgian National Fund for Scientific Research (FNRS), as part of the project REgulatory Solutions to MitigatE DISinformation (REMEDIS), ref. INTER_FNRS_21_16554939_REMEDIS. Furthermore, this research is supported by a research grant from the German Research Foundation (DFG grant 492310022).
Hunt Allcott and Matthew Gentzkow. 2017. Social media and fake news in the 2016 election. Journal of Economic Perspectives 31, 2 (2017), 211-236.
Jennifer Allen, Antonio A Arechar, Gordon Pennycook, and David G Rand. 2021. Scaling up fact-checking using the wisdom of crowds. Science Advances 7, 36 (2021), eabf4393.
Jennifer Allen, Cameron Martel, and David G Rand. 2022. Birds of a feather don't fact-check each other: Partisanship and the evaluation of news in Twitter's Birdwatch crowdsourced fact-checking program. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. 1-19.
Sacha Altay, Manon Berriche, and Alberto Acerbi. 2023. Misinformation on misinformation: Conceptual and methodological challenges. Social Media + Society 9, 1 (2023), 20563051221150412.
Joshua D Angrist and Jörn-Steffen Pischke. 2009. Mostly harmless econometrics: An empiricist's companion. Princeton University Press.
Sinan Aral and Dean Eckles. 2019. Protecting elections from social media manipulation. Science 365, 6456 (2019), 858-861.
Jonah Berger and Katherine L Milkman. 2012. What makes online content viral? Journal of Marketing Research 49, 2 (2012), 192-205.
Md Momen Bhuiyan, Amy X Zhang, Connie Moon Sehat, and Tanushree Mitra. 2020. Investigating differences in crowdsourced news credibility assessment: Raters, tasks, and expert criteria. Proceedings of the ACM on Human-Computer Interaction 4, CSCW2 (2020), 1-26.
William J Brady, Killian McLoughlin, Tuan N Doan, and Molly J Crockett. 2021. How social learning amplifies moral outrage expression in online social networks. Science Advances 7, 33 (2021), eabe5641.
William J Brady, Killian L McLoughlin, Mark P Torres, Kara F Luo, Maria Gendron, and MJ Crockett. 2023. Overperception of moral outrage in online social networks inflates beliefs about intergroup hostility. Nature Human Behaviour 7, 6 (2023), 917-927.
William J Brady, Julian A Wills, John T Jost, Joshua A Tucker, and Jay J Van Bavel. 2017. Emotion shapes the diffusion of moralized content in social networks. Proceedings of the National Academy of Sciences 114, 28 (2017), 7313-7318.
William Brannon and Deb Roy. 2024. The speed of news in Twitter (X) versus radio. Scientific Reports 14, 1 (2024), 11939.
Ceren Budak, Brendan Nyhan, David M Rothschild, Emily Thorson, and Duncan J Watts. 2024. Misunderstanding the harms of online misinformation. Nature 630, 8015 (2024), 45-53.
Sabur Butt, Shakshi Sharma, Rajesh Sharma, Grigori Sidorov, and Alexander Gelbukh. 2022. What goes on inside rumour and non-rumour tweets and their reactions: A psycholinguistic analyses. Computers in Human Behavior 135 (2022), 107345.
Dominik Bär, Nicolas Pröllochs, and Stefan Feuerriegel. 2023. New threats to society from free-speech social media platforms. Commun. ACM 66, 10 (2023), 37-40.
Jose Camacho-collados, Kiamehr Rezaee, Talayeh Riahi, Asahi Ushio, Daniel Loureiro, Dimosthenis Antypas, Joanne Boisson, Luis Espinosa Anke, Fangyu Liu, and Eugenio Martínez Cámara. 2022. TweetNLP: Cutting-edge natural language processing for social media. In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing: System Demonstrations. 38-49.
Matias D Cattaneo and Rocio Titiunik. 2022. Regression discontinuity designs. Annual Review of Economics 14, 1 (2022), 821-851.
Yuwei Chuai, Yutian Chang, and Jichang Zhao. 2022. What really drives the spread of COVID-19 Tweets: A revisit from perspective of content. In 2022 IEEE 9th International Conference on Data Science and Advanced Analytics. 1-10.
Yuwei Chuai, Moritz Pilarski, Gabriele Lenzini, and Nicolas Pröllochs. 2024. Community notes reduce the spread of misleading posts on X. OSF (2024).
Yuwei Chuai, Moritz Pilarski, Thomas Renault, David Restrepo-Amariles, Aurore Troussel-Clément, Gabriele Lenzini, and Nicolas Pröllochs. 2024. Communitybased fact-checking reduces the spread of misleading posts on social media. ArXiv (2024).
Yuwei Chuai, Haoye Tian, Nicolas Pröllochs, and Gabriele Lenzini. 2024. Did the roll-out of Community Notes reduce engagement with misinformation on X/Twitter? Proceedings of the ACM on Human-Computer Interaction 8, CSCW2 (2024), 1-52.
Yuwei Chuai and Jichang Zhao. 2022. Anger can make fake news viral online. Frontiers in Physics 10 (2022), 970174.
Yuwei Chuai, Jichang Zhao, and Gabriele Lenzini. 2024. From news sharers to post viewers: How topic diversity and conspiracy theories shape engagement with misinformation during a health crisis? ArXiv (2024).
Yuwei Chuai, Jichang Zhao, Nicolas Pröllochs, and Gabriele Lenzini. 2025. Is fact-checking politically neutral? Asymmetries in how U.S. fact-checking organizations pick up false statements mentioning political elites. In Proceedings of the International AAAI Conference on Web and Social Media, Vol. forthcoming.
Matteo Cinelli, Gianmarco De Francisci Morales, Alessandro Galeazzi, Walter Quattrociocchi, and Michele Starnini. 2021. The echo chamber effect on social media. Proceedings of the National Academy of Sciences 118, 9 (2021), e2023301118.
Katherine Clayton, Spencer Blair, Jonathan A Busam, Samuel Forstner, John Glance, Guy Green, Anna Kawata, Akhila Kovvuri, Jonathan Martin, Evan Morgan, et al. 2020. Real solutions for fake news? Measuring the effectiveness of general warnings and fact-check tags in reducing belief in false stories on social media. Political Behavior 42 (2020), 1073-1095.
Jonas Colliander. 2019. "This is fake news": Investigating the role of conformity to other users' views when commenting on and spreading disinformation in social media. Computers in Human Behavior 97 (2019), 202-215.
Molly J Crockett. 2017. Moral outrage in the digital age. Nature Human Behaviour 1, 11 (2017), 769-771.
Ross Dahlke and Jeffrey Hancock. 2024. Effects of misinformation on election beliefs: Disentangling motivated reasoning from selective exposure. OSF (2024).
Michela Del Vicario, Gianna Vivaldo, Alessandro Bessi, Fabiana Zollo, Antonio Scala, Guido Caldarelli, and Walter Quattrociocchi. 2016. Echo chambers: Emotional contagion and group polarization on facebook. Scientific Reports 6, 1 (2016), 37825.
Deloitte. 2021. Are younger generations moving away from traditional news sources? https://www.forbes.com/sites/kenrapoza/2017/02/26/can-fake-newsimpact-the-stock-market/.
Joan Donovan. 2020. Social-media companies must flatten the curve of misinformation. Nature (2020).
Chiara Patricia Drolsbach and Nicolas Pröllochs. 2023. Diffusion of community fact-checked misinformation on Twitter. Proceedings of the ACM on HumanComputer Interaction 7, CSCW2 (2023), 1-22.
Chiara Patricia Drolsbach and Nicolas Pröllochs. 2024. Content moderation on social media in the EU: Insights from the DSA Transparency Database. In Companion Proceedings of the ACM on Web Conference 2024. 939-942.
Chiara Patricia Drolsbach and Nicolas Pröllochs. 2023. Believability and harmfulness shape the virality of misleading social media posts. In Proceedings of the ACM Web Conference 2023. 4172-4177.
Chiara Patricia Drolsbach, Kirill Solovev, and Nicolas Pröllochs. 2024. Community notes increase trust in fact-checking on social media. PNAS Nexus 3, 7 (2024), pgae217.
Ullrich Ecker, Jon Roozenbeek, Sander van der Linden, Li Qian Tay, John Cook, Naomi Oreskes, and Stephan Lewandowsky. 2024. Misinformation poses a bigger threat to democracy than you might think. Nature 630, 8015 (2024), 29-32.
Ullrich KH Ecker, Stephan Lewandowsky, John Cook, Philipp Schmid, Lisa K Fazio, Nadia Brashier, Panayiota Kendeou, Emily K Vraga, and Michelle A Amazeen. 2022. The psychological drivers of misinformation belief and its resistance to correction. Nature Reviews Psychology 1, 1 (2022), 13-29.
Alexandros Efstratiou and Emiliano De Cristofaro. 2022. Adherence to misinformation on social media through socio-cognitive and group-based processes. Proceedings of the ACM on Human-Computer Interaction 6, CSCW2 (2022), 1-35.
Paul Ekman. 1992. An argument for basic emotions. Cognition & Emotion 6, 3-4 (1992), 169-200.
Paul Ekman, Wallace V Friesen, and Phoebe Ellsworth. 2013. Emotion in the human face: Guidelines for research and an integration of findings. Vol. 11. Elsevier.
Adam M. Enders, Joseph Uscinski, Casey Klofstad, and Justin Stoler. 2022. On the relationship between conspiracy theory beliefs, misinformation, and vaccine hesitancy. PLoS ONE 17, 10 (2022), e0276082.
Ziv Epstein, Gordon Pennycook, and David Rand. 2020. Will the crowd game the algorithm? Using layperson judgments to combat misinformation on social media by downranking distrusted sources. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1-11.
Morten W Fagerland. 2012. T-tests, non-parametric tests, and large studies-a paradox of statistical practice? BMC Medical Research Methodology 12 (2012), 1-7.
Stefan Feuerriegel, Renée DiResta, Josh A Goldstein, Srijan Kumar, Philipp Lorenz-Spreen, Michael Tomz, and Nicolas Pröllochs. 2023. Research can help to tackle AI-generated disinformation. Nature Human Behaviour 7, 11 (2023), 1818-1821.
Stefan Feuerriegel, Abdurahman Maarouf, Dominik Bär, Dominique Geissler, Jonas Schweisthal, Nicolas Pröllochs, Claire E Robertson, Steve Rathje, Jochen Hartmann, Saif M Mohammad, Oded Netzer, Alexandra Siegel, Barbara Plank, and Van Bavel Jay. 2025. Using natural language processing to analyse text data in behavioural science. Nature Reviews Psychology forthcoming (2025).
Daniela Flamini. 2019. Most Republicans don't trust fact-checkers, and most Americans don't trust the media. https://www.poynter.org/ifcn/2019/mostrepublicans-dont-trust-fact-checkers-and-most-americans-dont-trust-themedia/.
World Economic Forum. 2024. Global risks report. https://www.weforum.org/publications/global-risks-report-2024/.
Felix Gaisbauer, Armin Pournaki, Sven Banisch, and Eckehard Olbrich. 2021. Ideological differences in engagement in public debate on Twitter. PLoS ONE 16, 3 (2021), e0249241.
Dilrukshi Gamage, Piyush Ghasiya, Vamshi Bonagiri, Mark E Whiting, and Kazutoshi Sasahara. 2022. Are deepfakes concerning? Analyzing conversations of deepfakes on reddit and exploring societal implications. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. 1-19.
Amit Goldenberg and James J Gross. 2020. Digital emotion contagion. Trends in Cognitive Sciences 24, 4 (2020), 316-328.
Jon Green, William Hobbs, Stefan McCabe, and David Lazer. 2022. Online engagement with 2020 election misinformation and turnout in the 2021 Georgia runoff election. Proceedings of the National Academy of Sciences 119, 34 (2022), e2115900119.
Jonathan Haidt et al. 2003. The moral emotions. Handbook of Affective Sciences 11, 2003 (2003), 852-870.
Md Mahfuzul Haque, Mohammad Yousuf, Ahmed Shatil Alam, Pratyasha Saha, Syed Ishtiaque Ahmed, and Naeemul Hassan. 2020. Combating misinformation in Bangladesh: Roles and responsibilities as perceived by journalists, factcheckers, and users. Proceedings of the ACM on Human-Computer Interaction 4, CSCW2 (2020), 1-32.
P Sol Hart, Sedona Chinn, and Stuart Soroka. 2020. Politicization and polarization in COVID-19 news coverage. Science Communication 42, 5 (2020), 679-697.
Jochen Hartmann. 2022. Emotion english DistilRoBERTa-base. https:// huggingface.co/j-hartmann/emotion-english-distilroberta-base/.
Amelia Hassoun, Ian Beacock, Sunny Consolvo, Beth Goldberg, Patrick Gage Kelley, and Daniel M Russell. 2023. Practicing information sensibility: How Gen Z engages with online information. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1-17.
Catherine Hausman and David S Rapson. 2018. Regression discontinuity in time: Considerations for empirical applications. Annual Review of Resource Economics 10, 1 (2018), 533-552.
Hendrik Heuer and Elena Leah Glassman. 2022. A comparative evaluation of interventions against misinformation: Augmenting the WHO checklist. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. 1-21.
Clayton Hutto and Eric Gilbert. 2014. VADER: A parsimonious rule-based model for sentiment analysis of social media text. In Proceedings of the International AAAI Conference on Web and Social Media, Vol. 8. 216-225.
Guido W Imbens and Thomas Lemieux. 2008. Regression discontinuity designs: A guide to practice. Journal of Econometrics 142, 2 (2008), 615-635.
Farnaz Jahanbakhsh and David R Karger. 2024. A browser extension for in-place signaling and assessment of misinformation. In Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems. 1-21.
Johannes Jakubik, Michael Vössing, Nicolas Pröllochs, Dominik Bär, and Stefan Feuerriegel. 2023. Online emotions during the storming of the US Capitol: Evidence from the social media network Parler. In Proceedings of the International AAAI Conference on Web and Social Media, Vol. 17. 423-434.
Prerna Juneja, Md Momen Bhuiyan, and Tanushree Mitra. 2023. Assessing enactment of content regulation policies: A post hoc crowd-sourced audit of election misinformation on YouTube. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1-22.
Naveena Karusala and Richard Anderson. 2022. Towards conviviality in navigating health information on social media. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. 1-14.
Luke Keele and Nathan J Kelly. 2006. Dynamic models for dynamic theories: The ins and outs of lagged dependent variables. Political Analysis 14, 2 (2006), 186-205.
Jaehong Kim, Chaeyoon Jeong, Seongchan Park, Meeyoung Cha, and Wonjae Lee. 2024. How do moral emotions shape political participation? A cross-cultural analysis of online petitions using language models. In Findings of the Association for Computational Linguistics ACL 2024. 16274-16289.
Anastasia Kozyreva, Stefan M Herzog, Stephan Lewandowsky, Ralph Hertwig, Philipp Lorenz-Spreen, Mark Leiser, and Jason Reifler. 2023. Resolving content moderation dilemmas between free speech and harmful misinformation. Proceedings of the National Academy of Sciences 120, 7 (2023), e2210666120.
Adam DI Kramer, Jamie E Guillory, and Jeffrey T Hancock. 2014. Experimental evidence of massive-scale emotional contagion through social networks. Proceedings of the National Academy of Sciences 111, 24 (2014), 8788-8790.
David MJ Lazer, Matthew A Baum, Yochai Benkler, Adam J Berinsky, Kelly M Greenhill, Filippo Menczer, Miriam J Metzger, Brendan Nyhan, Gordon Pennycook, David Rothschild, and others. 2018. The science of fake news. Science 359, 6380 (2018), 1094-1096.
Sian Lee, Aiping Xiong, Haeseung Seo, and Dongwon Lee. 2023. "Fact-checking" fact checkers: A data-driven approach. Harvard Kennedy School Misinformation Review (2023).
Jennifer S Lerner, Ye Li, Piercarlo Valdesolo, and Karim S Kassam. 2015. Emotion and decision making. Annual Review of Psychology 66, 1 (2015), 799-823.
Daniel Loureiro, Francesco Barbieri, Leonardo Neves, Luis Espinosa Anke, and Jose Camacho-collados. 2022. TimeLMs: Diachronic language models from Twitter. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics: System Demonstrations. 251-260.
Thomas Lumley, Paula Diehr, Scott Emerson, and Lu Chen. 2002. The importance of the normality assumption in large public health data sets. Annual Review of Public Health 23, 1 (2002), 151-169.
Cameron Martel, Gordon Pennycook, and David G Rand. 2020. Reliance on emotion promotes belief in fake news. Cognitive Research: Principles and Implications 5 (2020), 1-20.
Melinda McClure Haughey, Martina Povolo, and Kate Starbird. 2022. Bridging contextual and methodological gaps on the "misinformation beat": Insights from journalist-researcher collaborations at speed. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. 1-15.
Killian L McLoughlin, William J Brady, Aden Goolsbee, Ben Kaiser, Kate Klonick, and MJ Crockett. 2024. Misinformation exploits outrage to spread online. Science 386, 6725 (2024), 991-996.
Nicholas Micallef, Vivienne Armacost, Nasir Memon, and Sameer Patil. 2022. True or false: Studying the work practices of professional fact-checkers. Proceedings of the ACM on Human-Computer Interaction 6, CSCW1 (2022), 1-44.
Nicholas Micallef, Bing He, Srijan Kumar, Mustaque Ahamad, and Nasir Memon. 2020. The role of the crowd in countering misinformation: A case study of the COVID-19 infodemic. In 2020 IEEE International Conference on Big Data. 748-757.
Saif M. Mohammad and Peter D. Turney. 2013. Crowdsourcing a word-emotion association lexicon. Computational Intelligence 29, 3 (2013), 436-465.
Catherine Molho, Joshua M Tybur, Ezgi Güler, Daniel Balliet, and Wilhelm Hofmann. 2017. Disgust and anger relate to different aggressive responses to moral violations. Psychological Science 28, 5 (2017), 609-619.
Mohsen Mosleh, Cameron Martel, Dean Eckles, and David Rand. 2021. Perverse downstream consequences of debunking: Being corrected by another user for posting false political news increases subsequent sharing of low quality, partisan, and toxic content in a Twitter field experiment. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1-13.
Dominik Neumann and Nancy Rhodes. 2024. Morality in social media: A scoping review. New Media & Society 26, 2 (2024), 1096-1126.
Society of Professional Journalists. 2014. Code of ethics. https://www.spj.org/ ethicscode.asp
Mathias Osmundsen, Alexander Bor, Peter Bjerregaard Vahlstrup, Anja Bechmann, and Michael Bang Petersen. 2021. Partisan polarization is the primary psychological motivation behind political fake news sharing on Twitter. American Political Science Review 115, 3 (2021), 999-1015.
Bo Pang, Lillian Lee, et al. 2008. Opinion mining and sentiment analysis. Foundations and Trends in Information Retrieval 2, 1-2 (2008), 1-135.
Kun Peng, Yu Zheng, Yuewei Qiu, and Qingrui Li. 2023. Rage of righteousness: Anger's role in promoting debunking effects during the COVID-19 pandemic. Computers in Human Behavior 148 (2023), 107896.
Gordon Pennycook and David G Rand. 2019. Fighting misinformation on social media using crowdsourced judgments of news source quality. Proceedings of the National Academy of Sciences 116, 7 (2019), 2521-2526.
Francesco Pierri, Brea L. Perry, Matthew R. DeVerna, Kai-Cheng Yang, Alessandro Flammini, Filippo Menczer, and John Bryden. 2022. Online misinformation is linked to early COVID-19 vaccination hesitancy and refusal. Scientific Reports 12, 1 (2022), 5966.
Moritz Pilarski, Kirill Olegovich Solovev, and Nicolas Pröllochs. 2024. Community Notes vs. Snoping: How the crowd selects fact-checking targets on social media. In Proceedings of the International AAAI Conference on Web and Social Media, Vol. 18. 1262-1275.
Ethan Porter and Thomas J Wood. 2021. The global effectiveness of fact-checking: Evidence from simultaneous experiments in Argentina, Nigeria, South Africa, and the United Kingdom. Proceedings of the National Academy of Sciences 118, 37 (2021), e2104235118.
Nicolas Pröllochs, Dominik Bär, and Stefan Feuerriegel. 2021. Emotions explain differences in the diffusion of true vs. false social media rumors. Scientific Reports 11, 1 (2021), 22721.
Nicolas Pröllochs. 2022. Community-based fact-checking on Twitter's Birdwatch platform. In Proceedings of the International AAAI Conference on Web and Social Media, Vol. 16. 794-805.
Steve Rathje, Jay J. Van Bavel, and Sander van der Linden. 2021. Out-group animosity drives engagement on social media. Proceedings of the National Academy of Sciences 118, 26 (2021), e2024292118.
Raquel Recuero, Felipe Bonow Soares, and Anatoliy Gruzd. 2020. Hyperpartisanship, disinformation and political conversations on Twitter: The Brazilian presidential election of 2018. In Proceedings of the International AAAI Conference on Web and Social Media, Vol. 14. 569-578.
Thomas Renault, David Restrepo Amariles, and Aurore Troussel. 2024. Collaboratively adding context to social media posts reduces the sharing of false news. ArXiv (2024).
Manoel Horta Ribeiro, Robert West, Ryan Lewis, and Sanjay Kairam. 2025. Post guidance for online communities. Proceedings of the ACM on Human-Computer Interaction forthcoming (2025).
Claire E Robertson, Nicolas Pröllochs, Kaoru Schwarzenegger, Philip Pärnamets, Jay J Van Bavel, and Stefan Feuerriegel. 2023. Negativity drives online news consumption. Nature Human Behaviour 7, 5 (2023), 812-822.
Hannes Rosenbusch, Anthony M Evans, and Marcel Zeelenberg. 2019. Multilevel emotion transfer on YouTube: Disentangling the effects of emotional contagion and homophily on video audiences. Social Psychological and Personality Science 10, 8 (2019), 1028-1035.
Katja Rost, Lea Stahel, and Bruno S Frey. 2016. Digital social norm enforcement: Online firestorms in social media. PLoS ONE 11, 6 (2016), e0155923.
David Rozado, Ruth Hughes, and Jamin Halberstadt. 2022. Longitudinal analysis of sentiment and emotion in news media headlines using automated labelling with Transformer language models. PLoS ONE 17, 10 (2022), e0276367.
Mohammed Saeed, Nicolas Traub, Maelle Nicolas, Gianluca Demartini, and Paolo Papotti. 2022. Crowdsourced fact-checking at Twitter: How does the crowd compare with experts?. In Proceedings of the 31st ACM International Conference on Information & Knowledge Management. 1736-1746.
Jessica M Salerno and Liana C Peter-Hagene. 2013. The interactive effect of anger and disgust on moral outrage and judgments. Psychological Science 24, 10 (2013), 2069-2078.
Yoonmo Sang, Jee Young Lee, Sora Park, Caroline Fisher, and Glen Fuller. 2020. Signalling and expressive interaction: Online news users' different modes of interaction on digital platforms. Digital Journalism 8, 4 (2020), 467-485.
Disa A Sauter, Frank Eisner, Paul Ekman, and Sophie K Scott. 2010. Cross-cultural recognition of basic emotions through nonverbal emotional vocalizations. Proceedings of the National Academy of Sciences 107, 6 (2010), 2408-2412.
Brennan Schaffner, Arjun Nitin Bhagoji, Siyuan Cheng, Jacqueline Mei, Jay L Shen, Grace Wang, Marshini Chetty, Nick Feamster, Genevieve Lakier, and Chenhao Tan. 2024. "Community guidelines make this the best party on the internet": An in-depth study of online platforms' content moderation policies. In Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems. 1-16.
Zakir Shah, Jianxun Chu, Sara Qaisar, Zameer Hassan, and Usman Ghani. 2020. Perceived public condemnation and avoidance intentions: The mediating role of moral outrage. Journal of Public Affairs 20, 1 (2020), e2027.
Leah M Smith, Linda E Lévesque, Jay S Kaufman, and Erin C Strumpf. 2017. Strategies for evaluating the assumptions of the regression discontinuity design: A case study using a human papillomavirus vaccination programme. International Journal of Epidemiology 46, 3 (2017), 939-949.
Kirill Solovev and Nicolas Pröllochs. 2023. Moralized language predicts hate speech on social media. PNAS Nexus 2, 1 (2023), pgac281.
Kirill Solovev and Nicolas Pröllochs. 2022. Moral emotions shape the virality of COVID-19 misinformation on social media. In Proceedings of the ACM Web Conference 2022. 3706-3717.
SSRS. 2023. CNN Poll on Biden, economy and elections. https://www.documentcloud.org/documents/23895856-cnn-poll-on-bideneconomy-and-elections.
Statista. 2024. Number of internet and social media users worldwide as of July 2024. https://www.statista.com/statistics/617136/digital-populationworldwide/.
Stefan Stieglitz and Linh Dang-Xuan. 2013. Emotions and information diffusion in social media-sentiment of microblogs and sharing behavior. Journal of Management Information Systems 29, 4 (2013), 217-248.
Wienke Strathern, Mirco Schoenfeld, Raji Ghawi, and Juergen Pfeffer. 2020. Against the others! Detecting moral outrage in social media networks. In 2020 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining. 322-326.
Huiyun Tang, Gabriele Lenzini, Samuel Greiff, Björn Rohles, and Anastasia Sergeeva. 2024. "Who knows? Maybe it really works": Analysing users' perceptions of health misinformation on social media. In Proceedings of the 2024 ACM Designing Interactive Systems Conference. 1499-1517.
Jay J Van Bavel, Claire E Robertson, Kareena Del Rosario, Jesper Rasmussen, and Steve Rathje. 2024. Social media and morality. Annual Review of Psychology 75, 1 (2024), 311-340.
Julie Van de Vyver and Dominic Abrams. 2015. Testing the prosocial effectiveness of the prototypical moral emotions: Elevation increases benevolent behaviors and outrage increases justice behaviors. Journal of Experimental Social Psychology 58 (2015), 23-33.
Frances van der Eijk and Simon Columbus. 2023. Expressions of moral disgust reflect both disgust and anger. Cognition and Emotion 37, 3 (2023), 499-514.
Rama Adithya Varanasi, Joyojeet Pal, and Aditya Vashistha. 2022. Accost, accede, or amplify: Attitudes towards COVID-19 misinformation on WhatsApp in India. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. 1-17.
Soroush Vosoughi, Deb Roy, and Sinan Aral. 2018. The spread of true and false news online. Science 359, 6380 (2018), 1146-1151.
Senuri Wijenayake, Danula Hettiachchi, Simo Hosio, Vassilis Kostakos, and Jorge Goncalves. 2020. Effect of conformity on perceived trustworthiness of news in social media. IEEE Internet Computing 25, 1 (2020), 12-19.
Tamar Wilner, Kayo Mimizuka, Ayesha Bhimdiwala, Jason C Young, and Ahmer Arif. 2023. It's about time: Attending to temporality in misinformation interventions. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1-19.
Stefan Wojcik, Sophie Hilgard, Nick Judd, Delia Mocanu, Stephen Ragain, MB Hunzaker, Keith Coleman, and Jay Baxter. 2022. Birdwatch: Crowd wisdom and bridging algorithms can inform understanding and reduce the spread of misinformation. ArXiv (2022).
X. 2024. About replies and mentions. https://help.x.com/en/using-x/mentionsand-replies
Ali Yadollahi, Ameneh Gholipour Shahraki, and Osmar R Zaiane. 2017. Current state of text sentiment analysis from opinion to emotion mining. ACM Computing Surveys (CSUR) 50, 2 (2017), 1-33.
Waheeb Yaqub, Otari Kakhidze, Morgan L Brockman, Nasir Memon, and Sameer Patil. 2020. Effects of credibility indicators on social media news sharing intent. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1-14.
YouTube. 2024. Testing new ways to offer viewers more context and information on videos. https://blog.youtube/news-and-events/new-ways-to-offer-viewersmore-context/
Himanshu Zade, Spencer Williams, Theresa T Tran, Christina Smith, Sukrit Venkatagiri, Gary Hsieh, and Kate Starbird. 2024. To reply or to quote: Comparing conversational framing strategies on Twitter. ACM Journal on Computing and Sustainable Societies 2, 1 (2024), 1-27.
Yixuan Zhang, Joseph D Gaggiano, Nutchanon Yongsatianchot, Nurul M Suhaimi, Miso Kim, Yifan Sun, Jacqueline Griffin, and Andrea G Parker. 2023. What do we mean when we talk about trust in social media? A systematic review. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1-22.
Yixuan Zhang, Yimeng Wang, Nutchanon Yongsatianchot, Joseph D Gaggiano, Nurul M Suhaimi, Anne Okrah, Miso Kim, Jacqueline Griffin, and Andrea G Parker. 2024. Profiling the dynamics of trust & distrust in social media: A survey study. In Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems. 1-24.
Jiawei Zhou, Yixuan Zhang, Qianni Luo, Andrea G Parker, and Munmun De Choudhury. 2023. Synthetic lies: Understanding AI-generated misinformation and evaluating algorithmic and human solutions. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1-20.
Fabiana Zollo, Petra Kralj Novak, Michela Del Vicario, Alessandro Bessi, Igor Mozetic, Antonio Scala, Guido Caldarelli, and Walter Quattrociocchi. 2015. Emotional dynamics in the age of misinformation. PLoS ONE 10, 9 (2015), e0138740.
