class: center, middle, inverse, title-slide .title[ #
Misinformation Exposure Beyond Traditional Feeds: Evidence from a WhatsApp Deactivation Experiment
] .author[ ### Tiago Ventura, Rajeshwari Majumdar, Jonathan Nagler, and Joshua A. Tucker
Georgetown University & Center for Social Media and Politics, NYU
] .date[ ###
DISINFORMATION, [SOCIAL] MEDIA WAR: Data, Actors, Processes & Impacts
] --- layout: true <div class="my-footer"><span>Tiago Ventura (Georgetown University)                                               </span></div> --- class:middle <img src="nyt.png" width="100%" /> --- class:middle ## Research on Social Media and its effects - Existing research: focused primarily on feed-based platforms that are popular in advanced democracies (Twitter, Facebook) - But in the Global South - The types of social media platforms that are predominantly used are fundamentally different (message-based; WhatsApp) - Different affordances/platforms shapes the types of misinformation that is more prevalent - Over 80% of existing studies on interventions to correct misinformation focus on Global North countries .midgrey[(Blair et. al. 2023, Badrinathan and Chauchard, 2023)] - The harmful offline consequences of misinformation exposure may be more pronounced --- <br> <br> <br> <br> <br> <br> <br> <br> .content-box-gray[Identify the causal effects of **.red[WhatsApp usage]** on **.red[exposure to online rumors]** and its downstream effects on **.red[belief accuracy]** and **.red[political attitudes]**] --- class: middle ## Deactivation Studies .center[ <img src="deactivation_studies.png" width="90%" /> ] .pull-left[ .center[Facebook Deactivation in the US [(Alcott et al., 2020)](https://www.aeaweb.org/articles?id=10.1257/aer.20190658)] ] .pull-right[ .center[Facebook Deactivation in Bosnia and Herzegovina [(Asimovic et. al, 2022)](https://www.pnas.org/doi/10.1073/pnas.2022819118)] ] --- class: middle ### Our Experiment <svg viewBox="0 0 512 512" style="height:1em;position:relative;display:inline-block;top:.1em;" xmlns="http://www.w3.org/2000/svg"> <path d="M504 256C504 119 393 8 256 8S8 119 8 256s111 248 248 248 248-111 248-248zm-448 0c0-110.5 89.5-200 200-200s200 89.5 200 200-89.5 200-200 200S56 366.5 56 256zm72 20v-40c0-6.6 5.4-12 12-12h116v-67c0-10.7 12.9-16 20.5-8.5l99 99c4.7 4.7 4.7 12.3 0 17l-99 99c-7.6 7.6-20.5 2.2-20.5-8.5v-67H140c-6.6 0-12-5.4-12-12z"></path></svg> **Problem**: Fully deactivating WhatsApp is neither possible nor ideal <svg viewBox="0 0 512 512" style="height:1em;position:relative;display:inline-block;top:.1em;" xmlns="http://www.w3.org/2000/svg"> <path d="M504 256C504 119 393 8 256 8S8 119 8 256s111 248 248 248 248-111 248-248zm-448 0c0-110.5 89.5-200 200-200s200 89.5 200 200-89.5 200-200 200S56 366.5 56 256zm72 20v-40c0-6.6 5.4-12 12-12h116v-67c0-10.7 12.9-16 20.5-8.5l99 99c4.7 4.7 4.7 12.3 0 17l-99 99c-7.6 7.6-20.5 2.2-20.5-8.5v-67H140c-6.6 0-12-5.4-12-12z"></path></svg> **Our Design:** Cut the primary channels through which users are exposed to misinformation and polarizing content: videos, images and audios .midgrey[(Machado et al., 2019; Resende et al., 2019; Garimella and Tyson, 2018; Garimella and Eckles, 2020; Batista Pereira et al., 2023).] <svg viewBox="0 0 512 512" style="height:1em;position:relative;display:inline-block;top:.1em;" xmlns="http://www.w3.org/2000/svg"> <path d="M504 256C504 119 393 8 256 8S8 119 8 256s111 248 248 248 248-111 248-248zm-448 0c0-110.5 89.5-200 200-200s200 89.5 200 200-89.5 200-200 200S56 366.5 56 256zm72 20v-40c0-6.6 5.4-12 12-12h116v-67c0-10.7 12.9-16 20.5-8.5l99 99c4.7 4.7 4.7 12.3 0 17l-99 99c-7.6 7.6-20.5 2.2-20.5-8.5v-67H140c-6.6 0-12-5.4-12-12z"></path></svg> **Experiment:** Offer respondents a monetary incentive to - Disable their automatic download of media on WhatsApp. - Do not purposefully click and watch any media on WhatsApp. <svg viewBox="0 0 512 512" style="height:1em;position:relative;display:inline-block;top:.1em;" xmlns="http://www.w3.org/2000/svg"> <path d="M504 256C504 119 393 8 256 8S8 119 8 256s111 248 248 248 248-111 248-248zm-448 0c0-110.5 89.5-200 200-200s200 89.5 200 200-89.5 200-200 200S56 366.5 56 256zm72 20v-40c0-6.6 5.4-12 12-12h116v-67c0-10.7 12.9-16 20.5-8.5l99 99c4.7 4.7 4.7 12.3 0 17l-99 99c-7.6 7.6-20.5 2.2-20.5-8.5v-67H140c-6.6 0-12-5.4-12-12z"></path></svg> **Treatment Period:** Three weeks: - **Start:** Three weeks before general election in Brazil. - **End:** three days after the voting day. --- class:middle, center, inverse # Overview of the Experiment --- class:middle .center[ <img src="output/research_design.png" width="120%" /> ] --- class:middle ## Recruitment **Method:** Facebook Ads targeting adults Brazil **Started Recruitment:** September 8th **Number of respondents:** 1,947 **Screening variables:** + Willingness to join: .red[1,8861 participants] + More 5min WhatsApp daily + Only WhatsApp mobile + More than 2 min to complete recruitment + other quality controls --- class:middle ## Treatment Assignment **Start**: September 15. **Treatment**: - Turn off the automatic download. - Three .red[weeks] without consuming any multimedia. **Control**: Three .red[days] without consuming any multimedia. **Invited**: 1,135 respondents **Enrolled**: 773 respondents --- ## Deactivation .center[ <img src="./output/iphone_deact.jpeg" width="40%" /> ] --- ## Intervention .center[ <img src="./blur.jpg" width="60%" /> ] --- class:middle ## Compliance **Compliance Tasks:** - Screenshots of WhatsApp storage intormation - Every week + final survey - After the first compliance check, the control group was re-activated --- class:middle ## Compliance II .center[ <img src="./output/iphone_compliance.jpeg" width="40%" /> ] --- class:middle ## Outcomes **Self-Reported Exposure and Accuracy Judgment** - False Rumors published on fact-checking webpages during the month of the experiment + True News stories headlines from mainstream media. **Polarization** - Affective polarization (Feeling Thermometer). - Social Polarization (Willingness to engage with outgroup voter). - Issue Polarization (Abortion, gun control, etc..). - Perceptions about ideological polarization ('Where do I observe the two main candidates?'). **Subjective Well-being** - How did you feel for the past three weeks? (Happy, Anxious, etc...). --- class: center, middle, inverse # Results --- ### First-Stage Results .center[ <img src="./output/models_compliance.png" width="90%" /> ] --- ### Effects on Exposure to Misinformation Rumors (H1) .center[ <img src="./output/exposure_h1.png" width="90%" /> ] --- ### Reduction in exposure is large for false news (H1) .center[ <img src="./output/difference_true_false_exposure.png" width="90%" /> ] --- ### Effects on Belief Accuracy (H2) .center[ <img src="./output/belief_accuracy_h2.png" width="90%" /> ] --- ### Effects on Polarization & Subjective Well-Being (H3 & H4) .center[ <img src="./output/pol_sw_index.png" width="90%" /> ] --- class: middle, inverse, center ## Additional Analyses (Non Pre-Registered) --- ### Exposure and Partisanship .center[ <img src="output/sif_exposure_bothparties_counter_pro.png" width="90%" /> ] --- ### Belief Accuracy Conditional on WhatsApp usage for Politics .center[ <img src="output/sif_het_use_whatsapp_fac.png" width="90%" /> ] --- ### Polarization Outcomes .center[ <img src="output/pol_outcomes.png" width="90%" /> ] --- class: middle ## Discussion <svg viewBox="0 0 512 512" style="height:1em;position:relative;display:inline-block;top:.1em;" xmlns="http://www.w3.org/2000/svg"> <path d="M504 256C504 119 393 8 256 8S8 119 8 256s111 248 248 248 248-111 248-248zm-448 0c0-110.5 89.5-200 200-200s200 89.5 200 200-89.5 200-200 200S56 366.5 56 256zm72 20v-40c0-6.6 5.4-12 12-12h116v-67c0-10.7 12.9-16 20.5-8.5l99 99c4.7 4.7 4.7 12.3 0 17l-99 99c-7.6 7.6-20.5 2.2-20.5-8.5v-67H140c-6.6 0-12-5.4-12-12z"></path></svg> **WhatsApp is an important vector through which voters receive misinformation in Brazil at .red[a higher rate] compared to true news.** <svg viewBox="0 0 512 512" style="height:1em;position:relative;display:inline-block;top:.1em;" xmlns="http://www.w3.org/2000/svg"> <path d="M504 256C504 119 393 8 256 8S8 119 8 256s111 248 248 248 248-111 248-248zm-448 0c0-110.5 89.5-200 200-200s200 89.5 200 200-89.5 200-200 200S56 366.5 56 256zm72 20v-40c0-6.6 5.4-12 12-12h116v-67c0-10.7 12.9-16 20.5-8.5l99 99c4.7 4.7 4.7 12.3 0 17l-99 99c-7.6 7.6-20.5 2.2-20.5-8.5v-67H140c-6.6 0-12-5.4-12-12z"></path></svg> **The null results provide support for a .red[minimalist view of the short-term causal effects] of exposure to misinformation on WhatsApp on political attitudes.** <svg viewBox="0 0 512 512" style="height:1em;position:relative;display:inline-block;top:.1em;" xmlns="http://www.w3.org/2000/svg"> <path d="M504 256C504 119 393 8 256 8S8 119 8 256s111 248 248 248 248-111 248-248zm-448 0c0-110.5 89.5-200 200-200s200 89.5 200 200-89.5 200-200 200S56 366.5 56 256zm72 20v-40c0-6.6 5.4-12 12-12h116v-67c0-10.7 12.9-16 20.5-8.5l99 99c4.7 4.7 4.7 12.3 0 17l-99 99c-7.6 7.6-20.5 2.2-20.5-8.5v-67H140c-6.6 0-12-5.4-12-12z"></path></svg> **Exposure to misinformation .red[does not] mechanically affect attitudes** --- class: middle ### Next Steps <svg viewBox="0 0 512 512" style="height:1em;position:relative;display:inline-block;top:.1em;" xmlns="http://www.w3.org/2000/svg"> <path d="M504 256C504 119 393 8 256 8S8 119 8 256s111 248 248 248 248-111 248-248zm-448 0c0-110.5 89.5-200 200-200s200 89.5 200 200-89.5 200-200 200S56 366.5 56 256zm72 20v-40c0-6.6 5.4-12 12-12h116v-67c0-10.7 12.9-16 20.5-8.5l99 99c4.7 4.7 4.7 12.3 0 17l-99 99c-7.6 7.6-20.5 2.2-20.5-8.5v-67H140c-6.6 0-12-5.4-12-12z"></path></svg> **Multicountry Deactivation Experiment**: Currently running a multi-country replication of this experiment. - **Where:** Three major Global South Democracies: India, South Africa and Brazil. - **Interventions:** Two distinct interventions - Multimedia Deactivation and Time Reduction. - **Fours weeks** before national elections in India and South Africa and local elections in Brazil. - Follow-up survey **two weeks after participants** return to social media. <svg viewBox="0 0 512 512" style="height:1em;position:relative;display:inline-block;top:.1em;" xmlns="http://www.w3.org/2000/svg"> <path d="M504 256C504 119 393 8 256 8S8 119 8 256s111 248 248 248 248-111 248-248zm-448 0c0-110.5 89.5-200 200-200s200 89.5 200 200-89.5 200-200 200S56 366.5 56 256zm72 20v-40c0-6.6 5.4-12 12-12h116v-67c0-10.7 12.9-16 20.5-8.5l99 99c4.7 4.7 4.7 12.3 0 17l-99 99c-7.6 7.6-20.5 2.2-20.5-8.5v-67H140c-6.6 0-12-5.4-12-12z"></path></svg> **Data Donation Pipeline for WhatsApp Data** --- class:middle, center, inverse # Thank you!