class: center, middle, inverse, title-slide .title[ #
WhatsApp increases exposure to false rumors but has limited effects on beliefs and polarization: Evidence from a multimedia constrained deactivation experiment
] .author[ ### Tiago Ventura, Rajeshwari Majumdar, Jonathan Nagler, and Joshua A. Tucker
Center for Social Media and Politics, NYU
] .date[ ###
CSMaP Conference
04/15/2023
] --- layout: true <div class="my-footer"><span>Tiago Ventura (CSMaP)                                               CSMaP Conference</span></div> --- class:middle ## Motivation <img src="./presentation/nyt.png" width="100%" /> --- ### Research Goal <br> <br> <br> <br> .content-box-gray[Provide causal estimates for the effects of exposure to misinformation on WhatsApp on political outcomes.] --- class: inverse, center, middle ## WhatsApp Multimedia Deactivation Field Experiment during the three weeks leading up to the 2022 Presidential Election in Brazil. --- class: middle <svg viewBox="0 0 512 512" style="height:1em;position:relative;display:inline-block;top:.1em;" xmlns="http://www.w3.org/2000/svg"> <path d="M504 256C504 119 393 8 256 8S8 119 8 256s111 248 248 248 248-111 248-248zm-448 0c0-110.5 89.5-200 200-200s200 89.5 200 200-89.5 200-200 200S56 366.5 56 256zm72 20v-40c0-6.6 5.4-12 12-12h116v-67c0-10.7 12.9-16 20.5-8.5l99 99c4.7 4.7 4.7 12.3 0 17l-99 99c-7.6 7.6-20.5 2.2-20.5-8.5v-67H140c-6.6 0-12-5.4-12-12z"></path></svg> **Our Design:** Cut the primary channels through which users are exposed to misinformation and polarizing content: videos, images and audios .red[(Machado et al., 2019; Resende et al., 2019; Garimella and Tyson, 2018; Garimella and Eckles, 2020; Batista Pereira et al., 2023).] -- <svg viewBox="0 0 512 512" style="height:1em;position:relative;display:inline-block;top:.1em;" xmlns="http://www.w3.org/2000/svg"> <path d="M504 256C504 119 393 8 256 8S8 119 8 256s111 248 248 248 248-111 248-248zm-448 0c0-110.5 89.5-200 200-200s200 89.5 200 200-89.5 200-200 200S56 366.5 56 256zm72 20v-40c0-6.6 5.4-12 12-12h116v-67c0-10.7 12.9-16 20.5-8.5l99 99c4.7 4.7 4.7 12.3 0 17l-99 99c-7.6 7.6-20.5 2.2-20.5-8.5v-67H140c-6.6 0-12-5.4-12-12z"></path></svg> **Experiment:** Offer respondents a monetary incentive to - Disable their automatic download of media on WhatsApp. - Do not purposefully click and watch any media on WhatsApp. -- <svg viewBox="0 0 512 512" style="height:1em;position:relative;display:inline-block;top:.1em;" xmlns="http://www.w3.org/2000/svg"> <path d="M504 256C504 119 393 8 256 8S8 119 8 256s111 248 248 248 248-111 248-248zm-448 0c0-110.5 89.5-200 200-200s200 89.5 200 200-89.5 200-200 200S56 366.5 56 256zm72 20v-40c0-6.6 5.4-12 12-12h116v-67c0-10.7 12.9-16 20.5-8.5l99 99c4.7 4.7 4.7 12.3 0 17l-99 99c-7.6 7.6-20.5 2.2-20.5-8.5v-67H140c-6.6 0-12-5.4-12-12z"></path></svg> **Treatment Period:** Three weeks: - **Start:** Three weeks before general election in Brazil. - **End:** three days after the voting day. --- class:center, middle, inverse ## Overview of the Experiment --- ## Treatment Assignment .pull-left[ **Start**: September 15. **Treatment**: - Turn off the automatic download. - Three .red[weeks] without consuming any multimedia. **Control**: Three .red[days] without consuming any multimedia. **Invited**: 1,135 respondents **Completed**: 773 respondents ] .pull-right[ .center[ <img src="./output/iphone_deact.jpeg" width="80%" /> ] ] --- ## Compliance Checks .pull-left[ **Compliance Tasks:** - Screenshots of WhatsApp storage intormation - Every week + final survey - After the first compliance check, the control group was activated ] .pull-right[ .center[ <img src="./output/iphone_compliance.jpeg" width="80%" /> ] ] --- class:middle ## Outcomes -- **Self-Reported Exposure and Accuracy Judgment** - False Rumors published on fact-checking webpages during the month of the experiment + True News stories headlines from mainstream media. -- **Polarization** - Affective polarization (Feeling Thermometer). - Social Polarization (Willingness to engage with outgroup voter). - Issue Polarization (Abortion, gun control, etc..). - Perceptions about ideological polarization ('Where do I observe the two main candidates?'). -- **Subjective Well-being** - How did you feel for the past three weeks? (Happy, Anxious, etc...). -- --- ## Recruitment and Power Analysis .pull-left[ **Complete Responses:** 732. ] .pull-right[ **Attrition Rate:** 5.3%. ] .center[ <img src="./output/sims_with_covariate.png" width="70%" /> ] --- class: center, middle, inverse # Results --- ### First-Stage Results .center[ <img src="./output/models_compliance.png" width="90%" /> ] --- ### Effects on Exposure to Misinformation Rumors (H1) .center[ <img src="./output/exposure_h1.png" width="90%" /> ] --- ### Reduction in exposure is large for false news (H1) .center[ <img src="./output/difference_true_false_exposure.png" width="90%" /> ] --- ### Effects on Belief Accuracy (H2) .center[ <img src="./output/belief_accuracy_h2.png" width="90%" /> ] --- ### Belief Accuracy Conditional on WhatsApp usage for Politics .center[ <img src="./output/sif_het_use_whatsapp_fac.png" width="90%" /> ] --- ### Effects on Polarization & Subjective Well-Being (H3 & H4) .center[ <img src="./output/pol_sw_index.png" width="90%" /> ] --- ### Polarization Outcomes .center[ <img src="./output/pol_outcomes.png" width="90%" /> ] --- class: middle ## Discussion -- <svg viewBox="0 0 512 512" style="height:1em;position:relative;display:inline-block;top:.1em;" xmlns="http://www.w3.org/2000/svg"> <path d="M504 256C504 119 393 8 256 8S8 119 8 256s111 248 248 248 248-111 248-248zm-448 0c0-110.5 89.5-200 200-200s200 89.5 200 200-89.5 200-200 200S56 366.5 56 256zm72 20v-40c0-6.6 5.4-12 12-12h116v-67c0-10.7 12.9-16 20.5-8.5l99 99c4.7 4.7 4.7 12.3 0 17l-99 99c-7.6 7.6-20.5 2.2-20.5-8.5v-67H140c-6.6 0-12-5.4-12-12z"></path></svg> **WhatsApp is an important vector through which voters receive misinformation in Brazil at .red[a higher rate] compared to true news.** -- <svg viewBox="0 0 512 512" style="height:1em;position:relative;display:inline-block;top:.1em;" xmlns="http://www.w3.org/2000/svg"> <path d="M504 256C504 119 393 8 256 8S8 119 8 256s111 248 248 248 248-111 248-248zm-448 0c0-110.5 89.5-200 200-200s200 89.5 200 200-89.5 200-200 200S56 366.5 56 256zm72 20v-40c0-6.6 5.4-12 12-12h116v-67c0-10.7 12.9-16 20.5-8.5l99 99c4.7 4.7 4.7 12.3 0 17l-99 99c-7.6 7.6-20.5 2.2-20.5-8.5v-67H140c-6.6 0-12-5.4-12-12z"></path></svg> **The null results provide support for a .red[minimalist view of the short-term causal effects] of exposure to misinformation on WhatsApp on political attitudes.** -- <svg viewBox="0 0 512 512" style="height:1em;position:relative;display:inline-block;top:.1em;" xmlns="http://www.w3.org/2000/svg"> <path d="M504 256C504 119 393 8 256 8S8 119 8 256s111 248 248 248 248-111 248-248zm-448 0c0-110.5 89.5-200 200-200s200 89.5 200 200-89.5 200-200 200S56 366.5 56 256zm72 20v-40c0-6.6 5.4-12 12-12h116v-67c0-10.7 12.9-16 20.5-8.5l99 99c4.7 4.7 4.7 12.3 0 17l-99 99c-7.6 7.6-20.5 2.2-20.5-8.5v-67H140c-6.6 0-12-5.4-12-12z"></path></svg> **Exposure to misinformation .red[does not] mechanically affect attitudes** -- --- class:middle ## Limitations -- - Scope conditions: focus on direct effects of WhatsApp. -- - Larger effect might exist exactly in hard to reach groups. -- - Small effect size vs power -- --- class: middle ## Next steps. -- ### Replication, Replication, Replication -- --- class:middle, center ## Thank you! --- ## Examples of Misinformation Outcomes ### False Item: _Only complete votes are counted by the electoral justice. If the voter only votes for the President, and votes blank for all the other races, the vote is considered a partial vote, and will be annulled_ ### True Item: _After consecutive reductions, the current oil price in Brazil is below the global average value_