Next Article in Journal
Percentages of Vaccination Coverage Required to Establish Herd Immunity against SARS-CoV-2
Next Article in Special Issue
Second Wave of the Study of Taiwanese Caregivers of Children with ADHD in the COVID-19 Pandemic: Intentions to Vaccinate Their Children for COVID-19, and Related Factors
Previous Article in Journal
COVID-19 Vaccination in Health Care Workers in Italy: A Literature Review and a Report from a Comprehensive Cancer Center
Previous Article in Special Issue
Factors Influencing the Acceptance of COVID-19 Vaccines in a Country with a High Vaccination Rate
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
Vaccines
Volume 10
Issue 5
10.3390/vaccines10050735
vaccines-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Adverse Mentions, Negative Sentiment, and Emotions in COVID-19 Vaccine Tweets and Their Association with Vaccination Uptake: Global Comparison of 192 Countries

by
Jungmi Jun
,
Ali Zain
*,
Yingying Chen
and
Sei-Hill Kim
School of Journalism and Mass Communications, College of Information and Communications, University of South Carolina, Columbia, SC 29208, USA
*
Author to whom correspondence should be addressed.
Vaccines 2022, 10(5), 735; https://doi.org/10.3390/vaccines10050735
Submission received: 19 April 2022 / Revised: 3 May 2022 / Accepted: 6 May 2022 / Published: 8 May 2022
(This article belongs to the Special Issue COVID-19 Vaccine Acceptance and Uptake: Insights from Behavioural and Social Sciences)
Browse Figure
Versions Notes

Abstract

:
Background: Many countries show low COVID-19 vaccination rates despite high levels of readiness and delivery of vaccines. The public’s misperceptions, hesitancy, and negative emotions toward vaccines are psychological factors discouraging vaccination. At the individual level, studies have revealed negative perceptual/behavioral outcomes of COVID-19 information exposure via social media where misinformation and vaccine fear flood. Objective: This study extends research context to the global level and investigates social media discourse on the COVID-19 vaccine and its association with vaccination rates of 192 countries in the world. Methods: COVID-19 vaccine tweets were compared by country in terms of (1) the number per million Twitter users, (2) mentions of adverse events—death, side-effects, blood clots, (3) negative sentiment (vs. positive), and (4) fear, sadness, or anger emotions (vs. joy). Artificial intelligence (AI) was adopted to classify sentiment and emotions. Such tweets and covariates (COVID-19 morbidity and mortality rates, GDP, population size and density, literacy rate, democracy index, institutional quality, human development index) were tested as predictors of vaccination rates in countries. Results: Over 21.3 million COVID-19 vaccine tweets posted between November 2020 and August 2021 worldwide were included in our analysis. The global average of COVID-19 vaccine tweets mentioning adverse events was 2% for ‘death’, 1.15% for ‘side-effects’, and 0.80% for ‘blood clots’. Negative sentiment appeared 1.90 times more frequently than positive sentiment. Fear, anger, or sadness appeared 0.70 times less frequently than joy. The mention of ‘side-effects’ and fear/sadness/anger emotions appeared as significant predictors of vaccination rates, along with the human development index. Conclusions: Our findings indicate that global efforts to combat misinformation, address negative emotions, and promote positive languages surrounding COVID-19 vaccination on social media may help increase global vaccination uptakes.

1. Introduction

Multiple types of vaccines for a newly discovered coronavirus, SARS-CoV-2 (COVID-19 hereafter), have become available globally, although the level of public accessibility varies by nation. There are 33 vaccines approved by at least one country, and the World Health Organization (WHO) has approved 10 types to date (Nuvaxovid, COVOVAX, Moderna/Spikevax, Pfizer/BioNTech, Janssen, Oxford/AstraZeneca, Covishield, Covaxin, Sinopharm/Covilo, and Sinovac/CoronaVac) [1]. All 195 countries that are members or observers of the United Nations have approved at least one vaccine. As of March 2022, 63.5% of the world population has received at least one dose of a COVID-19 vaccine [2], remaining below the goal of WHO to reach herd immunity [3]. Global inequity of COVID-19 vaccines exists: only 13.7% of people in low-income countries have received at least one dose of vaccine [2]. Fewer than 15 countries (e.g., Canada, United States, Italy, United Kingdom, Germany) have enough vaccines to cover the entire population, and many countries rely on the import or donation of vaccines from others [4]. However, there are sufficient vaccine supplies/leftovers for most of the world [5].
The percentage of the fully vaccinated population remains below 70% in many developed countries, including the United States, despite ample vaccine supplies and more than 1 year of inoculation efforts [6]. The low vaccination rate in these countries seems to be an outcome of individuals’ choice not to get vaccinated, not due to supply or access issues. Such an individual decision can be associated with misperceptions, hesitancy, and negative emotions toward vaccines [7].
Social media has been a critical source of COVID-19 information [8]. However, social media has been flooded with misinformation and disinformation since the beginning of the pandemic [9]. These platforms are also where people express and circulate individual opinions and emotions—either negative or positive—toward vaccination. Research found that COVID-19 vaccine-related tweets were emotional, and many showed objection and hesitancy rather than interest in vaccines [10].
At the individual level, research has evidenced the negative impacts of social media on COVID-19-related perceptions and behaviors. Individuals who were exposed to COVID-19 information via social media were less likely to have optimistic attitudes and adhere to preventive measures as compared to those who used authoritative sources (i.e., the Ministry of Health) [11]. Those who trusted COVID-19 news from social media were more likely to believe in COVID-19 myths and false information, while those who trusted information from the government were less likely to do so [12]. COVID-19 misinformation exposure via social media or instant messaging was also associated with lower engagement in preventive behaviors, mediated by misinformation beliefs [13].
On the basis of the literature, we propose that a country’s COVID-19 vaccination discourse on social media will be an important predictor of the country’s vaccination rate. A higher presence of negative sentiment and emotions on social media discourse of vaccination in a country will be associated with the public’s tendency of negative perceptions and attitudes toward vaccination and, thus, will be associated with a lower vaccination rate of the country. Multiple social science theories supporting the influence of languages, opinions/climate, and/or social networks on social media on health behaviors of a group of people exist: social cognitive theory [14], media framing theory [15], and social contagion theory [16]. Extant studies have identified the type, source, diffusion, and individual impact of COVID-19 (mis)information on social media within a country [13,17,18]. Yet, few studies have utilized a multinational approach comparing vaccine discourse on social media across countries. Moreover, it is unknown if a country’s social media conversations on COVID-19 vaccination are associated with actual vaccination rate of the country. Given the context and the gap in the literature, this study compares countries’ COVID-19 vaccination discourse on Twitter in terms of the mentions of adverse events, sentiment, and emotions, as well as tests such factors as predictors of vaccination rates among countries.
Death in COVID-19 vaccine tweets. Early news reporting and social media discourses surrounding COVID-19 vaccines focused on their safety and potential adverse events, such as death and side-effects. Research found that deaths and side-effects were two of the most frequently appeared topics in COVID-19 vaccine-related tweets posted between November 2020 and February 2021 [19]. More than 100 deaths after vaccination were reported to the US government’s Vaccine Adverse Event Reporting System (VAERS; where anyone, including non-health experts, can submit suspected events) in the first month of inoculation [20]. Although the US Centers for Disease Control and Prevention (CDC) reviewed and reported that these deaths were not related to COVID-19 vaccination, numerous posts misinforming or misinterpreting VAERS reports or including rumors on a death after vaccine spread on social media [21]. The experiences of the US as one of the first countries to approve COVID-19 vaccines and begin inoculation were likely to be shared globally via social media. For instance, Facebook announced that a healthy doctor dying 2 weeks after taking COVID-19 vaccine was the most viewed content on its platform in the first 3 months of 2021 [22].
Blood clots in COVID-19 vaccine tweets. In December 2020, the US Food and Drug Administration (FDA) and CDC determined to pause the use of the Johnson and Johnson COVID-19 vaccine in the US due to reports of a rare and severe type of blood clot, and the agencies lifted the order and recommended to resume of the use of the vaccine after a safety review in April 2021 [23]. Furthermore, scientists found a potential link between blood clots and AstraZeneca [24], another COVID-19 vaccine approved and widely used in the United Kingdom and other countries [1]. The scientists explained the type of blood clots induced by the vaccine to be extremely rare, linked to 73 deaths out of nearly 50 million doses of AstraZeneca given in the UK [25]. Accordingly, blood clots, as a representative side-effect of COVID-19 vaccine, have received tremendous attention from news media and the global public [26].
Negative sentiment in COVID-19 vaccine tweets. The global public has shown different valence and attitudes toward COVID-19 vaccination. Studies based on sentiment analysis of tweets revealed that users often posted words indicating negative, positive, or neutral sentiment to express attitudes toward COVID-19 and health-related issues [19,27,28]. On social media, users expressed negative attitudes related to COVID-19 vaccination using words indicating negative sentiment. For example, a recent study analyzed 2.6 million tweets about COVID-19 vaccines in the English language and found that tweets with negative sentiment were more likely to mention conspiracy theories or question the trial results or efficacy of COVID-19 vaccines than their counterparts (i.e., tweets with positive or neutral sentiment) [29]. Thus, understanding the proportion of negative sentiment as compared to positive sentiment in COVID-19 vaccine tweets from a country can help quantify vaccine-related opinions of the country.
Fear, sadness, and anger in COVID-19 vaccine tweets. Research suggests that emotions are often stronger predictors of vaccine risk perceptions and intentions than statistical risk [30]. In the COVID-19 vaccine context, fear and anxiety were significantly associated with vaccine acceptance [31]. Examining the specific emotions expressed in tweets can help quantifying widespread emotions associated with COVID-19 vaccination in a country. Recent studies found the dominance of fear emotions when people tweet about new COVID-19 cases and deaths [32], as well as continuous diffusions of fear, anxiety, stress, and depression in COVID-19-related tweets [33].

Objectives

The current study aimed to analyze COVID-19 vaccine tweets and test their association with the vaccination rates of 192 countries in the world. We compared COVID-19 vaccine tweets by country in terms of (1) the number of related tweets per million Twitter users, (2) the proportion of tweets mentioning adverse events (death, side-effects, blood clots), (3) appearance of negative sentiment as compared to positive sentiment as classified by an AI tool, and (4) appearance of fear, sadness, or anger emotions as compared to joy as classified by an AI tool. To address the last aim, we tested the adverse mentions, negative sentiment, and fear/sadness/anger emotions in tweets, along with the COVID-19 morbidity/mortality and socioeconomic and political characteristics of a country, as predictors of its vaccination rate.

2. Method

2.1. Data Collection

To collect our data (COVID-19 vaccine-related tweets from countries in the world), Brandwatch (social media/online data search and analytics tool) was employed. The search location included 192 countries that are members/observers of the United Nations [34] and have access to the Twitter platform [35]. Two groups of queries were used: (1) “COVID-19” or “coronavirus” and (2) “vaccine” or “vaccination”. We used the keywords in English, as well as those translated in the dominant languages of each country if the languages were supported by Twitter. A total of 33 languages (English, Arabic, Bengali, Czech, Danish, German, Greek, Spanish, Persian, Finnish, Filipino, French, Hebrew, Hindi, Hungarian, Indonesian, Italian, Japanese, Korean, Malay, Dutch, Norwegian, Polish, Portuguese, Romanian, Russian, Swedish, Thai, Turkish, Ukrainian, Urdu, Vietnamese, Chinese (simplified), and Chinese (traditional)) were used in our search. The search period was from 1 November 2020 (the beginning of vaccine approval and global inoculation efforts) to 15 August 2021 (the data collection date). Noise in tweets was excluded (e.g., advertisements, pornography, and automatic tweet generation apps) using a filter in Brandwatch.

2.2. Measures

COVID-19 vaccine tweets per million Twitter users. We considered the population size and Twitter penetration rate in calculating the number of COVID-19 vaccine tweets of each country to compare the degree of attention to the topic of COVID-19 vaccine on Twitter by country. Twitter penetration rate varied by country from 0.03% in Eritrea to 52.6% in Luxembourg [36]. We divided the total number of COVID-19 vaccine tweets of a country by million population and Twitter penetration rate. For example, we found a total of 6,570,155 tweets mentioning COVID-19 vaccines in the United States, which has a population of 332,915,074 and a Twitter penetration rate of 27.7%. In our analysis, the COVID-19 vaccine tweets per million Twitter users for the United States was calculated as 5466.66 = 6,570,155 ÷ 332.9 × 0.27.
Adverse mentions—“death”, “side-effects”, and “blood clot”. We calculated the proportion of COVID-19 vaccine tweets mentioning words signifying adverse events of vaccination, including death (“death” or “die”), side-effects (“side-effect” or “side-effects”), and blood clot (“blood clot” or “blood clots”). Again, these mentions were searched in English and an additional 33 languages.
Negative sentiment. Brandwatch’s sentiment analysis tool was used to measure the sentiment. Sentiment analysis is a natural language processing (NLP) technique that categorizes documents into negative-, positive-, and neutral-based classification algorithms [37]. According to Brandwatch, its sentiment analysis tool is based on transfer learning, which is a deep learning method, reaching an average accuracy rate of 60–75% across 44 languages [38]. The transfer learning approach improves the accuracy of results by supervised machine learning models or a dictionary-based approach [39]. We should note that the sentiment analysis does not reveal the ground truth; therefore, we set positive sentiment as a benchmark to examine the relative changes of negative sentiment. We adopted the negative and positive sentiment estimated and classified by the sentiment analysis tool and calculated the odds of negative sentiment as compared to positive sentiment.
Fear, sadness, or anger emotions. We relied on Brandwatch’s emotion analysis tool to identify tweets that express fear, sadness, or anger emotions. The statistical classification models categorized each tweet into one of six emotions—anger, disgust, fear, joy, surprise, and sadness [40]. Like sentiment analysis, the emotion analysis tool does not reveal the ground truth. Therefore, we set joy as the benchmark emotion and calculated the odds of fear, anger, or sadness as compared to joy.
Vaccination rate of a country. The outcome variable, vaccination rate of each country, was operationalized as the percentage of total adult population that received at least one dose of any vaccine as of December 2021, which was obtained from Our World in Data [6], World Bank [41], European Centre for Disease Prevention and Control [42], and the US Centers for Disease Control and Prevention [43].
Covariates: We considered COVID-19 morbidity (COVID-19 infection cases per million population) and mortality rates (COVID-19 linked deaths per million population) as of December 2021 for each country, adopted from the Economist Intelligence Unit [44]. In addition, we included socioeconomic and political determinants that are known to predict the access to vaccines or actual vaccination rate of nations [45]: total population, population density, and GDP per capita adopted from Mathieu et al. [6], literacy adopted from Roser and Ortiz-Ospina [46], democracy index (each country’s scores for electoral process and pluralism, functioning of government, political participation, democratic political culture and civil liberties: 1 = authoritarian regime, 2 = hybrid regime, 3 = flawed democracy, 4 = full democracy) adopted from the Economist Intelligence Unit [44], and institutional quality (voice and accountability, political stability and absence of violence/terrorism, government effectiveness, regulatory quality, rule of law, and control of corruption indices; lowest score = −3.00, highest score = 3.00), and human development index (composite index of life expectancy, education, and per capita income indicators, which are used to rank countries into four tiers of human development: 1.0–0.8 = very high, 0.79–0.70 = high, 0.70–0.55 = medium, below 0.55 = low) adopted from Kaufmann and Kraay [47].
All variable used and the sources of secondary data are summarized in Figure A1. Study variables and data sources.

3. Results

Table 1 presents the descriptive information of covariates used in this study, including the means, dispersion, and ranges of COVID-19 morbidity and mortality, vaccination rate (as of December 2021), and socioeconomic and political characteristics of 192 counties included in our analysis.
Table 2 shows the global average of COVID-19 vaccine tweet-related variables and top 10 countries with higher rates or odds. There were over 21.3 million COVID-19 vaccine tweets worldwide and nearly 2740 COVID-19 vaccine tweets per million people in the world. We found about 350 COVID-19 vaccine tweets per million Twitter users on average, posted between November 2020 and August 2021. Countries posting greater numbers of COVID-19 vaccine tweets per million users include Nigeria (N = 2586) followed by Tonga (N = 2510), St. Vincent and the Grenadines (N = 2274), and Fiji (N = 2160).
Of the COVID-19 vaccine tweets, nearly 2% mentioned ‘death’ on a global average. Countries showing a higher proportion of ‘death’ mentions included Germany (25.60%), Austria (21.60%), Japan (12.90%), the Netherlands (10.68%), and Liechtenstein (10.64%). As for ‘side-effects’, 1.15% of COVID-19 vaccine tweets mentioned such words, with Burundi (4.16%), Comoros (4.00%), and Germany (3.47%) mentioning ‘side-effects’ more frequently. About 0.80% of COVID-19 vaccine tweets mentioned ‘blood clots’ globally.
Our sentiment analysis showed that negative sentiment was more likely to appear than positive sentiment in COVID-19 vaccine tweets globally (M = 1.90 times, SD = 1.33). The likelihood of negative sentiment (vs. positive) was greater in some countries, including Turkey (11.93 times), Burundi (8.73 times), Japan (6.79 times), Congo (6.68 times), and Burma (5.18 times).
The emotion analysis showed that, globally, fear, sadness, or anger appeared less frequently than joy in COVID-19 vaccine tweets (M = 0.70 times, SD = 0.33). One of the three negative emotions appeared more frequently than joy in some countries including Namibia (1.87 times), Australia (1.65 times), Eritrea (1.63 times), Burma (1.60 times), and South Africa (1.55 times).
The 192 countries included in our analysis and their number of COVID19 vaccine tweets, adverse mentions, sentiment, and emotions are available in Table S1.
Table 3 entails the results of Pearson’s correlation analyses. Notable findings were significant and positive correlations between ‘death’ and ‘side-effect’ mentions (r = 0.414, p < 0.001), between ‘side-effect’ mentions and negative sentiment (r = 0.338, p < 0.001), and between ‘blood clot’ mentions and fear/sadness/anger emotions (r = 0.316, p < 0.001). COVID-19 morbidity rates showed a positive correlation with all three adverse mentions: ‘death’ (r = 0.186, p < 0.001), ‘side-effects’ (r = 0.224, p = 0.002), and ‘blood clots’ (r = 0.257, p < 0.001).
Overall, country’s GDP per capita, democracy index, institutional quality, and human development index were positively associated with adverse mentions and fear/sadness/anger emotions in COVID-19 vaccine tweets.
Table 4 shows the results of Pearson’s correlation and hierarchical regression analyses, which were used to determine predictors of vaccination rates of countries. A three-step hierarchical regression analysis was performed. In all models, COVID-19 morbidity and mortality were entered in the first block. Socioeconomic and political characteristics of countries, including GDP per capita, total population, population density, literacy rate, democracy index, institutional quality, and human development index (HDI), were entered in the second block. COVID-19 vaccine tweet factors including the number of COVID-19 vaccine tweets per million users, the proportion of adverse mentions (death, side-effects, and blood clot), negative sentiment, and fear/sadness/anger emotions were entered in the last block.
COVID-19 morbidity significantly predicted vaccination rates (β = 0.538, SE = 0.000, p < 0.001; see Model 1 column in Table 4), while COVID-19 mortality did not. However, the effect of COVID-19 morbidity did not remain when socioeconomic and political characteristics of country were considered. As shown in the Model 2 column, human development index (β = 0.734, SE = 24.490, p < 0.001) appeared as the strongest predictor. In the final model including all covariates, ‘side-effect’ mentions (β = −0.156, SE = 1.889, p < 0.01) and fear/sadness/anger emotions (β = −0.105, SE = 4.630, p < 0.05) appeared as significant predictors of vaccination rates, along with human development index (β = 0.682, SE = 25.275, p < 0.001). In the final model, A significant regression equation was found for COVID-19 morbidity and mortality in the first block (F [2, 151] = 23.85, p < 0.001), with an R2 of 0.24, socioeconomic and political characteristics of country in the second block (F [7, 144] = 36.02, p < 0.001), with an R2 of 0.48, and COVID-19 vaccine tweet factors in the last block (F [6, 138] = 4.90, p < 0.001), with an R2 of 0.05. The total R2 of the regression model was 0.77.

4. Discussion

The WHO declared an infodemic in referring to the wide spread of false and misleading information about COVID-19 in digital and physical environments [48]. Concerning dangerous outcomes of the infodemic threatening human health and security, 132 member countries of the United Nations signed a cross-regional statement to combat the COVID-19 infodemic [49]. One of the key behavioral aims of tackling the COVID-19 infodemic is to increase vaccination uptakes of the world population and reach the herd immunity globally. Despite the greater need and trend of international collaboration to surveil and combat misinformation and negative languages surrounding COVID-19 vaccination, the unit of analysis in extant investigations of the impact of COVID-19 information exposure via social media has mostly been an individual within a country. Our research contributes to the literature by extending the unit of analysis to a nation and providing a global comparison. We expanded individual-level findings and showed that social media discourses are also associated with vaccination behavior at the national level.
Consistent with previous analyses of COVID-19-related tweets, our study again confirmed a tremendous amount of attention to COVID-19 vaccines among the global public given the number of related tweets. More than 21.3 million COVID-19 vaccine tweets were posted globally within the 10-month period. Approximately 2% of COVID-19 vaccine tweets mentioned ‘death’, and the proportion was much higher in several developed countries, including Germany, Austria, Japan, and the Netherlands. It should be noted that death mentions in our data did not always refer to a death after or associated with vaccination. For instance, the term ‘death’ could be referring to how vaccines do or do not prevent COVID-19 deaths. In our analysis, death mentions were positively associated with side-effect mentions, negative sentiment, and fear/sadness/anger at the bivariate level. Furthermore, a higher proportion of death mention was observed in countries with high levels of COVID-19 morbidity, GDP per capita, literacy rate, democracy index, institutional quality, and human development index. The death mention was not a significant predictor of vaccination rates, which indicates that a more precise query strategy should be considered to capture the circulation of misinformation or rumors on vaccine-induced deaths on social media and its behavioral impacts.
More than one in 100 COVID-19 vaccine tweets mentioned ‘side-effects’ in our analysis. Side-effect mentions were also positively associated with death, negative sentiment, and fear/sadness/anger at the bivariate level. Similar with the death mentions, a greater number of side-effect mentions were observed in countries with high levels of COVID-19 morbidity, GDP per capita, literacy rate, democracy index, institutional quality, and human development index. The side-effect mentions were associated with a decreased level of vaccination rate of a country when all covariates were considered. This result indicates that, when more people in a country express concern about the side-effects of vaccines or focus on adverse events of vaccination on social media, it can discourage confidence and engagement in vaccination behaviors in the country. Social media is the double-edged sword to health communicators as it is where health misinformation spreads but offers a promising avenue to monitor and correct such misinformation with real-time corrections, crowdsourced fact-checking, and algorithmic tagging [50]. Although the health organizations and scholars should continue efforts to investigate and prevent adverse events of vaccines, as well as to provide relevant scientific information to the public, the governments and public health communicators should monitor adverse events on social media and make efforts to correct if such adverse events are incorrect or misinterpreted. Moreover, the safety and efficacy of vaccines should be communicated on social media with clear and easy information on the scarcity of adverse events to increase vaccine confidence and uptake.
Overall, the joyous emotion appeared more frequently than fear, sadness, or anger in global tweets of COVID-19 vaccines even though some countries showed the opposite trend of showing more negative emotions. This result may reflect the world population’s excitement for a cure of the virus and possibility of ending the global pandemic. The likelihood of fear, sadness, or anger appearance as compared to joy in COVID-19 vaccine tweets was associated with a decreased level of vaccination rates. In other words, the likelihood of joy as compared to negative emotions was linked to a heightened level of vaccination rates. Health communication scholars suggested the potential of activating positive emotions in promoting vaccination by highlighting the efficacy of the vaccine in helping the return to a normal life and closer interactions with family/community after a prolonged period of social distancing [51]. Our findings support this idea at the international level.
Our study had several limitations. First, although we found some significant correlations between variables, our analysis was limited to confirm a causal relationship between social media discourse of vaccines and vaccination due to the cross-sectional nature of our data. Second, although our macrolevel analysis may enhance ecological validity of previous studies, it would be an ecological fallacy to extrapolate country-level findings to individuals, given the difference between the unit of observation (countries) and the unit of inference (individuals). That is, the influence of Twitter discourse on individuals’ vaccine behaviors cannot directly be inferred from country-level correlations. Moreover, it is not unusual to find inflated R-squared values from aggregated data. Because of increased homogeneity typically found among larger-scale units (e.g., countries), correlations computed at an aggregated-level tend to be larger in general than those computed from individual-level measurements [52]. Therefore, it should be noted that some significant regression coefficients reported in our study could have been inflated, and the large R-squared values from our predictors could have in part been attributed to our use of aggregated data. Third, we did not explore the reasons behind why some countries showed more negative sentiment or emotions in COVID-19 vaccine tweets than others, calling for additional case studies to gain an in-depth understanding of each country’s vaccine discourse and associated factors. For instance, there can be differences in emotionally responding to COVID-19 as a crisis among countries [53]. At the same time, cross-cultural variations may exist in the public’s distrust in vaccine and other medical sciences across people with different the race/ethnicity, religions, and health literacy levels. Fourth, we did not conduct an exhaustive analysis on all COVID-19 vaccination discourses. We limited the scope of analysis to discourses related to a few adverse events of vaccination, keeping the search keywords (e.g., death, side-effects) simple and short for translation in 33 languages. Thus, our data are also limited to specific side-effects or deaths induced by COVID-19 vaccination. Due to the limitations regarding languages available for Brandwatch’s emotion analysis, we could not include several languages that are widely used in some regions that may also appear frequently in tweets (e.g., Swahili and Hausa in Africa). Another limitation is that our analysis was only based on tweets that revealed geographic locations; however, estimating geographic locations remains a challenge. Lastly, AI-driven sentiment and emotion analysis is still developing, accompanied by various limitations including Brandwatch AI’s inability to effectively detect emotions in many languages other than English. Scholars have pointed out discrepancies of sentiment and emotion classification between AI and humans [54]. Addressing these limitations can be an opportunity for future research.
Withstanding the limitations, our research contributes to the scholarship. Our algorithm-based analysis of social media conversations and macrolevel comparison of vaccination rates may enhance the ecological validity of findings from previous studies. First, instead of using questionnaire-based measures of vaccine-related concerns, attitudes, and emotions, we analyzed Twitter messages to capture real-life expressions of vaccine-related sentiment and emotions among users in the world. Second, the macrolevel comparison allowed us to analyze actual vaccination rates, rather than intention to get vaccinated, and link them to the cross-national variations in vaccine concerns, sentiment, and emotions expressed in Twitter messages. Certainly, it is questionable whether the adverse mentions, sentiment, and emotions expressed on Twitter can truly represent what the public in each country think about vaccines. That is, how closely Twitter users can represent the entire population is always questionable, and it raises concern about the validity of data from Twitter, particularly given the large variation in Twitter penetration rates across countries. Opinions of Twitter users are limited in representing the global public’s view. For instance, adult Twitter users in the US are younger and more likely to have progressive political views than the general public [55]. Furthermore, we could not include related conversations from Facebook, a social media platform with greater global market shares than Twitter, as Facebook no longer supports data access for researchers through an application programming interface (API). Despite the validity concerns, it is necessary to point out that large-scale data that can reflect and quantify cognitive and psychological responses to a universal health issue from all or most countries in the world are hardly available, and a global social media platform, such as Twitter, seems to be perhaps the only feasible source to obtain such data. The tradeoff between social media data from most countries in the world and more focused observational data from a few selected countries, i.e., the tradeoff between enhanced generalizability and higher measurement quality, seems to be an issue for current studies involving macrolevel comparisons and a task for future researchers to improve.

5. Conclusions

Our research findings contribute to global efforts in communicating and promoting COVID-19 vaccination by providing a cross-national comparison of related conversations on one of the most globally used social media platforms and examining its health outcome. We found that, when social media discourse in a country focused more on side-effects or showed negative emotions when talking about COVID-19 vaccines, the country’s vaccination rate tended to be lower than others. This result considered each country’s socioeconomic and political characteristics and their COVID-19 cases and deaths. Our research supports the idea that global efforts to combat mis- and disinformation, address fear and other negative emotions, and promote positive languages surrounding COVID-19 vaccination on social media may contribute to increasing vaccination uptake worldwide.

Supplementary Materials

The following are available online at https://www.mdpi.com/article/10.3390/vaccines10050735/s1, Table S1: Sample Countries and Adverse Mentions, Negative Sentiment, and Emotions in COVID-19 Vaccine Tweets.

Author Contributions

Conceptualization, J.J.; funding acquisition, J.J.; methodology, J.J.; Y.C.; S.-H.K.; investigation, J.J.; A.Z.; supervision of data curation, J.J.; formal analysis, J.J. and A.Z.; writing, J.J.; A.Z., Y.C., S.-H.K.; data curation, A.Z. All authors have read and agreed to the published version of the manuscript.

Funding

This research was supported by the Social Media Core of UofSC Big Data Health Sciences Center.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

Vaccines 10 00735 g0a1 550
Figure A1. Study variables and data sources.
Figure A1. Study variables and data sources.
Vaccines 10 00735 g0a1

References

  1. Basta, N.; Moodie, E. COVID-19 Vaccine Development and Approvals Tracker. 2022. Available online: https://covid19.trackvaccines.org/agency/who (accessed on 21 March 2022).
  2. Ritchie, H.; Mathieu, E.; Rodés-Guirao, L.; Appel, C.; Giattino, C.; Ortiz-Ospina, E.; Hasell, J.; Macdonald, B.; Beltekian, D.; Roser, M. Coronavirus Pandemic (COVID-19). Our World Data. 2022. Available online: https://ourworldindata.org/coronavirus (accessed on 21 March 2022).
  3. WHO. Achieving 70% COVID-19 Immunization Coverage by Mid-2022. Available online: https://www.who.int/news/item/23-12-2021-achieving-70-covid-19-immunization-coverage-by-mid-2022 (accessed on 13 March 2022).
  4. Cohen, J.; Kupferschmidt, K. Countries Now Scrambling for COVID-19 Vaccines May Soon Have Surpluses to Donate. Sci. Mag. 2021. [Google Scholar] [CrossRef]
  5. WHO. Vaccine Equity. Available online: https://www.who.int/campaigns/vaccine-equity (accessed on 13 March 2022).
  6. Mathieu, E.; Ritchie, H.; Ortiz-Ospina, E.; Roser, M.; Hasell, J.; Appel, C.; Giattino, C.; Rodés-Guirao, L. A Global Database of COVID-19 Vaccinations. Nat. Hum. Behav. 2021, 5, 947–953. [Google Scholar] [CrossRef] [PubMed]
  7. Rief, W. Fear of Adverse Effects and COVID-19 Vaccine Hesitancy: Recommendations of the Treatment Expectation Expert Group. JAMA Health Forum 2021, 2, e210804. [Google Scholar] [CrossRef]
  8. Mitchell, A.; Liedke, J. About Four-in-Ten Americans Say Social Media Is an Important Way of Following COVID-19 Vaccine News. Pew Res. Cent. 2021. Available online: https://www.pewresearch.org/fact-tank/2021/08/24/about-four-in-ten-americans-say-social-media-is-an-important-way-of-following-covid-19-vaccine-news (accessed on 21 March 2022).
  9. Muric, G.; Wu, Y.; Ferrara, E. COVID-19 Vaccine Hesitancy on Social Media: Building a Public Twitter Data Set of Antivaccine Content, Vaccine Misinformation, and Conspiracies. JMIR Public Health Surveill. 2021, 7, e30642. [Google Scholar] [CrossRef]
  10. Yousefinaghani, S.; Dara, R.; Mubareka, S.; Papadopoulos, A.; Sharif, S. An Analysis of COVID-19 Vaccine Sentiments and Opinions on Twitter. Int. J. Infect. Dis. 2021, 108, 256–262. [Google Scholar] [CrossRef]
  11. Alshareef, N.; Yunusa, I.; Al-Hanawi, M.K. The Influence of COVID-19 Information Sources on the Attitudes and Practices Toward COVID-19 Among the General Public of Saudi Arabia: Cross-Sectional Online Survey Study. JMIR Public Health Surveill. 2021, 7, e28888. [Google Scholar] [CrossRef]
  12. Melki, J.; Tamim, H.; Hadid, D.; Makki, M.; El Amine, J.; Hitti, E. Mitigating Infodemics: The Relationship between News Exposure and Trust and Belief in COVID-19 Fake News and Social Media Spreading. PLoS ONE 2021, 16, e0252830. [Google Scholar] [CrossRef]
  13. Lee, J.J.; Kang, K.-A.; Wang, M.P.; Zhao, S.Z.; Wong, J.Y.H.; O’Connor, S.; Yang, S.C.; Shin, S. Associations Between COVID-19 Misinformation Exposure and Belief With COVID-19 Knowledge and Preventive Behaviors: Cross-Sectional Online Study. J. Med. Internet Res. 2020, 22, e22205. [Google Scholar] [CrossRef]
  14. Bandura, A. Health Promotion by Social Cognitive Means. Health Educ. Behav. 2004, 31, 143–164. [Google Scholar] [CrossRef]
  15. Ophir, Y.; Walter, D.; Arnon, D.; Lokmanoglu, A.; Tizzoni, M.; Carota, J.; D’Antiga, L.; Nicastro, E. The Framing of COVID-19 in Italian Media and Its Relationship with Community Mobility: A Mixed-Method Approach. J. Health Commun. 2021, 26, 161–173. [Google Scholar] [CrossRef]
  16. Christakis, N.A.; Fowler, J.H. Social Contagion Theory: Examining Dynamic Social Networks and Human Behavior. Stat. Med. 2013, 32, 556–577. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  17. Kouzy, R.; Abi Jaoude, J.; Kraitem, A.; El Alam, M.B.; Karam, B.; Adib, E.; Zarka, J.; Traboulsi, C.; Akl, E.W.; Baddour, K. Coronavirus Goes Viral: Quantifying the COVID-19 Misinformation Epidemic on Twitter. Cureus 2020, 12, e7255. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  18. Lobato, E.J.C.; Powell, M.; Padilla, L.M.K.; Holbrook, C. Factors Predicting Willingness to Share COVID-19 Misinformation. Front. Psychol. 2020, 11, 566108. [Google Scholar] [CrossRef]
  19. Karami, A.; Zhu, M.; Goldschmidt, B.; Boyajieff, H.R.; Najafabadi, M.M. COVID-19 Vaccine and Social Media in the U.S.: Exploring Emotions and Discussions on Twitter. Vaccines 2021, 9, 1059. [Google Scholar] [CrossRef] [PubMed]
  20. Gee, J.; Marquez, P.; Su, J.; Calvert, G.M.; Liu, R.; Myers, T.; Nair, N.; Martin, S.; Clark, T.; Markowitz, L.; et al. First Month of COVID-19 Vaccine Safety Monitoring—United States, 14 December 2020–13 January 2021. MMWR Morb. Mortal. Wkly. Rep. 2021, 70, 283–288. [Google Scholar] [CrossRef]
  21. Neale, T. Reports of Sudden Deaths among Athletes After COVID-19 Vax Are ‘Misinformation.’ tctMD 2022. Available online: https://www.tctmd.com/news/reports-sudden-deaths-among-athletes-after-covid-19-vax-are-misinformation (accessed on 1 April 2022).
  22. Bond, S. Facebook’s Most Viewed Article In Early 2021 Raised Doubt About COVID Vaccine. NPR. 2021. Available online: https://www.npr.org/2021/08/21/1030038616/facebooks-most-viewed-article-in-early-2021-raised-doubt-about-covid-vaccine (accessed on 1 April 2022).
  23. US FDA. FDA and CDC Lift Recommended Pause on Johnson & Johnson (Janssen) COVID-19 Vaccine Use Following Thorough Safety Review. Available online: https://www.fda.gov/news-events/press-announcements/fda-and-cdc-lift-recommended-pause-johnson-johnson-janssen-covid-19-vaccine-use-following-thorough (accessed on 9 April 2022).
  24. Baker, A.T.; Boyd, R.J.; Sarkar, D.; Teijeira-Crespo, A.; Chan, C.K.; Bates, E.; Waraich, K.; Vant, J.; Wilson, E.; Truong, C.D.; et al. ChAdOx1 Interacts with CAR and PF4 with Implications for Thrombosis with Thrombocytopenia Syndrome. Sci. Adv. 2021, 7, eabl8213. [Google Scholar] [CrossRef] [PubMed]
  25. Gallagher, J. Covid: Trigger of Rare Blood Clots with AstraZeneca Jab Found by Scientists. BBC News, 2 December 2021. Available online: https://www.bbc.com/news/health-59418123(accessed on 1 April 2022).
  26. Jemielniak, D.; Krempovych, Y. An Analysis of AstraZeneca COVID-19 Vaccine Misinformation and Fear Mongering on Twitter. Public Health 2021, 200, 4–6. [Google Scholar] [CrossRef] [PubMed]
  27. Chandrasekaran, R.; Mehta, V.; Valkunde, T.; Moustakas, E. Topics, Trends, and Sentiments of Tweets About the COVID-19 Pandemic: Temporal Infoveillance Study. J. Med. Internet Res. 2020, 22, e22624. [Google Scholar] [CrossRef]
  28. Hung, M.; Lauren, E.; Hon, E.S.; Birmingham, W.C.; Xu, J.; Su, S.; Hon, S.D.; Park, J.; Dang, P.; Lipsky, M.S. Social Network Analysis of COVID-19 Sentiments: Application of Artificial Intelligence. J. Med. Internet Res. 2020, 22, e22590. [Google Scholar] [CrossRef]
  29. Liu, S.; Liu, J. Public Attitudes toward COVID-19 Vaccines on English-Language Twitter: A Sentiment Analysis. Vaccine 2021, 39, 5499–5505. [Google Scholar] [CrossRef]
  30. Betsch, C.; Ulshöfer, C.; Renkewitz, F.; Betsch, T. The Influence of Narrative v. Statistical Information on Perceiving Vaccination Risks. Med. Decis. Making 2011, 31, 742–753. [Google Scholar] [CrossRef]
  31. Bendau, A.; Plag, J.; Petzold, M.B.; Ströhle, A. COVID-19 Vaccine Hesitancy and Related Fears and Anxiety. Int. Immunopharmacol. 2021, 97, 107724. [Google Scholar] [CrossRef] [PubMed]
  32. Xue, J.; Chen, J.; Hu, R.; Chen, C.; Zheng, C.; Su, Y.; Zhu, T. Twitter Discussions and Emotions About the COVID-19 Pandemic: Machine Learning Approach. J. Med. Internet Res. 2020, 22, e20550. [Google Scholar] [CrossRef] [PubMed]
  33. Xi, H.; Zhang, C.; Zhao, Y.; He, S. Public Emotional Diffusion over COVID-19 Related Tweets Posted by Major Public Health Agencies in the United States. Data Intell. 2022, 4, 66–87. [Google Scholar] [CrossRef]
  34. United Nations Member States. Available online: https://www.un.org/en/about-us/member-states (accessed on 21 March 2022).
  35. Twitter About Eligibility for Twitter. Ads. Available online: https://business.twitter.com/en/help/ads-policies/campaign-considerations/about-eligibility-for-twitter-ads.html (accessed on 21 March 2022).
  36. DigitalReportal. Digital 2021 October Global Statshot Report. Available online: https://datareportal.com/reports/digital-2021-october-global-statshot (accessed on 21 March 2022).
  37. Liu, B. Sentiment Analysis and Opinion Mining. Synth. Lect. Hum. Lang. Technol. 2012, 5, 1–167. [Google Scholar] [CrossRef] [Green Version]
  38. Bannister, K. Understanding Sentiment Analysis: What It Is & Why It’s Used. Available online: https://www.brandwatch.com/blog/understanding-sentiment-analysis/ (accessed on 1 April 2022).
  39. Taylor, N. The Data Science Behind Brandwatch’s New Sentiment Analysis. Available online: https://www.brandwatch.com/blog/data-science-behind-brandwatchs-new-sentiment-analysis/ (accessed on 11 April 2022).
  40. Taylor, N. Get a Deeper Understanding of Consumer Sentiment with Emotion Analysis. Available online: https://www.brandwatch.com/blog/get-a-deeper-understanding-of-consumer-sentiment-with-emotion-analysis/ (accessed on 11 April 2022).
  41. World Bank. The World Bank|COVID-19 Vaccine Deployment Tracker. Available online: https://covid19vaccinedeploymenttracker.worldbank.org/tracker (accessed on 21 March 2022).
  42. European Centre for Disease Prevention and Control Sources—Worldwide Data on COVID-19. Available online: https://www.ecdc.europa.eu/en/publications-data/sources-worldwide-data-covid-19 (accessed on 21 March 2022).
  43. CDC. COVID Data Tracker. Available online: https://covid.cdc.gov/covid-data-tracker (accessed on 21 March 2022).
  44. The Economist. Intelligence Unit Democracy Index 2020. Available online: https://www.eiu.com/n/campaigns/democracy-index-2020/ (accessed on 21 March 2022).
  45. de Oliveira, B.R.B.; da Penha Sobral, A.I.G.; Marinho, M.L.M.; Sobral, M.F.F.; de Souza Melo, A.; Duarte, G.B. Determinants of Access to the SARS-CoV-2 Vaccine: A Preliminary Approach. Int. J. Equity Health 2021, 20, 183. [Google Scholar] [CrossRef]
  46. Roser, M.; Ortiz-Ospina, E. Literacy. Our World Data. 2016. Available online: https://ourworldindata.org/literacy (accessed on 21 March 2022).
  47. Kaufmann, D.; Kraay, A. WGI-Home. Available online: http://info.worldbank.org/governance/wgi/ (accessed on 21 March 2022).
  48. WHO. Infodemic. Available online: https://www.who.int/health-topics/infodemic (accessed on 9 April 2022).
  49. United Nations. Cross-Regional Statement on “Infodemic” in the Context of COVID-19. Available online: https://onu.delegfrance.org/IMG/pdf/cross-regional_statement_on_infodemic_final_with_all_endorsements.pdf (accessed on 9 April 2022).
  50. Walter, N.; Brooks, J.J.; Saucier, C.J.; Suresh, S. Evaluating the Impact of Attempts to Correct Health Misinformation on Social Media: A Meta-Analysis. Health Commun. 2021, 36, 1776–1784. [Google Scholar] [CrossRef]
  51. Chou, W.-Y.S.; Budenz, A. Considering Emotion in COVID-19 Vaccine Communication: Addressing Vaccine Hesitancy and Fostering Vaccine Confidence. Health Commun. 2020, 35, 1718–1722. [Google Scholar] [CrossRef]
  52. Scheuch, E.K. Cross-National Comparisons Using Aggregated Data: Some Substantive and Methodological Problems. In Comparing Nations: The Use of Quantitative Data in Cross-National Research; Yale University: New Haven, CT, USA, 1966; pp. 131–167. ISBN 978-0-300-00767-1. [Google Scholar]
  53. Imran, A.S.; Daudpota, S.M.; Kastrati, Z.; Batra, R. Cross-Cultural Polarity and Emotion Detection Using Sentiment Analysis and Deep Learning on COVID-19 Related Tweets. IEEE Access 2020, 8, 181074–181090. [Google Scholar] [CrossRef]
  54. Hayes, J.L.; Britt, B.C.; Evans, W.; Rush, S.W.; Towery, N.A.; Adamson, A.C. Can Social Media Listening Platforms’ Artificial Intelligence Be Trusted? Examining the Accuracy of Crimson Hexagon’s (Now Brandwatch Consumer Research’s) AI-Driven Analyses. J. Advert. 2020, 1–11. [Google Scholar] [CrossRef]
  55. Wojcik, S.; Hughes, A. Sizing Up Twitter Users 2019. Available online: https://www.pewresearch.org/internet/2019/04/24/sizing-up-twitter-users/ (accessed on 2 May 2022).
Table
Table 1. Description of covariates.
Table 1. Description of covariates.
Total N = 192
M (SD)Min–Max
COVID-19
Morbidity (per million)59,397 (62,332)8.60–260,309.74
Mortality (per million)978 (1073)3.1–6050.71
Country Characteristics
GDP per capitaUS$18,061 ($19,296)661.24–116,935.6
Total population40,867,457 (150,016,829)10,873–1.44 billion
Population density301 (1519)1.98–19,347.5
Literacy rate86% (18%)19.10–80.90%
Democracy index a2.24 (1.08)1–4
Institutional quality b−0.07 (0.91)−3–1.78
Human development index c0.72 (0.15)0.39–0.96
Vaccination Rate d46.99% (27.77%)0.00–99%
Low-income countries8.01% (9.44%)0.00–45%
Middle-income countries36.8% (23.6%)1.00–84%
Upper-middle income countries48.36% (21.37%)8.00–90.29%
High-income countries72.26% (12.36%)38.83–98.99%
a Democracy index scale: 1 = authoritarian regime, 2 = hybrid regime, 3 = flawed democracy, 4 = full democracy. b Composite average scores of countries on voice and accountability, political stability and absence of violence/terrorism, government effectiveness, regulatory quality, rule of law, and control of corruption (lowest score = −3.00, highest score = 3.00). c HDI scale ranges between 0 and 1 and is divided into four tiers: 1.0–0.8 = very high, 0.79–0.70 = high, 0.70–0.55 = medium, below 0.55 = low. d Percentage of total population having taken at least one dose of COVID-19 vaccine.
Table
Table 2. Adverse Mentions, Negative Sentiment, and Emotions in COVID-19 Vaccine Tweets.
Table 2. Adverse Mentions, Negative Sentiment, and Emotions in COVID-19 Vaccine Tweets.
Vaccine TweetsGlobal M (SD)Top 10 Countries
COVID19 vaccine tweets per million users633.19
(1941.93)		Monaco (20739.44), Canada (9302.41), Ireland (8348.63), United Kingdom (7889.12), United States (5466.66), Maldives (5082.80), Singapore (3347.87), Uruguay (2637.25), Japan (2238.79), Kuwait (2165.87)
Death mention1.99% (2.77%)Germany (25.60%), Austria (21.60%), Japan (12.90%), rgw Netherlands (10.68%), Liechtenstein (10.64%), Switzerland (9.43%), Suriname (4.93%), Namibia (4.90%), Swaziland (4.20%), Timor-Leste (4.08%)
Side-effects mention1.15% (0.79%)Burundi (4.16%), Comoros (4.00%), Germany (3.47%), Netherland (3.46%), Denmark (3.39%), Slovenia (3.24%), Macedonia (3.24%), Rep. of Congo (3.07%), Japan (2.92%), Thailand (2.95%)
Blood clots mention0.79% (0.69%)Equatorial Guinea (3.52%), Serbia (3.39%), Cyprus (3.89%), Swaziland (2.80%), Lesotho (2.47%), Central African Republic (2.39%), Slovenia (2.30%), Montenegro (2.22%), Mauritius (2.13%), Norway (2.08%)
JoyN = 8289
(SD = 56,983)		United States (714,642), United Kingdom (228,668), India (215,465), Canada (155,620), Nigeria (28,166), Australia (25,882), Ireland (16,930), Malaysia (14,676), South Africa (13,547), Kenya (11,726)
FearN = 2315
(SD = 16,077)		United States (203,800), United Kingdom (63,378), Canada (53,693), India (42,690), Australia (14,856), Nigeria (6319), Ireland (5867), South Africa (5838), Malaysia (4457), Philippines (3552)
SadnessN = 3437
(SD = 25,311)		United States (329,899), India (82,938), United Kingdom (71,629), Canada (60,401), Australia (18,144), Nigeria (11,960), South Africa (10,860), Kenya (7505), Ireland (5510), Malaysia (5008)
AngerN = 1625
(SD = 12,051)		United States (151,662), United Kingdom (55,883), Canada (39,808), India (23,094), Australia (9596), South Africa (4245), Ireland (4010), Nigeria (3047), Kenya (2094), Malaysia (1607)
Likelihood of negative sentiment (vs. positive)1.90 times (1.33)Turkey (11.93 times), Burundi (8.73 times), Japan (6.79 times), Dem. Rep. of Congo (6.68 times), Burma (5.18 times), Togo (5.06 times), Central African Republic (4.67 times), Guatemala (4.31 times), Chad (4 times), Cape Verde (4 times)
Likelihood of fear/sadness/anger emotions (vs. joy)0.70 times (0.33)Namibia (1.87 times), Australia (1.65 times), Eritrea (1.63 times), Burma (1.60 times), South Africa (1.55 times), Samoa (1.52 times), Swaziland (1.50 times), Iran (1.50 times), Antigua and Barbuda (1.48 times), Iceland (1.36 times)
Table
Table 3. Correlations among adverse mentions, negative sentiment, and emotions.
Table 3. Correlations among adverse mentions, negative sentiment, and emotions.
Death MentionSide-Effect MentionsBlood Clot MentionsNegative
Sentiment		Fear/
Sadness/Anger
r (p)r (p)r (p)r (p)
Death mention 0.414 (<0.001)0.112 (0.122)0.235 (0.001)0.182 (0.012)
Side-effect mentions 0.243 (<0.001)0.338 (<0.001)0.207 (0.004)
Blood clot mentions −0.042 (0.568)0.316 (<0.001)
Negative sentiment 0.306 (0.001)
COVID-19
Morbidity (per million)0.186 (<0.001)0.224 (0.002)0.257 (<0.001)−0.008 (0.917)0.080 (0.280)
Mortality (per million)0.111 (0.137)0.061 (0.417)0.159 (0.033)0.035 (0.642)0.089 (0.236)
Country Characteristics
GDP per capita0.247 (<0.001)0.222 (0.002)0.168 (0.022)0.002 (0.976)0.231 (0.002)
Total population0.043 (0.560)−0.046 (0.525)−0.072 (325)−0.027 (713)0.074 (0.313)
Population density−0.003 (0.969)0.093 (0.205)−0.010 (0.891)0.056 (0.444)0.136 (0.063)
Literacy rate0.173 (0.018)0.132 (0.071)0.205 (0.005)0.039 (0.592)0.274 (<0.001)
Democracy index0.358 (<0.001)0.259 (<0.001)0.296 (<0.001)0.008 (0.919)0.241 (0.002)
Institutional quality0.340 (<0.001)0.243 (<0.001)0.226 (0.002)−0.029 (0.687)0.235 (<0.001)
Human development index0.280 (<0.001)0.217 (0.003)0.238 (<0.001)−0.019 (0.796)0.259 (<0.001)
Table
Table 4. Predictors of vaccination rates.
Table 4. Predictors of vaccination rates.
r (p)Model IModel IIModel III
COVID-19 bSEbSEbSE
Morbidity 0.485 (<0.001)0.538 ***0.000−0.1260.000−0.0530.000
Mortality0.328 (<0.001)−0.0710.003−0.0350.002−0.0850.002
Total R2 = 0.24R2Change = 0.24R2Change = 0.24
Country Characteristics
GDP per capita0.642 (<0.001) 0.0250.0000.0730.000
Total population0.078 (0.283) 0.103 *0.0000.103 *0.000
Population density0.114 (0.116) 0.0110.0020.0060.002 *
Literacy rate0.671 (<0.001) 0.0400.1380.0710.132
Democracy index0.554 (<0.001) −0.01620.1830.0532.254
Institutional quality0.690 (<0.001) 0.19730.5090.2023.292
Human development index0.812 (<0.001) 0.734 ***260.4900.682 ***25.275
R2Change = 0.48R2Change = 0.48
Total R2 = 0.72
Vaccine Tweets
COVID19 vaccine tweets0.070 (0.347) 0.0520.003
Death mention0.387 (0.009) 0.0030.469
Side-effect mentions0.003 (0.971) −0.156 **1.889
Blood clot mentions0.058 (0.428) −0.0422.050
Negative sentiment−0.050 (0.945) −0.0220.248
Fear/sadness/anger0.144 (0.049) −0.105 *4.630
R2 Change = 0.05
Total R2 = 0.77
Note: *** p < 0.001, ** p < 0.01, * p < 0.05; b = standardized coefficient beta; SE = standardized error, 95%.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Jun, J.; Zain, A.; Chen, Y.; Kim, S.-H. Adverse Mentions, Negative Sentiment, and Emotions in COVID-19 Vaccine Tweets and Their Association with Vaccination Uptake: Global Comparison of 192 Countries. Vaccines 2022, 10, 735. https://doi.org/10.3390/vaccines10050735

AMA Style

Jun J, Zain A, Chen Y, Kim S-H. Adverse Mentions, Negative Sentiment, and Emotions in COVID-19 Vaccine Tweets and Their Association with Vaccination Uptake: Global Comparison of 192 Countries. Vaccines. 2022; 10(5):735. https://doi.org/10.3390/vaccines10050735

Chicago/Turabian Style

Jun, Jungmi, Ali Zain, Yingying Chen, and Sei-Hill Kim. 2022. "Adverse Mentions, Negative Sentiment, and Emotions in COVID-19 Vaccine Tweets and Their Association with Vaccination Uptake: Global Comparison of 192 Countries" Vaccines 10, no. 5: 735. https://doi.org/10.3390/vaccines10050735

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop