âšď¸ Skipped - page is already crawled
| Filter | Status | Condition | Details |
|---|---|---|---|
| HTTP status | PASS | download_http_code = 200 | HTTP 200 |
| Age cutoff | FAIL | download_stamp > now() - 6 MONTH | 7.7 months ago |
| History drop | PASS | isNull(history_drop_reason) | No drop reason |
| Spam/ban | PASS | fh_dont_index != 1 AND ml_spam_score = 0 | ml_spam_score=0 |
| Canonical | PASS | meta_canonical IS NULL OR = '' OR = src_unparsed | Not set |
| Property | Value |
|---|---|
| URL | https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/ |
| Last Crawled | 2025-08-24 19:17:04 (7 months ago) |
| First Indexed | not set |
| HTTP Status Code | 200 |
| Meta Title | Misinformedness about the European Union and the Preference to Vote to Leave or Remain - PMC |
| Meta Description | European politicians have become increasingly concerned about the possible distorting effects of citizens not only being uninformed, but systematically misinformed about the European Union (EU). Against this background, this study assesses the role ... |
| Meta Canonical | null |
| Boilerpipe Text | Abstract European politicians have become increasingly concerned about the possible distorting effects of citizens not only being un informed, but systematically mis informed about the European Union (EU). Against this background, this study assesses the role of EU knowledge in shaping the preference to vote to leave or remain in a (hypothetical) referendum on EU membership using crossânational survey data that were collected simultaneously in eight EU countries during the runâup to the 2019 EP elections. The surveys included a newly designed item battery of EU knowledge capturing both the accuracy as well as confidence in knowledge of the respondents. The results show that misinformedness is associated with a preference to leave the EU, the uninformed citizens tend to be undecided or not intending to vote, while the wellâinformed prefer to remain. Overall, our findings contribute to the ongoing debates about the role of misinformation in politics. Keywords: misinformedness, European Union, referendum, political knowledge, confidence in knowledge Introduction In recent years, European politicians and political observers have become increasingly wary about voters being misinformed about politics. Most notably, the Brexit referendum played a critical role in triggering such worries. In the referendum on 23 June 2016 a majority of the British people voted to leave the European Union (EU), a supranational institution it had joined 43âyears earlier in 1973. The outcome of the Brexit referendum sent financial and political shockwaves around the world generating heated debate about what has led UK citizens to vote to leave (Hobolt, 2016 ; Clarke et al ., 2017 ). In this regard, many discussions arose on citizens' informedness about the EU. Scholarly research as well as pundit discussions became also focused on the risk of a potential âdomino effectâ â that is, that similar referendums in other member states may lead to the same outcome, thus posing a severe threat to the existence of the EU itself (for example, Hobolt, 2016 ). Indeed, a necessary condition for the proper functioning of democracies is that citizens are well informed about the decisions at stake (Banducci et al ., 2017 ). Yet, mere uninformedness might not even be particularly harmful. Political ignorance â that is, the absence of information â is mostly thought to result in rather arbitrary individual errors that cancel out in the electorate at large (Converse, 1990 ; Page and Shapiro, 1992 ; Stimson, 2015 ). In contrast, misinformed people may take political action on the basis of systematically incorrect information, becoming what Hochschild and Einstein ( 2015 ) call the âactive misinformedâ. As a result, voters' misinformedness has a potential of leading to a systematic distortion of outcomes. Given the complex institutional structure of the EU and the tendency of domestic politicians to engage in a âblame gameâ with Brussels, EUârelated referendums are particularly likely to be affected by misinformedness as the issues are often crossâcutting to usual party lines (LeDuc, 2009 ). Unlike in elections where voters choose their representatives, common heuristics (Popkin, 1991 ) such as party identification cannot be applied in the same way and protect against the distorting effects of misperceptions in directâdemocratic decisions. In this paper, we therefore bring together two strands of literature â both the literature on misinformedness and EU membership preferences. Relying on the twoâdimensional conception of political knowledge introduced by Kuklinski et al . ( 1998 , 2000 ) who have emphasised the importance of confidence in one's own knowledge as a factor shaping public opinion, we designed a new item battery to measure EU informedness capturing not only the factual accuracy of beliefs regarding EU institutions and policies, but also the respondents' confidence in their knowledge about the EU. Based on this novel measure, we can distinguish not only between wellâinformed and uninformed citizens, but also focus on misinformed voters. Studying the underlying cognitions of hypothetical preferences has the advantage that we can observe the ânaturally occurringâ associations between beliefs and preferences to leave or remain in the EU in the absence of an actual ongoing campaign where active mobilization and counterâmobilization will exert an additional influence on preference formation (Hobolt and De Vries, 2016 ). Using original survey data from eight EU member states (Austria, Denmark, France, Germany, Hungary, Italy, Poland, Spain) collected in the context of the 2019 European Parliament elections, we demonstrate that misinformed citizens are characterized by distinct preferences regarding their country's EU membership, which sets them apart from the wellâinformed and uninformed. Our findings underline that the concept of confidence in knowledge is relevant for our understanding of public opinion. I. The TwoâDimensional Structure of Knowledge and Types of Informedness We rely on the twoâdimensional conception of knowledge as introduced by Kuklinski et al . ( 1998 , 2000 ) and as shown in Figure 1 . The first dimension is the accuracy of knowledge. Accuracy has often been simply equated with knowledge as such, leaving the second dimension which is confidence in knowledge aside. The accuracy of political knowledge can be defined as a continuum ranging from low to high amounts of factually correct information about politics that is stored in longâterm memory (Delli Carpini and Keeter, 1996 ). At the individual level, the accuracy of political knowledge has been explained by wellâknown antecedents such as political interest, education, and exposure to political news in the media (for example, Luskin, 1990 ; Delli Carpini and Keeter, 1996 ; Kwak, 1999 ). Figure 1. The Two Dimensions of Political Knowledge and Four Types of Informedness
Note : Own diagram based on Lee and Matsuo ( 2018 ). The second dimension, far less studied, is confidence in knowledge. Confidence represents âan individual's perceptions of his or her knowledgeâ (Radecki and Jaccard, 1995 , p.107). As such, confidence in knowledge can be thought of as a metaâcognition of how certain a person feels about the accuracy of his or her beliefs reflecting the availability and accessibility of information stored in memory upon retrieval. In line with this notion, Lee and Matsuo ( 2018 ) demonstrate that greater confidence is associated with lower response time, suggesting greater cognitive availability and accessibility of responses about which respondents felt confident that they are correct. The existing literature has also shown that the two dimensions â accuracy and confidence â cannot only be distinguished analytically, but also empirically each with unique antecedents and its own measurement (Park et al ., 1994 ; Radecki and Jaccard, 1995 ). While a common finding in psychological research is that confidence is positively related to accuracy (namely that citizens believe they know more when they actually do know more) (for example, Allwood and Montgomery, 1987 ; Griffin and Tversky, 1992 ), Lee and Matsuo ( 2018 ) illustrate that there is only a mild positive correlation between measures of accuracy and confidence, and that education is positively correlated with accuracy in political knowledge but not related to confidence in knowledge. Kuklinski et al . ( 2000 , pp. 794â5) mention three mental processes documented by social cognitive psychology, which may lead to overconfidence: (1) citizens are likely to draw inferences based on their observations, (2) they try to make inferences that are consistent with the information already stored in their minds, and (3) those inferences become stored as âhard dataâ that are considered to be equally valid than facts learned based on actual evidence. As a result of these cognitive mechanisms, some people tend to be overconfident. Meanwhile, overconfidence is very often associated with gender with men overestimating their abilities (Kling et al ., 1999 ; Soll and Klayman, 2004 ; Niederle and Vesterlund, 2011 ), but also with age with older persons being more likely to show patterns of overconfidence in their political reasoning (Ortoleva and Snowberg, 2015 ). Also, people with higher education seem to be more confident (Baumeister et al ., 2003 ), as do people holding more extreme political positions (Ortoleva and Snowberg, 2015 ). Based on the two dimensions of knowledge, citizens can be broadly grouped into different types of informedness. We follow Lee and Matsuo ( 2018 ) and speak of citizens as wellâinformed, uninformed, partially informed or misinformed based on the following constellations of accuracy and confidence in knowledge (see Figure 1 ): (1) wellâinformed citizens possess accurate information and are confident, (2) the misinformed hold mostly inaccurate information but are nevertheless fairly confident that they got the facts right, (3) the uninformed hold inaccurate information and lack confidence, and (4) the partially informed are rather high in accuracy but low in confidence. For us, in particular, the interplay between accuracy and confidence will be relevant in the following. II. The Relationship between EU Knowledge and EU Membership Preferences Based on normative notions of democracy, it is desirable that citizens possess an enlightened understanding of politics (Dahl, 1989 ) and use this to decide what serves their interests best. A certain level of accurate political information is thought to be fundamentally important for citizens' ability to match their preferences and interests with specific public issues and to promote political participation (for example, Delli Carpini and Keeter, 1996 ). Thus, the notion prevails that a lack of factual information tends to misguide citizens in their policy preferences and behaviours (Kuklinski et al ., 2000 ) and biases the shape of collective opinion (Althaus, 2003 ). But accuracy is not all that matters. Confidence in knowledge influences politically relevant behaviours as well. For example, confidence in knowledge tends to make people less likely to search for information (Dancey and Sheagley, 2013 ), and much more likely to rely on cognitive shortcuts such as their prior beliefs and preferences (Koch, 2003 ). What is more, voters possessing high confidence are more likely to believe that they have all the knowledge they need to make a decision (Weary and Jacobson, 1997 ; Tiedens and Linton, 2001 ). Low accuracy in pair with high confidence may thus mislead citizens' political choices and distort their opinions at much higher rates â leading to false evaluations of events, processes or threats â rather than when they just hold inaccurate information alone (Lewandowsky et al ., 2005 ; Flynn et al ., 2017 ). Various circumstances contribute to European citizens being misinformed about the EU. Courts and legal scholars have described the EU with regard to its institutional design as a creation sui generis , with little historical or international precedent for citizens to compare it to. Democratic processes at the EU level are fairly complex with some scholars pointing to its democratic deficit (Follesdal and Hix, 2006 ). Despite reforms and the strengthened role of the European Parliament, policyâmaking at the EU level remains highly complex. The interplay and powerâsharing among various institutions at the EU level and the nation states seems to provide ample opportunity for misunderstandings of how democracy in the EU actually functions and what the role of the member states is. It is thus perhaps not surprising that knowledge of the EU is consistently found to be lower compared to knowledge of national or local level of politics (for example, Rapeli, 2014 ). Previous research has also shown that national politicians tend to engage in a âblame gameâ with Brussels, obfuscating their own role in the decisionâmaking process at the EU level, portraying actions by the EU as illegitimate external interference, and characterizing the EU as an overly powerful bureaucratic and wasteful entity (for example, Schlipphak and Treib, 2017 ). In recent years, with the EU facing several crises (Baglioni and Hurrelmann, 2016 ) it often was portrayed in dramatised ways by the news media. In the face of the actual level of complexity, misleading domestic portrayal of EU politics, and repeatedly occurring dramatised crisis events, it does not seem surprising that some citizens may misperceive the working and competences of the EU resulting in distorted evaluations thereof. Hypotheses What expectations follow based on these considerations for opinion formation of preferences in a (hypothetical) referendum on EU membership? We derive as a first expectation that the wellâinformed will be more likely to prefer to remain in the EU than those with views being distorted by common portrayals of the EU as an illegitimate actor. This does not necessarily mean that âto know it, is to love itâ (Karp et al ., 2003 , p. 271), but suggests that the wellâinformed will show somewhat greater support than those drawing inferences based on common distorted portrayals. Previous research provides support for this expectation. Empirically, for instance, Inglehart ( 1970 , p. 54) finds that âcognitive mobilization [is] the most powerful predictor of proâEuropean attitudesâ confirming that âall information about [EU] integration promotes [EU] supportâ (Gabel, 1998 , p. 335). Likewise, Janssen ( 1991 , p. 459) shows that âa higher level of political skills is indeed strongly related to a more supportive attitude towards integration and EC membershipâ and Anderson ( 1998 , p. 589) finds that âinterest in EU politics was the most significant and consistently important variable affecting support for EU membershipâ. Following the theory of cognitive mobilization (Inglehart, 1970 ), the supposed mechanism behind this association is that wellâinformed citizens will overall feel more familiar with EU matters and will hence perceive the EU as less threatening. Based on that, we can infer that those holding accurate beliefs with confidence are the most likely to support the membership of their country in the EU. This leads to our first hypothesis: Hypothesis 1 High accuracy of knowledge in conjunction with high levels of confidence in knowledge about the EU is positively related to voting to remain in a hypothetical referendum on EU membership. Secondly, we expect the misinformed to be the most likely to display a preference of voting to leave. Previous research has quite consistently documented an association between misinformedness, antiâestablishment attitudes and voting behaviour. For instance, van Prooijen and Krouwel ( 2019 ) found that low knowledge but high confidence about a specific political event tend to predict an antiâestablishment vote. This is confirmed by van Kessel etâal . ( 2021 ) who show that misinformedness relates positively to support for rightâwing populist parties. The psychological mechanisms behind this association are not fully known. However, some research suggests that perceptions of threat may play a role as also implied by the theory of cognitive mobilization. As argued above, citizens who lack accurate information about the EU may perceive the EU, which is based on blameâportrayals and dramatised crisis events as threatening, creating the desire for seemingly simple solutions such as leaving the EU altogether. In a similar vein, some research suggests that the psychological link between an antiâestablishment vote and support for rightâwing populism may in part be due to the association between antiâestablishment thinking and attractiveness to conspiracy beliefs (Castanho Silva et al ., 2017 ), which have also been linked to perceptions of threat and times of uncertainty (van Prooijen and Douglas, 2018 ). Apart from that, the complexity of EU politics may matter. Facing overwhelming complexity, accurate information can be hard to come by and citizens are often faced with the challenge of verifying claims of unknown veracity. With the hard data being essentially inaccessible, people tend to âfill in the blanksâ (Kuklinski et al ., 2000 , p.794) drawing their own inferences based on their observations from everyday life generating simple, subjectively consistent narratives that reduce realâworld complexity. It is known that the stronger the initial opinion, the less likely one is to correct oneself and remains open to bias and inaccurate information (Cromby, 2019 ). This means that inaccurate information is likely to be fuelled by further inaccurate information increasing confidence in wrongly held beliefs against the EU fuelling even greater Euroscepticism (De Vreese, 2007 ). What further adds to the prevalence of misinformedness is that some people tend to feel overconfident and mistakenly treat inferences as hard data (Kuklinski et al ., 2000 ), even when they arrived at those (false) conclusions based on inaccurate information or biased informationâprocessing. These theoretical considerations lead to our next hypothesis: Hypothesis 2 Low accuracy of knowledge in conjunction with high levels of confidence in knowledge about the EU is positively related to voting to leave in a hypothetical referendum on EU membership. Finally, it follows that citizens low on confidence in knowledge are less likely to make use of their beliefs when forming judgments and deciding on political actions. This has been demonstrated, for instance, by research on the impact of uncertainty in perceptions of issue positions: Citizens who feel uncertain about the positions of political parties are less likely to base their judgment and voting decisions on them (Alvarez and Franklin, 1994 ). Confidence is also strongly related with indifference and ambivalent views regarding politics and political candidates. Existing studies indicate that indifference and ambivalence reduce citizens' motivation to be politically active with uninformed voters overall less likely to vote or engage politically (for example, Huckfeldt et al ., 2004 ; Mutz, 2006 ). This point is also supported by Lee and Matsuo ( 2018 ) who show that confidence relates to the frequency of political discussions, which is an important antecedent of forming an opinion and participation in politics. As a result, citizens with low confidence in knowledge â the uninformed and partially informed citizens â may decide not to turn out to vote, or remain rather undecided. From this follows our last hypothesis: Hypothesis 3 Regardless of the accuracy of knowledge, low confidence in knowledge about the EU is positively related to being undecided about remain or leave, or choosing to abstain in a hypothetical referendum on EU membership. III. Data and Methods To evaluate the impact of accuracy of and confidence in EU knowledge on the evaluation of one's country's future in the EU, we make use of the data gathered by the RECONNECT and AUTNES project during the 2019 EP elections. As part of these projects, surveys were conducted simultaneously in eight EU countries, namely Austria, Denmark, France, Germany, Hungary, Italy, Poland and Spain (Aichholzer et al ., 2020 ; Plescia et al ., 2020 ). The country sample covers a variety of EU democracies, including old and new member states as well as countries from East and West and North and South of Europe. The country sample also spans considerably different contexts in terms of longâstanding attitudes towards the EU (Hobolt and De Vries, 2016 ; Kritzinger et al ., 2020 ). While the original study included two survey waves, for this paper, we will make exclusive use of the preâelection data that was gathered in April 2019 since this wave included all relevant measures of both our dependent and independent variables. The data were collected as quota samples via online access panels, with quotas closely mirroring the population distributions of key demographics, namely age, gender, education and region. In all analyses, in addition, postâstratification weights were applied to match population targets. The dependent variable in our analysis is the question of how respondents would vote in a hypothetical referendum. We study vote choice in a hypothetical referendum on the EU which means that we will be able to focus on the impact of our main independent variable â that is, citizens' informedness on vote choice â net of the influence of the role of elites in shaping the information environment and campaign effects taking place during a real referendum campaign.
1 The question wording is as follows: âIf there was a referendum about staying or leaving the EU in [COUNTRY], how would you decide?â. The answering options are â[COUNTRY] staying in the EUâ, â[COUNTRY] leaving the EUâ, âI am undecidedâ, and âI would not voteâ. We collapse the undecided and nonâvoters into one category as we have the same hypothesis for these two categories. As a result, our dependent variable groups respondents into three categories (Remain, Leave, and Undecided/NonâVoter). With regards to our independent variables, the surveys included a battery of knowledge questions on the EU similar to those usually asked in other Europeâwide studies. The five questions covered, in particular, the major institutions of the EU involved in the policy process at the European level such as the European Parliament, the European Commission, and the Council of the European Union. The battery also included one question on EU policies and the budget. These questions constitute conventional measures of EU politics since they refer to the functioning of the EU political system and the actors involved, and are all relevant to EU politics as well as the daily lives of EU citizens. Appendix A includes the full question wording. All knowledge questions can be considered ideologically neutral since they are not necessarily more or less ideologically convenient for respondents preferring their country to remain an EU member or rather to leave the EU (our dependent variable).
2 Further below we discuss robustness checks showing that the results are robust to the use of partial subsets of the knowledge items. Each knowledge question offered four answering options, with one being correct and three being false. Respondents were instructed to give their best guess if they did not know the answer. This means that there was no explicit âDo not Knowâ response option available to respondents. This is first, to avoid that unequal propensities to opt for a âDo not Knowâ answer affect the results (Mondak and Creel Davis, 2001 ), and second, to accommodate for the substantial gender differences in the use of such an answer category (Fraile, 2013 ). Instead, after answering each of the knowledge questions, respondents are asked in a followâup question to indicate how certain they are that their answer is correct on a 11âpoint scale from 0 to 10, capturing the respondents' confidence in knowledge in the same way as suggested by previous research evaluating the role of misinformedness (Kuklinski et al ., 2000 ; Lee and Matsuo, 2018 ). Figure 2 shows the distributions of the responses on the knowledge questions with respondents answering some questions more correctly than others. The question on the EP members being elected by citizens was answered correctly by 69 per cent of the respondents, whereas 31 per cent answered incorrectly. A slim majority, 52 per cent, also answered the question on the approval vote for the President of the European Commission correctly. The remaining three questions were answered incorrectly by a majority of the respondents. Sixty per cent were not able to identify the statement regarding the administrative costs being the largest item of the EU budget as false. Sixtyâeight per cent could not identify the institution at the EU level in which national governments are being represented by their ministers. And, 71 per cent could not name the European Commission as the institution with the formal right to initiate laws at the EU level. These apparently were harder knowledge questions. Figure 2. Accuracy of and Confidence in EU Knowledge
Note : Pooled data for Austria, Denmark, France, Germany, Hungary, Italy, Poland and Spain ( N â=â16.523, weighted). Despite the variation in difficulty across the items measuring the accuracy of knowledge, there are fewer differences in the level of confidence, as shown by the rightâhand panel in Figure 2 . Respondents felt the most confident when answering the question on the EP, with 51 per cent indicating that they felt rather confident about their answer being correct.
3 For the remaining questions the level of confidence was slightly lower ranging from 33 to 43 per cent. Overall, the patterns suggest that confidence in knowledge varies less across items than accuracy. To build a scale of the accuracy of EU knowledge, we fit a twoâparameter logistic IRT model using the binary knowledge items (Thissen and Orlando, 2001 ). The twoâparameter model allows for varying difficulty and discrimination of the items, and is commonly identified by assuming that the latent knowledge variable follows a standard normal distribution (Bock and Lieberman, 1970 ). The item characteristic curves in Figure 3 confirm that the item on the EP was a fairly easy one, whereas the item of the Commission's right to initiate new laws was the hardest. At the lower end of the latent scale, the probability to answer any of the items correctly is fairly low. In contrast, at higher levels of the knowledge scale, the respondents have a fairly high propensity to answer all items correctly. The items on the EP members and the Council of the EU show the steepest slopes, meaning that they possess high discriminatory value. We extract the latent scores from the response model and use them as our measure of EU knowledge accuracy in the subsequent analyses. Figure 3. Item Characteristics Curves and Correlation Matrix
Note : Pooled data for Austria, Denmark, France, Germany, Hungary, Italy, Poland and Spain ( N â=â16.523). To build a scale of confidence in knowledge, we ran a factor analysis on the 11âpoint scales capturing confidence. The results suggest that these items strongly load on one single factor. The rightâhand panel in Figure 3 shows the correlation matrix between the individual items and the extracted factor scores. We can observe that all items are strongly correlated with this scale of confidence in knowledge. The factor scores will enter the analysis as our measure of EU knowledge confidence.
4 The correlation between our scale of accuracy of and confidence in knowledge is 0.34. Thus, although there is a moderate positive association between accuracy and confidence, we can confirm in line with previous research (Lee and Matsuo, 2018 ) that the two distinct analytical concepts are also empirically distinguishable. The analysis proceeds in two steps: First, we explore the univariate and bivariate distributions of the dependent and main independent variables. Then, we run a multinomial logistic regression model as our dependent variable has three (unordered) categories. As our research design is crossâsectional, it is particularly important to include a broad array of control variables to account for potential confounders. Several sociodemographic and nonâsociodemographic factors have been used to explain why people have chosen to vote to leave or remain in the Brexit referendum. Thereby, Leave voters were predominantly found among the more economically disadvantaged working classes, the less educated, and older voters (Goodwin and Heath, 2016 ). Further research indicated that also the lack of political trust, the absence of a European identity, rightâwing political leanings, antiâimmigration, antiâfree trade and antiâestablishment attitudes played a role in the vote to leave (Hobolt, 2016 ). We therefore include as control variables key sociodemographic factors such as age, gender, and education as well as various measures of political attitudes and political involvement. We specifically include retrospective assessments of national and personal economic conditions, political selfâplacement on the leftâright and the European integration dimension, attitudes towards immigration (âimmigrants take away jobsâ, ârestricted access to welfare for immigrantsâ) and free trade (âfree is a good vs. bad thingâ), trust in national and European institutions, a measure of European identity (âfeeling close to Europeâ), and satisfaction with democracy at the EU level. We also control for political interest and a measure of internal political efficacy. Political interest is measured on a fourâpoint scale (from 0 ânot interested at allâ to 3 âvery interestedâ). The scale of internal political efficacy was formed based on two items (âI have a good understanding of the important political issues facing the European Unionâ and âI consider myself well qualified to participate in EU politicsâ) using factor analysis. In the same way, the measure of antiâestablishment attitudes was constructed based on two items (âGovernment is run by a few big interestsâ, âGovernment officials use power to improve people's livesâ, reversed coding). We also include countryâfixed effects along with clustered standard errors. Apart from the control variables, the models include the aboveâdescribed scales of EU knowledge accuracy and confidence as well as an interaction between these two primary independent variables. The interaction term is particularly critical as it allows testing for the distinct effect of misinformedness, when people think they do know, but in truth they do not. If misinformedness plays a role in shaping the preference to vote leave or remain, we should see that confidence in EU knowledge is related to a preference to vote to leave at low levels accuracy, whereas it is expected to be associated with voting to remain at high level of accuracy of EU knowledge. IV. Analysis and Results Figure 4 shows the distribution of preferences to remain and to leave the EU in the eight member states. In all countries under scrutiny, a majority of citizens would vote to remain in the EU. However, in some countries this majority is fairly slim, with 50 per cent in Italy, 52âper cent in France, and 55 per cent in Austria. The preference for leaving the EU is strongest in Denmark, Italy, Austria, and France, with values ranging from 20 to 24 per cent. It is smallest in the Eastern European member states, Poland and Hungary, and in Spain, with about 10 to 11 per cent. Germany, with 15 per cent of leavers, lies in the midfield. Although preferences to leave are a minority position, this minority is quite sizable in some member states. It is also worth noting that a sizable minority is undecided or preferring not to vote on this question, with the share of respondents in this group ranging from 15 to 28 per cent. Figure 4. Preferences to Leave or Remain in the EU. How are these preferences distributed across levels of EU knowledge accuracy and confidence? Figure 5 shows the heatmap of the preference to leave and remain as well as for undecided/nonâvoters along the two dimensions of EU knowledge. The first map on the leftâhand side shows the share of preferences to remain. The highest shares can be found in the upper right quadrant (dark grey and black) where 73 to 81 per cent (and more) would vote to remain in a hypothetical referendum. This quadrant includes the wellâinformed voters with above average accuracy ( x âaxis) and confidence in their EU knowledge ( y âaxis). Figure 5. Informedness and the Preference to Leave or Remain in the EU
Note : Pooled data for Austria, Denmark, France, Germany, Hungary, Italy, Poland and Spain ( N â=â16.523, weighted). The second heatmap in the middle of the plot shows the distribution of preferences to leave. The maximum support is found in the most up left corner, with more than 40 per cent showing a preference to leave. But also slightly below that, at low levels of accuracy with fairly high levels of confidence, the support for leave is fairly strong. Leave support is lower at the highest levels of accurate information, in particular, among those who feel confident in their knowledge about the EU. Finally, the third heatmap shows the distribution of the undecided and nonâvoters. The highest share of undecided and nonâvoters can be found in the lower left quadrant. But also in the lower right quadrant some undecided/nonâvoting citizens can be found. The minimum values for undecidedness/nonâvoting can be found in the upper right quadrant, hence, among the wellâinformed. Overall, these descriptive results give a first support for our three hypotheses, but we now move to the multivariate analysis. We conduct a multinomial regression analysis of EU membership preferences, including our measures of accuracy and confidence as well as an interaction term among them alongside with our control variables. For the full estimation table, see Table B1 in Appendix B . As interaction effects are notoriously difficult to interpret in nonâlinear models, we opt for a visual inspection of the continuousâbyâcontinuous interaction relying on average marginal effects calculated based on the observed value approach (Hanmer and Kalkan, 2013 ). Specifically, we plot the average marginal effect of confidence over the range of accuracy (Figure 6 ) as well as the average marginal effect of accuracy over varying levels of confidence (Figure 7 ).
5 If our three hypotheses are confirmed, we should see in Figure 6 that confidence at high levels of accuracy is associated with a higher probability to prefer to remain (Hypothesis 1 ), that confidence at low levels of accuracy is associated with a higher probability to prefer to leave (Hypothesis 2 ), and that confidence should coincide with greater chances of being undecided/nonvoting, at all levels of accuracy (Hypothesis 3 ). Likewise, Figure 7 should show that accuracy at high levels of confidence relates to a greater probability of a preference to remain and to a lower chance to vote to leave. Figure 6. Average Marginal Effects of EU Knowledge Confidence
Note : The dots show the average marginal effects of confidence in knowledge across varying levels of accuracy with 95% confidence intervals. Figure 7. Average Marginal Effects of EU Knowledge Accuracy
Note : The dots show the average marginal effects of accuracy in knowledge across varying levels of confidence with 95% confidence intervals. Figures 6 and 7 confirm all three of these expectations. The first panel of Figure 6 shows the marginal effect of confidence across varying levels of accuracy on the preference to remain. In line with Hypothesis 1 , we see that at the highest levels of accuracy, a unit shift in confidence is significantly associated with a higher probability of approximately 2 percentage points to vote to remain. In other words, wellâinformed citizens who have a very accurate understanding of the EU and great confidence in their judgment are more likely to vote to remain in a hypothetical referendum. For the preference to leave, in line with Hypothesis 2 , we see a reversed pattern in the second panel of Figure 6 . At the lowest level of accuracy, a unit shift in confidence is significantly associated with a higher probability of voting to leave, of about 3.5 percentage points. In other words, misinformed voters who hold highly inaccurate EU views but who strongly feel confident about their (inaccurate) EU knowledge, are more likely to vote leave. Finally, confirming Hypothesis 3 , we see in the right panel of Figure 6 a constant negative association of a unit shift in confidence on the chances of being undecided/nonâvoting, with no significant variation across levels of EU knowledge accuracy. This suggests that voters who fundamentally lack confidence in how much or how little they know about the EU are most likely to remain undecided or to not vote at all â independent of their knowledge accuracy. Lastly, Figure 7 adds further confirmation to Hypotheses 1 and 2 showing that at high levels of confidence accuracy is with a higher probability to prefer remain and a lower probability of voting to leave.
6 The full results for our control variables, we document in Appendix B and only briefly summarise the main observed patterns here. We find that male respondents are more opinionated, preferring more often to vote to remain as well as to leave than female respondents, who are more likely to remain undecided or not vote at all. In line with previous research, we find that the highly educated are more likely to vote to remain and less likely to vote to leave. Interestingly, we see no significant associations with the assessment of national and personal economic conditions. In terms of political attitudes, we find that leftâwing voters prefer to vote to remain whereas rightâwing voters show a preference for leaving. Without great surprise, respondents in favour of further EU integration prefer remaining and disfavour leaving. Antiâimmigration attitudes and, most notably, perceived labour market competition (âimmigrants take away jobsâ) are associated with a greater preference to leave and lower chance to vote remain. A proâfreeâtrade attitude is correlated with a higher chance to prefer remaining in the EU. When it comes to trust, we see that respondents trusting the EP show a greater chance to vote to remain rather than to leave. The same pattern emerges for a European identity and satisfaction with EU democracy: Those feeling close to Europe and those satisfied with EU democracy are more likely to vote to remain and less likely to vote to leave. In contrast, citizens with an antiâestablishment attitude, prefer to vote to leave. Concerning political involvement, we see that politically interested respondents are less likely to be undecided or not voting. For internal political efficacy â the general subjective feeling of competence in EU matters â we find that voters feeling more competent are more likely to vote to leave. V. Robustness Checks and Discussion The analysis thus far shows that the misinformed are more likely to prefer voting to leave the EU whereas wellâinformed citizens prefer to remain. Is this a methodological artefact based on a biased selection of knowledge questions? What are the underlying causal mechanisms? To investigate whether our knowledge items offer a particularly beneficial portrayal of the EU, we conduct two robustness checks. First, we drop two of the items that may seem to shed a somewhat beneficial light on the EU, namely the item on the approval vote for the EC president and the share of administrative costs in the budget. We rerun all steps of the analysis excluding those two items to see whether the inclusion of the specific items produced our results. This, however, is not the case as all substantial results remain completely unchanged (see Appendix C1 ). Second, to assess whether misinformed voters selectively guessed more negative answers, we compare the patterns of the responses for each item between uninformed and misinformed respondents. We find that the response patterns for uninformed and misinformed voters to be fairly similar (see Appendix C2 ). If anything, misinformed voters selected answers that we would expect to shed a more positive light on the EU. For instance, misinformed voters more often believed that the right to propose new laws resides with the EP than uninformed or wellâinformed voters. Based on these robustness checks, we conclude that our findings are not driven by single items or a particularly beneficial portrayal of EU politics.
7 The statistical association we find can be the result of two different underlying causal processes based on the theory of motivated reasoning (Lodge and Taber, 2013 ; Druckman and McGrath, 2019 ): (1) Accuracyâmotivated citizens may try to seek out objective information from sources that they subjectively believe to be highly credible and update their preferences accordingly, or (2) directionallyâmotivated citizens may deliberately seek out and selectively absorb information which confirms their prior beliefs. While the goal of accuracyâmotivated reasoners is to arrive at accurate conclusions, the directionallyâmotivated reasoners instead are driven by some directional goal such as maintaining their identity or affinity to a group status. Unfortunately, as Druckman and McGrath ( 2019 ) point out, these two processes are often observationally equivalent, and even cleverly designed experimental designs have struggled to disentangle those mechanisms. Previous research in general seems to suggest that the relationship between attitudes and knowledge is a mutual one (Kim et al ., 2010 ). Therefore, we wish to acknowledge that reverse causality may have produced or contributed to the patterns observed. We believe that our analysis provides a number of relevant insights and theoretical and practical conclusions that can be drawn based on the observed patterns. First, the analysis confirms that both of the two dimensions of knowledge matter and are related to preference formation in distinct ways, with the lack of confidence being associated with less opinionation and willingness to participate. Second, simply providing the misinformed with correct information may not change their views, giving their high levels of confidence in inaccurate information regarding the EU. Likewise, a part of the electorate might be quite resilient against the spread of misinformation online or elsewhere as a nonânegligible proportion of citizens already hold accurate information confidently. Finally, given that we control for various confounders, we can establish that our measurement of knowledge does not simply capture underlying motivations that have already been demonstrated to be associated with preferences regarding EU membership, but we rather add one factor relevant to our understanding of the support and opposition to the EU. Having said that, it should also be stated that the magnitude of the association with the two dimensions of knowledge are relatively modest. Hence, if voters were to become more misinformed, it would most likely only make a substantial difference if the vote margin in a referendum would be close, which currently is not the case in the postâBrexit EU member states. At the same time, concerns about misinformed voters should not be underestimated either, given the potentially farâreaching consequences and as, most notably, we already know that referendum preferences can develop in highly dynamic ways, once an actual campaign is underway (LeDuc, 2009 ). As soon as this happens, it might be too late to build resilience against false information as this may require longâterm efforts of educating citizens about EU politics. Conclusion In recent years, the concern about voters being misinformed about EU politics has been growing. The shock of the Brexit referendum has caused fears about similar events happening elsewhere and led many to question whether people understand the EU properly. While previous research has often pointed to voters being largely uninformed as a problem for democracy, voters being misinformed pose an even bigger threat to democracy. As discussed in this paper, there are good reasons to suspect that EU referendums are particularly likely to be affected by the consequences of voters being misinformed. Based on a twoâdimensional conception of knowledge, we review the literature and identify several strands of research that link the two dimensions of knowledge with EU membership preferences. We expect misinformed voters to prefer voting to leave and wellâinformed voters to prefer to vote remain. The uninformed and partially informed voters, in contrast, we expect to remain undecided or not to vote. We evaluate these expectations by making use of an original dataset covering eight EU member states and including a newly designed battery to measure different types of informedness. The results confirm our theoretical expectations. Even when controlling for various other factors influencing preferences to leave or to remain in the EU, citizens who hold inaccurate views about the EU with great confidence are more likely to prefer voting to leave. In contrast, voters holding accurate beliefs about EU democracy with great confidence prefer voting to remain. Uninformed and partially informed voters, those with a lack of confidence in their knowledge about the EU, in general are less likely to express a clear preference. They mostly are undecided or prefer not to vote. The fact that the preference of voting to leave is associated with citizens being misinformed has important implications for understanding the opposition to the EU. Most notably, debunking inaccurate information about the EU by factâchecking and educating citizens as an attempt to increase EU support among the misinformed might be deemed to fail given the high level of confidence in this group. Classical approaches such as information campaigns and factâchecking could still, though, be effective for the uninformed and partially informed to prevent them from drifting into the group of the misinformed. As overall this group is considerably large, this is an important task for the future efforts. Future research should focus, in particular, on examining the sources of confidence and lack of accuracy and the design of effective counterstrategies, taking into account the underlying cognitive structure of the misinformed mind. Additionally, it should also look into who is misinformed and who is uninformed about the EU, how these distributions evolve over time, and also explore the linkage between factual knowledge about the EU and systemic knowledge about political affairs. Eventually, future research should also try to unpack the complex causal relationship between accuracy of and confidence in political knowledge on the one hand, and EU membership preferences on the other. Such tests will require longitudinal data to assess the extent to which one influences the other. This paper shows indeed that the association between accuracy of, confidence in knowledge and political decisions is indeed noteworthy and relevant to further research. Funding Data collection of the RECONNECT dataset was supported by the Horizon 2020 Framework Programme (Grant no. 770142) and data collection of the AUTNES dataset was supported by the Austrian Science Fund (Grant no. S10902âG11). Supporting information Table S1. B1 : Multinomial logistic regression for EU referendum preference. Figure S1. B1 : Average marginal effects for control variables. Figure S2. C1â1: Item characteristics curves and correlation matrix (reduced scale). Figure S3. C1â2: Informedness and the preference to leave or remain in the EU (reduced scale). Figure S4. C1â3: Average marginal effects of EU knowledge confidence (reduced scale). Figure S5. C1â4: Average marginal effects of EU knowledge accuracy (reduced scale). Table S6. C1â1 : Multinomial logistic regression for EU membership preference (reduced scale). Figure S7. C1â5 : Average marginal effects for control variables (reduced scale). Table S8. C2â1: Shares of different types of informedness. Table S9. C2â2: Response patterns across types of informedness. Figure S10. C3â1 : Item characteristics curves â by country. Figure S11. C3â2 : Correlation matrices â by country. Figure S12. C3â3 : Heatmaps â by country. Figure S13. C3â4 : Average marginal effects of EU knowledge confidence â by country. Figure S14. C3â5 : Average marginal effects of EU knowledge accuracy â by country. Figure S15. D1 : Univariate distribution of predicted scores for accuracy and confidence. Figure S16. D2 : Scree plot and correlation matrix. Table S17 . D1. Eigenvalues. Table S18 . D2. Factor loadings and unique variances. Figure S19. E1. Predicted probabilities for accuracy at low and high levels of confidence. Figure S20. E2. Predicted probabilities for confidence at low and high levels of accuracy.
PartheymĂźller, J.
,
Kritzinger, S.
, and
Plescia, C.
(2022) Misinformedness about the European Union and the Preference to Vote to Leave or Remain. JCMS: Journal of Common Market Studies, 60: 1449â1469. 10.1111/jcms.13316.
Footnotes 1 It is also worth noting that our survey took place more than a month before the EP elections 2019 and hence well before the various proâ and antiâEU messages could become part of the EP election campaign, which in the countries under scrutiny in this paper only started a few weeks before the elections (see Kritzinger et al ., 2020 ). In the countries we cover, even during the election campaign parties' proâ and antiâEU positions never really translated into a call for an EUâexit referendum since a majority of the population was clearly against it (see Kritzinger et al ., 2020 ). 2 Kuklinski et al . ( 2000 ) suggest that biased responses in their answer are suggestive of a certain direction (pro /antiâwelfare). In our case, we believe that being wrong (regardless of the direction) is most likely to lower support in the EU as it shows a lack of understanding of how the EU works. Even beliefs that suggest that the EU would be more democratic than it actually is, can lead to dissatisfaction by raising false expectations about what EU institutions can do. We believe that support for the EU requires a realistic perception of the EU to understand not only its legitimacy but also its constraints. 3 For visual representation the categories of the 11âpoint scale of confidence in knowledge were recoded as follows: 0â4 ârather unconfidentâ, 5 âmiddlingâ 6â10 ârather confidentâ. 4 Appendix D shows the univariate distribution of the measures of accuracy and confidence and provides additional methodological details. 5 Appendix E includes an alternative way of representing the continuousâbyâcontinuous interaction based on predicted probabilities. 6 We did not derive any expectation with regard to the effect of accuracy on the chances of being undecided or a nonâvoter. Yet, for completeness we also report in the third panel of Figure 7 the corresponding result. We see that accuracy at all levels of confidence decreases the chances of being undecided or nonâvoting. 7 We have reârun all our descriptive and multivariate analyses also countryâbyâcountry. The results can be found in Appendix C3 . No substantial country differences could be spotted, providing evidence for a consistent association between the type of informedness and support for EU membership across countries. References
Aichholzer, J.
,
PartheymĂźller, J.
,
Wagner, M.
,
Kritzinger, S.
,
Plescia, C.
,
Eberl, J.âM.
,
Meyer, T.
,
Berk, N.
,
Boomgaarden, H.
&
MĂźller, W.C.
(2020) AUTNES Online Panel Study 2017â2019. Vienna: AUSSDA. 10.11587/QDETRI
[ DOI ] [ Google Scholar ]
Allwood, C.M.
and
Montgomery, H.
(1987) âResponse Selection Strategies and Realism of Confidence Judgmentsâ. Organizational Behavior and Human Decision Processes, Vol. 39, No. 3, pp. 365â383. [ Google Scholar ]
Althaus, S.L.
(2003) Collective Preferences in Democratic Politics. Opinion Survey and the Will of the People (Cambridge: Cambridge University Press; ). [ Google Scholar ]
Alvarez, R.M.
and
Franklin, C.H.
(1994) âUncertainty and Political Perceptionsâ. Journal of Politics, Vol. 56, No. 3, pp. 671â688. [ Google Scholar ]
Anderson, C.J.
(1998) âWhen in Doubt, Use Proxies: Attitudes toward Domestic Politics and Support for European Integrationâ. Comparative Political Studies, Vol. 31, No. 5, pp. 569â601. [ Google Scholar ]
Baglioni, S.
and
Hurrelmann, A.
(2016) âThe Eurozone Crisis and Citizen Engagement in EU Affairsâ. West European Politics, Vol. 39, No. 1, pp. 104â124. [ Google Scholar ]
Banducci, S.
,
Giebler, H.
and
Kritzinger, S.
(2017) âKnowing More from Less: How the Information Environment Increases Knowledge of Party Positionsâ. British Journal of Political Science, Vol. 47, No. 3, pp. 571â588. [ Google Scholar ]
Baumeister, R.F.
,
Campbell, J.D.
,
Krueger, J.I.
and
Vohs, K.D.
(2003) âDoes High Selfâesteem Cause Better Performance, Interpersonal Success, Happiness, or Healthier Lifestyles?â Psychological Science in the Public Interest, Vol. 4, pp. 1â44. [ DOI ] [ PubMed ] [ Google Scholar ]
Bock, R.D.
and
Lieberman, M.
(1970) âFitting a Response Model For n Dichotomously Scored Itemsâ. Psychometrika, Vol. 35, No. 2, pp. 179â197. [ Google Scholar ]
Castanho Silva, B.
,
Vegetti, F.
and
Littvay, L.
(2017) âThe Elite Is up to Something: Exploring the Relation between Populism and Belief in Conspiracy Theoriesâ. Swiss Political Science Review, Vol. 23, No. 4, pp. 423â443. [ Google Scholar ]
Clarke, H.D.
,
Goodwin, M.
and
Whiteley, P.
(2017) âWhy Britain Voted for Brexit: An IndividualâLevel Analysis of the 2016 Referendum Voteâ. Parliamentary Affairs, Vol. 70, No. 3, pp. 439â464. [ Google Scholar ]
Converse, P.E.
(1990) âPopular Representation and the Distribution of Informationâ. In
Ferejohn, J.A.
and
Kuklinski, J.H.
(eds) Information and Democratic Processes (Urban: University of Illinois Press; ), pp. 369â388. [ Google Scholar ]
Cromby, J.
(2019) âThe Myths of Brexitâ. Journal of Community & Applied Social Psychology, Vol. 29, No. 1, pp. 56â66. [ Google Scholar ]
Dahl, R.A.
(1989) Democracy and its Critics (New Haven: Yale University Press; ). [ Google Scholar ]
Dancey, L.
and
Sheagley, G.
(2013) âHeuristics Behaving Badly: Party Cues and Voter Knowledgeâ. American Journal of Political Science, Vol. 57, No. 2, pp. 312â325. [ Google Scholar ]
De Vreese, C.H.
(2007) âA Spiral of Euroscepticism: The Media's Fault?â Acta Politica, Vol. 42, No. 2â3, pp. 271â286. [ Google Scholar ]
Delli Carpini, M.X.
and
Keeter, S.
(1996) What Americans Know about Politics and Why It Matters (New Haven: Yale University Press; ). [ Google Scholar ]
Druckman, J.N.
and
McGrath, M.C.
(2019) âThe Evidence for Motivated Reasoning in Climate Change Preference Formationâ. Nature Climate Change, Vol. 9, No. 2, pp. 111â119. [ Google Scholar ]
Flynn, D.J.
,
Nyhan, B.
and
Reifler, J.
(2017) âThe Nature and Origins of Misperceptions: Understanding False and Unsupported Beliefs about Politicsâ. Political Psychology, Vol. 38, No. S1, pp. 127â150. [ Google Scholar ]
Follesdal, A.
and
Hix, S.
(2006) âWhy There Is a Democratic Deficit in the EU: A Response to Majone and Moravcsikâ. JCMS: Journal of Common Market Studies, Vol. 44, No. 3, pp. 533â562. [ Google Scholar ]
Fraile, M.
(2013) âDo InformationâRich Contexts Reduce Knowledge Inequalities? The Contextual Determinants of Political Knowledge in Europeâ. Acta Politica, Vol. 48, No. 2, pp. 119â143. [ Google Scholar ]
Gabel, M.
(1998) âPublic Support for European Integration: An Empirical Test of Five Theoriesâ. Journal of Politics, Vol. 60, No. 2, pp. 333â354. [ Google Scholar ]
Goodwin, M.J.
and
Heath, O.
(2016) âThe 2016 Referendum, Brexit and the Left Behind: An AggregateâLevel Analysis of the Resultâ. Political Quarterly, Vol. 87, No. 3, pp. 323â332. [ Google Scholar ]
Griffin, D.
and
Tversky, A.
(1992) âThe Weighing of Evidence and the Determinants of Confidenceâ. Cognitive Psychology, Vol. 24, No. 3, pp. 411â435. [ Google Scholar ]
Hanmer, M.J.
and
Kalkan, K.O.
(2013) âBehind the Curve: Clarifying the Best Approach to Calculating Predicted Probabilities and Marginal Effects from Limited Dependent Variable Modelsâ. American Journal of Political Science, Vol. 57, No. 3, pp. 263â277. [ Google Scholar ]
Hobolt, S.B.
(2016) âThe Brexit Vote: A Divided Nation, a Divided Continentâ. Journal of European Public Policy, Vol. 23, No. 9, pp. 1259â1277. [ Google Scholar ]
Hobolt, S.B.
and
De Vries, C.E.
(2016) âPublic Support for European Integrationâ. Annual Review of Political Science, Vol. 19, pp. 413â432. [ Google Scholar ]
Hochschild, J.L.
and
Einstein, K.L.
(2015) Do Facts Matter? Information and Misinformation in American Politics (Norman: University of Oklahoma Press; ). [ Google Scholar ]
Huckfeldt, R.
,
Morehouse Mendez, J.
and
Osborn, T.
(2004) âDisagreement, Ambivalence, and Engagement: The Political Consequences of Heterogeneous Networksâ. Political Psychology, Vol. 25, No. 1, pp. 65â95. [ Google Scholar ]
Inglehart, R.
(1970) âCognitive Mobilization and European Identityâ. Comparative Politics, Vol. 3, No. 1, pp. 45â70. [ Google Scholar ]
Janssen, J.I.H.
(1991) âPostmaterialism, Cognitive Mobilization and Public Support for European Integrationâ. British Journal of Political Science, Vol. 21, No. 4, pp. 443â468. [ Google Scholar ]
Karp, J.A.
,
Banducci, S.A.
and
Bowler, S.
(2003) âTo Know It Is to Love It? Satisfaction with Democracy in the European Unionâ. Comparative Political Studies, Vol. 36, No. 3, pp. 271â292. [ Google Scholar ]
Kim, S.
,
Taber, C.S.
and
Lodge, M.
(2010) âA Computational Model of the Citizen as Motivated Reasoner: Modeling the Dynamics of the 2000 Presidential Electionâ. Political Behavior, Vol. 32, No. 1, pp. 1â28. [ Google Scholar ]
Kling, K.C.
,
Hyde, J.
,
Showers, C.
and
Buswell, B.N.
(1999) âGender Differences in SelfâEsteem: A MetaâAnalysisâ. Psychological Bulletin, Vol. 125, No. 4, pp. 470â500. [ DOI ] [ PubMed ] [ Google Scholar ]
Koch, J.W.
(2003) âBeing Certain versus Being Right: Citizen Certainty and Accuracy of House Candidates' Ideological Orientationsâ. Political Behavior, Vol. 25, No. 3, pp. 221â246. [ Google Scholar ]
Kritzinger, S.
,
Plescia, C.
,
Raube, K.
,
Wilhelm, J.
&
Wouters, J.
(2020) Assessing the 2019 European Parliament Elections. London: Routledge. [ Google Scholar ]
Kuklinski, J.H.
,
Quirk, P.J.
,
Jerit, J.
,
Schwieder, D.
and
Rich, R.F.
(2000) âMisinformation and the Currency of Democratic Citizenship of Democratic Citizenshipâ. Journal of Politics, Vol. 62, No. 3, pp. 790â816. [ Google Scholar ]
Kuklinski, J.H.
,
Quirk, P.J.
,
Schwieder, D.W.
and
Rich, R.F.
(1998) ââJust the Facts, Ma'amâ: Political Facts and Public Opinionâ. Annals of the American Academy of Political and Social Science, Vol. 560, No. 1, pp. 143â154. [ Google Scholar ]
Kwak, N.
(1999) âRevisiting the Knowledge Gap Hypothesis: Education, Motivation, and Media Useâ. Communication Research, Vol. 26, No. 4, pp. 385â413. [ Google Scholar ]
LeDuc, L.
(2009) âCampaign Tactics and Outcomes in Referendumsâ. In
Setälä, M.
and
Schiller, T.
(eds) Referendums and Representative Democracy: Responsiveness, Accountability and Deliberation (Abingdon: Routledge; ), pp. 139â161. [ Google Scholar ]
Lee, S.
and
Matsuo, A.
(2018) âDecomposing Political Knowledge: What Is Confidence in Knowledge and Why It Mattersâ. Electoral Studies, Vol. 51, pp. 1â13. [ Google Scholar ]
Lewandowsky, S.W.
,
Stritzke, G.K.
,
Oberauer, K.
and
Morales, M.
(2005) âMemory for Fact, Fiction, and Misinformation: The Iraq War 2003â. Psychological Science, Vol. 16, No. 3, pp. 190â195. [ DOI ] [ PubMed ] [ Google Scholar ]
Lodge, M.
and
Taber, C.S.
(2013) The Rationalizing Voter (Cambridge: Cambridge University Press; ). [ Google Scholar ]
Luskin, R.C.
(1990) âExplaining Political Sophisticationâ. Political Behavior, Vol. 12, No. 4, pp. 331â361. [ Google Scholar ]
Mondak, J.J.
and
Creel Davis, B.
(2001) âAsked and Answered: Knowledge Levels When We Will Not Take âDon't Knowâ for an Answerâ. Political Behavior, Vol. 23, No. 3, pp. 199â224. [ Google Scholar ]
Mutz, D.C.
(2006) Hearing the Other Side: Deliberative versus Participatory Democracy (Cambridge: Cambridge University Press; ). [ Google Scholar ]
Niederle, M.
and
Vesterlund, L.
(2011) âGender and Competitionâ. Annual Review of Economics, Vol. 3, pp. 601â630. [ Google Scholar ]
Ortoleva, P.
and
Snowberg, E.
(2015) âOverconfidence in Political Behaviorâ. American Economic Review, Vol. 105, No. 2, pp. 504â535. [ Google Scholar ]
Page, B.I.
and
Shapiro, R.Y.
(1992) The Rational Public: Fifty Years of Trends in Americans, Policy Preferences (Chicago: University of Chicago Press; ). [ Google Scholar ]
Park, C.W.
,
Mothersbaugh, D.L.
and
Feick, L.
(1994) âConsumer Knowledge Assessmentâ. Journal of Consumer Research, Vol. 21, No. 1, pp. 71â82. [ Google Scholar ]
Plescia, C.
,
Wilhelm, J.
,
Kritzinger, S.
,
SchĂźberl, T.
and
PartheymĂźller, J.
(2020) RECONNECT 2019 European Parliament Election Panel Survey (Vienna: AUSSDA; ). 10.11587/MOV0EZ
[ DOI ] [ Google Scholar ]
Popkin, S.L.
(1991) The Reasoning Voter. Communication and Persuasion in Presidential Campaigns (Chicago: University of Chicago Press; ). [ Google Scholar ]
Radecki, C.M.
and
Jaccard, J.
(1995) âPerceptions of Knowledge, Actual Knowledge, and Information Search Behaviorâ. Journal of Experimental Social Psychology, Vol. 31, No. 2, pp. 107â138. [ Google Scholar ]
Rapeli, L.
(2014) âComparing Local, National and EU Knowledge: The Ignorant Public Reassessedâ. Scandinavian Political Studies, Vol. 37, No. 4, pp. 428â446. [ Google Scholar ]
Schlipphak, B.
and
Treib, O.
(2017) âPlaying the Blame Game on Brussels: The Domestic Political Effects of EU Interventions against Democratic Backslidingâ. Journal of European Public Policy, Vol. 24, No. 3, pp. 352â365. [ Google Scholar ]
Soll, J.
and
Klayman, J.
(2004) âOverconfidence in Interval Estimatesâ. Journal of Experimental Psychology: Learning, Memory, and Cognition, Vol. 30, pp. 299â314. [ DOI ] [ PubMed ] [ Google Scholar ]
Stimson, J.A.
(2015) Tides of Consent: How Public Opinion Shapes American Politics (New York: Cambridge University Press; ). [ Google Scholar ]
Thissen, D.
and
Orlando, M.
(2001) âItem Response Theory for Items Scored in Two Categoriesâ. In
Thissen, D.
and
Wainer, H.
(eds) Test Scoring (Lawrence Erlbaum Associates Publishers; ), pp. 73â140. [ Google Scholar ]
Tiedens, L.Z.
and
Linton, S.
(2001) âJudgment under Emotional Certainty and Uncertainty: The Effect of Specific Emotions on Information Processingâ. Journal of Personality and Social Psychology, Vol. 81, No. 6, pp. 973â988. [ DOI ] [ PubMed ] [ Google Scholar ]
van Kessel, S.
,
Sajuria, J.
and
Van Hauwaert, S.M.
(2021) âInformed, Uninformed or Misinformed? A Crossânational Analysis of Populist Party Supporters across European Democraciesâ. West European Politics, Vol. 44, No. 3, pp. 585â610. [ Google Scholar ]
van Prooijen, J.âW.
and
Douglas, K.M.
(2018) âBelief in Conspiracy Theories: Basic Principles of an Emerging Research Domainâ. European Journal of Social Psychology, Vol. 48, No. 7, pp. 897â908. [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ]
van Prooijen, J.âW.
and
Krouwel, A.
(2019) âOverclaiming Knowledge Predicts Antiâestablishment Votingâ. Social Psychological and Personality Science, Vol. 11, No. 3, pp. 356â363. [ Google Scholar ]
Weary, G.
and
Jacobson, J.A.
(1997) âCausal Uncertainty Beliefs and Diagnostic Information Seekingâ. Journal of Personality and Social Psychology, Vol. 73, No. 4, pp. 839â848. [ Google Scholar ] Associated Data This section collects any data citations, data availability statements, or supplementary materials included in this article. Supplementary Materials Table S1. B1 : Multinomial logistic regression for EU referendum preference. Figure S1. B1 : Average marginal effects for control variables. Figure S2. C1â1: Item characteristics curves and correlation matrix (reduced scale). Figure S3. C1â2: Informedness and the preference to leave or remain in the EU (reduced scale). Figure S4. C1â3: Average marginal effects of EU knowledge confidence (reduced scale). Figure S5. C1â4: Average marginal effects of EU knowledge accuracy (reduced scale). Table S6. C1â1 : Multinomial logistic regression for EU membership preference (reduced scale). Figure S7. C1â5 : Average marginal effects for control variables (reduced scale). Table S8. C2â1: Shares of different types of informedness. Table S9. C2â2: Response patterns across types of informedness. Figure S10. C3â1 : Item characteristics curves â by country. Figure S11. C3â2 : Correlation matrices â by country. Figure S12. C3â3 : Heatmaps â by country. Figure S13. C3â4 : Average marginal effects of EU knowledge confidence â by country. Figure S14. C3â5 : Average marginal effects of EU knowledge accuracy â by country. Figure S15. D1 : Univariate distribution of predicted scores for accuracy and confidence. Figure S16. D2 : Scree plot and correlation matrix. Table S17 . D1. Eigenvalues. Table S18 . D2. Factor loadings and unique variances. Figure S19. E1. Predicted probabilities for accuracy at low and high levels of confidence. Figure S20. E2. Predicted probabilities for confidence at low and high levels of accuracy. |
| Markdown | [Skip to main content](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#main-content)

An official website of the United States government
Here's how you know
Here's how you know

**Official websites use .gov**
A **.gov** website belongs to an official government organization in the United States.

**Secure .gov websites use HTTPS**
A **lock** ( Locked padlock icon) or **https://** means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.
[](https://www.ncbi.nlm.nih.gov/)
Search
Log in
- [Dashboard](https://www.ncbi.nlm.nih.gov/myncbi/)
- [Publications](https://www.ncbi.nlm.nih.gov/myncbi/collections/bibliography/)
- [Account settings](https://www.ncbi.nlm.nih.gov/account/settings/)
- Log out
Primary site navigation

Logged in as:
- [Dashboard](https://www.ncbi.nlm.nih.gov/myncbi/)
- [Publications](https://www.ncbi.nlm.nih.gov/myncbi/collections/bibliography/)
- [Account settings](https://www.ncbi.nlm.nih.gov/account/settings/)
Log in
- [Journal List](https://pmc.ncbi.nlm.nih.gov/journals/)
- [User Guide](https://pmc.ncbi.nlm.nih.gov/about/userguide/)
NewTry this search in PMC Beta Search
- ## PERMALINK
Copy
As a library, NLM provides access to scientific literature. Inclusion in an NLM database does not imply endorsement of, or agreement with, the contents by NLM or the National Institutes of Health.
Learn more: [PMC Disclaimer](https://pmc.ncbi.nlm.nih.gov/about/disclaimer/) \| [PMC Copyright Notice](https://pmc.ncbi.nlm.nih.gov/about/copyright/)

J Common Mark Stud
. 2022 Jan 24;60(5):1449â1469. doi: [10\.1111/jcms.13316](https://doi.org/10.1111/jcms.13316)
- [Search in PMC](https://www.ncbi.nlm.nih.gov/pmc/?term=%22J%20Common%20Mark%20Stud%22%5Bjour%5D)
- [Search in PubMed](https://pubmed.ncbi.nlm.nih.gov/?term=%22J%20Common%20Mark%20Stud%22%5Bjour%5D)
- [View in NLM Catalog](https://www.ncbi.nlm.nih.gov/nlmcatalog?term=%22J%20Common%20Mark%20Stud%22%5BTitle%20Abbreviation%5D)
- [Add to search](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/?term=%22J%20Common%20Mark%20Stud%22%5Bjour%5D)
# Misinformedness about the European Union and the Preference to Vote to Leave or Remain
[Julia PartheymĂźller](https://pubmed.ncbi.nlm.nih.gov/?term=%22Partheym%C3%BCller%20J%22%5BAuthor%5D)
### Julia PartheymĂźller
1 Vienna Centre for Electoral Research, University of Vienna, Vienna
2 Department of Government, University of Vienna, Vienna
Find articles by [Julia PartheymĂźller](https://pubmed.ncbi.nlm.nih.gov/?term=%22Partheym%C3%BCller%20J%22%5BAuthor%5D)
1,2,â, [Sylvia Kritzinger](https://pubmed.ncbi.nlm.nih.gov/?term=%22Kritzinger%20S%22%5BAuthor%5D)
### Sylvia Kritzinger
2 Department of Government, University of Vienna, Vienna
Find articles by [Sylvia Kritzinger](https://pubmed.ncbi.nlm.nih.gov/?term=%22Kritzinger%20S%22%5BAuthor%5D)
2, [Carolina Plescia](https://pubmed.ncbi.nlm.nih.gov/?term=%22Plescia%20C%22%5BAuthor%5D)
### Carolina Plescia
2 Department of Government, University of Vienna, Vienna
Find articles by [Carolina Plescia](https://pubmed.ncbi.nlm.nih.gov/?term=%22Plescia%20C%22%5BAuthor%5D)
2
- Author information
- Article notes
- Copyright and License information
1 Vienna Centre for Electoral Research, University of Vienna, Vienna
2 Department of Government, University of Vienna, Vienna
\*
*Correspondence*: Dr Julia PartheymĂźller, University of Vienna, Vienna Centre for Electoral Research, Kolingasse 14â16, 1090 Vienna, Austria. email: julia.partheymueller@univie.ac.at
â
Corresponding author.
Revised 2021 Sep 30; Received 2021 Apr 30; Accepted 2021 Nov 22; Issue date 2022 Sep.
Š 2022 The Authors. JCMS: Journal of Common Market Studies published by University Association for Contemporary European Studies and John Wiley & Sons Ltd.
This is an open access article under the terms of the [http://creativecommons.org/licenses/by/4.0/](https://creativecommons.org/licenses/by/4.0/) License, which permits use, distribution and reproduction in any medium, provided the original work is properly cited.
[PMC Copyright notice](https://pmc.ncbi.nlm.nih.gov/about/copyright/)
PMCID: PMC9544071 PMID: [36248058](https://pubmed.ncbi.nlm.nih.gov/36248058/)
## Abstract
European politicians have become increasingly concerned about the possible distorting effects of citizens not only being *un*informed, but systematically *mis*informed about the European Union (EU). Against this background, this study assesses the role of EU knowledge in shaping the preference to vote to leave or remain in a (hypothetical) referendum on EU membership using crossânational survey data that were collected simultaneously in eight EU countries during the runâup to the 2019 EP elections. The surveys included a newly designed item battery of EU knowledge capturing both the accuracy as well as confidence in knowledge of the respondents. The results show that misinformedness is associated with a preference to leave the EU, the uninformed citizens tend to be undecided or not intending to vote, while the wellâinformed prefer to remain. Overall, our findings contribute to the ongoing debates about the role of misinformation in politics.
**Keywords:** misinformedness, European Union, referendum, political knowledge, confidence in knowledge
## Introduction
In recent years, European politicians and political observers have become increasingly wary about voters being misinformed about politics. Most notably, the Brexit referendum played a critical role in triggering such worries. In the referendum on 23 June 2016 a majority of the British people voted to leave the European Union (EU), a supranational institution it had joined 43 years earlier in 1973. The outcome of the Brexit referendum sent financial and political shockwaves around the world generating heated debate about what has led UK citizens to vote to leave (Hobolt, [2016](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0026); Clarke *et al*., [2017](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0011)). In this regard, many discussions arose on citizens' informedness about the EU. Scholarly research as well as pundit discussions became also focused on the risk of a potential âdomino effectâ â that is, that similar referendums in other member states may lead to the same outcome, thus posing a severe threat to the existence of the EU itself (for example, Hobolt, [2016](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0026)).
Indeed, a necessary condition for the proper functioning of democracies is that citizens are well informed about the decisions at stake (Banducci *et al*., [2017](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0006)). Yet, mere uninformedness might not even be particularly harmful. Political ignorance â that is, the absence of information â is mostly thought to result in rather arbitrary individual errors that cancel out in the electorate at large (Converse, [1990](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0012); Page and Shapiro, [1992](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0048); Stimson, [2015](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0056)). In contrast, misinformed people may take political action on the basis of systematically incorrect information, becoming what Hochschild and Einstein ([2015](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0028)) call the âactive misinformedâ. As a result, voters' misinformedness has a potential of leading to a systematic distortion of outcomes.
Given the complex institutional structure of the EU and the tendency of domestic politicians to engage in a âblame gameâ with Brussels, EUârelated referendums are particularly likely to be affected by misinformedness as the issues are often crossâcutting to usual party lines (LeDuc, [2009](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0039)). Unlike in elections where voters choose their representatives, common heuristics (Popkin, [1991](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0051)) such as party identification cannot be applied in the same way and protect against the distorting effects of misperceptions in directâdemocratic decisions.
In this paper, we therefore bring together two strands of literature â both the literature on misinformedness and EU membership preferences. Relying on the twoâdimensional conception of political knowledge introduced by Kuklinski *et al*. ([1998](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0037), [2000](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0036)) who have emphasised the importance of confidence in one's own knowledge as a factor shaping public opinion, we designed a new item battery to measure EU informedness capturing not only the factual accuracy of beliefs regarding EU institutions and policies, but also the respondents' confidence in their knowledge about the EU. Based on this novel measure, we can distinguish not only between wellâinformed and uninformed citizens, but also focus on misinformed voters. Studying the underlying cognitions of hypothetical preferences has the advantage that we can observe the ânaturally occurringâ associations between beliefs and preferences to leave or remain in the EU in the absence of an actual ongoing campaign where active mobilization and counterâmobilization will exert an additional influence on preference formation (Hobolt and De Vries, [2016](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0027)). Using original survey data from eight EU member states (Austria, Denmark, France, Germany, Hungary, Italy, Poland, Spain) collected in the context of the 2019 European Parliament elections, we demonstrate that misinformed citizens are characterized by distinct preferences regarding their country's EU membership, which sets them apart from the wellâinformed and uninformed. Our findings underline that the concept of confidence in knowledge is relevant for our understanding of public opinion.
## I. The TwoâDimensional Structure of Knowledge and Types of Informedness
We rely on the twoâdimensional conception of knowledge as introduced by Kuklinski *et al*. ([1998](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0037), [2000](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0036)) and as shown in Figure [1](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-fig-0001). The first dimension is the accuracy of knowledge. Accuracy has often been simply equated with knowledge as such, leaving the second dimension which is confidence in knowledge aside. The accuracy of political knowledge can be defined as a continuum ranging from low to high amounts of factually correct information about politics that is stored in longâterm memory (Delli Carpini and Keeter, [1996](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0017)). At the individual level, the accuracy of political knowledge has been explained by wellâknown antecedents such as political interest, education, and exposure to political news in the media (for example, Luskin, [1990](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0043); Delli Carpini and Keeter, [1996](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0017); Kwak, [1999](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0038)).
### Figure 1.

[Open in a new tab](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/figure/jcms13316-fig-0001/)
The Two Dimensions of Political Knowledge and Four Types of Informedness **Note*: Own diagram based on Lee and Matsuo ([2018](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0040)).*
The second dimension, far less studied, is confidence in knowledge. Confidence represents âan individual's perceptions of his or her knowledgeâ (Radecki and Jaccard, [1995](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0052), p.107). As such, confidence in knowledge can be thought of as a metaâcognition of how certain a person feels about the accuracy of his or her beliefs reflecting the availability and accessibility of information stored in memory upon retrieval. In line with this notion, Lee and Matsuo ([2018](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0040)) demonstrate that greater confidence is associated with lower response time, suggesting greater cognitive availability and accessibility of responses about which respondents felt confident that they are correct.
The existing literature has also shown that the two dimensions â accuracy and confidence â cannot only be distinguished analytically, but also empirically each with unique antecedents and its own measurement (Park *et al*., [1994](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0049); Radecki and Jaccard, [1995](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0052)). While a common finding in psychological research is that confidence is positively related to accuracy (namely that citizens believe they know more when they actually do know more) (for example, Allwood and Montgomery, [1987](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0001); Griffin and Tversky, [1992](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0024)), Lee and Matsuo ([2018](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0040)) illustrate that there is only a mild positive correlation between measures of accuracy and confidence, and that education is positively correlated with accuracy in political knowledge but not related to confidence in knowledge.
Kuklinski *et al*. ([2000](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0036), pp. 794â5) mention three mental processes documented by social cognitive psychology, which may lead to overconfidence: (1) citizens are likely to draw inferences based on their observations, (2) they try to make inferences that are consistent with the information already stored in their minds, and (3) those inferences become stored as âhard dataâ that are considered to be equally valid than facts learned based on actual evidence. As a result of these cognitive mechanisms, some people tend to be overconfident. Meanwhile, overconfidence is very often associated with gender with men overestimating their abilities (Kling *et al*., [1999](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0034); Soll and Klayman, [2004](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0055); Niederle and Vesterlund, [2011](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0046)), but also with age with older persons being more likely to show patterns of overconfidence in their political reasoning (Ortoleva and Snowberg, [2015](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0047)). Also, people with higher education seem to be more confident (Baumeister *et al*., [2003](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0008)), as do people holding more extreme political positions (Ortoleva and Snowberg, [2015](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0047)).
Based on the two dimensions of knowledge, citizens can be broadly grouped into different types of informedness. We follow Lee and Matsuo ([2018](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0040)) and speak of citizens as wellâinformed, uninformed, partially informed or misinformed based on the following constellations of accuracy and confidence in knowledge (see Figure [1](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-fig-0001)): (1) wellâinformed citizens possess accurate information and are confident, (2) the misinformed hold mostly inaccurate information but are nevertheless fairly confident that they got the facts right, (3) the uninformed hold inaccurate information and lack confidence, and (4) the partially informed are rather high in accuracy but low in confidence. For us, in particular, the interplay between accuracy and confidence will be relevant in the following.
## II. The Relationship between EU Knowledge and EU Membership Preferences
Based on normative notions of democracy, it is desirable that citizens possess an enlightened understanding of politics (Dahl, [1989](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0014)) and use this to decide what serves their interests best. A certain level of accurate political information is thought to be fundamentally important for citizens' ability to match their preferences and interests with specific public issues and to promote political participation (for example, Delli Carpini and Keeter, [1996](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0017)). Thus, the notion prevails that a lack of factual information tends to misguide citizens in their policy preferences and behaviours (Kuklinski *et al*., [2000](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0036)) and biases the shape of collective opinion (Althaus, [2003](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0002)).
But accuracy is not all that matters. Confidence in knowledge influences politically relevant behaviours as well. For example, confidence in knowledge tends to make people less likely to search for information (Dancey and Sheagley, [2013](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0015)), and much more likely to rely on cognitive shortcuts such as their prior beliefs and preferences (Koch, [2003](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0035)). What is more, voters possessing high confidence are more likely to believe that they have all the knowledge they need to make a decision (Weary and Jacobson, [1997](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0063); Tiedens and Linton, [2001](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0059)). Low accuracy in pair with high confidence may thus mislead citizens' political choices and distort their opinions at much higher rates â leading to false evaluations of events, processes or threats â rather than when they just hold inaccurate information alone (Lewandowsky *et al*., [2005](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0041); Flynn *et al*., [2017](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0019)).
Various circumstances contribute to European citizens being misinformed about the EU. Courts and legal scholars have described the EU with regard to its institutional design as a creation *sui generis*, with little historical or international precedent for citizens to compare it to. Democratic processes at the EU level are fairly complex with some scholars pointing to its democratic deficit (Follesdal and Hix, [2006](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0020)). Despite reforms and the strengthened role of the European Parliament, policyâmaking at the EU level remains highly complex. The interplay and powerâsharing among various institutions at the EU level and the nation states seems to provide ample opportunity for misunderstandings of how democracy in the EU actually functions and what the role of the member states is. It is thus perhaps not surprising that knowledge of the EU is consistently found to be lower compared to knowledge of national or local level of politics (for example, Rapeli, [2014](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0053)).
Previous research has also shown that national politicians tend to engage in a âblame gameâ with Brussels, obfuscating their own role in the decisionâmaking process at the EU level, portraying actions by the EU as illegitimate external interference, and characterizing the EU as an overly powerful bureaucratic and wasteful entity (for example, Schlipphak and Treib, [2017](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0054)). In recent years, with the EU facing several crises (Baglioni and Hurrelmann, [2016](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0005)) it often was portrayed in dramatised ways by the news media. In the face of the actual level of complexity, misleading domestic portrayal of EU politics, and repeatedly occurring dramatised crisis events, it does not seem surprising that some citizens may misperceive the working and competences of the EU resulting in distorted evaluations thereof.
### Hypotheses
What expectations follow based on these considerations for opinion formation of preferences in a (hypothetical) referendum on EU membership? We derive as a first expectation that the wellâinformed will be more likely to prefer to remain in the EU than those with views being distorted by common portrayals of the EU as an illegitimate actor. This does not necessarily mean that âto know it, is to love itâ (Karp *et al*., [2003](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0032), p. 271), but suggests that the wellâinformed will show somewhat greater support than those drawing inferences based on common distorted portrayals. Previous research provides support for this expectation. Empirically, for instance, Inglehart ([1970](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0030), p. 54) finds that âcognitive mobilization \[is\] the most powerful predictor of proâEuropean attitudesâ confirming that âall information about \[EU\] integration promotes \[EU\] supportâ (Gabel, [1998](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0022), p. 335). Likewise, Janssen ([1991](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0031), p. 459) shows that âa higher level of political skills is indeed strongly related to a more supportive attitude towards integration and EC membershipâ and Anderson ([1998](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0004), p. 589) finds that âinterest in EU politics was the most significant and consistently important variable affecting support for EU membershipâ. Following the theory of cognitive mobilization (Inglehart, [1970](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0030)), the supposed mechanism behind this association is that wellâinformed citizens will overall feel more familiar with EU matters and will hence perceive the EU as less threatening. Based on that, we can infer that those holding accurate beliefs with confidence are the most likely to support the membership of their country in the EU.
This leads to our first hypothesis:
> #### Hypothesis 1
> High accuracy of knowledge in conjunction with high levels of confidence in knowledge about the EU is positively related to voting to remain in a hypothetical referendum on EU membership.
Secondly, we expect the misinformed to be the most likely to display a preference of voting to leave. Previous research has quite consistently documented an association between misinformedness, antiâestablishment attitudes and voting behaviour. For instance, van Prooijen and Krouwel ([2019](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0062)) found that low knowledge but high confidence about a specific political event tend to predict an antiâestablishment vote. This is confirmed by van Kessel *et al*. ([2021](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0060)) who show that misinformedness relates positively to support for rightâwing populist parties.
The psychological mechanisms behind this association are not fully known. However, some research suggests that perceptions of threat may play a role as also implied by the theory of cognitive mobilization. As argued above, citizens who lack accurate information about the EU may perceive the EU, which is based on blameâportrayals and dramatised crisis events as threatening, creating the desire for seemingly simple solutions such as leaving the EU altogether. In a similar vein, some research suggests that the psychological link between an antiâestablishment vote and support for rightâwing populism may in part be due to the association between antiâestablishment thinking and attractiveness to conspiracy beliefs (Castanho Silva *et al*., [2017](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0010)), which have also been linked to perceptions of threat and times of uncertainty (van Prooijen and Douglas, [2018](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0061)).
Apart from that, the complexity of EU politics may matter. Facing overwhelming complexity, accurate information can be hard to come by and citizens are often faced with the challenge of verifying claims of unknown veracity. With the hard data being essentially inaccessible, people tend to âfill in the blanksâ (Kuklinski *et al*., [2000](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0036), p.794) drawing their own inferences based on their observations from everyday life generating simple, subjectively consistent narratives that reduce realâworld complexity. It is known that the stronger the initial opinion, the less likely one is to correct oneself and remains open to bias and inaccurate information (Cromby, [2019](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0013)). This means that inaccurate information is likely to be fuelled by further inaccurate information increasing confidence in wrongly held beliefs against the EU fuelling even greater Euroscepticism (De Vreese, [2007](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0016)). What further adds to the prevalence of misinformedness is that some people tend to feel overconfident and mistakenly treat inferences as hard data (Kuklinski *et al*., [2000](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0036)), even when they arrived at those (false) conclusions based on inaccurate information or biased informationâprocessing. These theoretical considerations lead to our next hypothesis:
> #### Hypothesis 2
> Low accuracy of knowledge in conjunction with high levels of confidence in knowledge about the EU is positively related to voting to leave in a hypothetical referendum on EU membership.
Finally, it follows that citizens low on confidence in knowledge are less likely to make use of their beliefs when forming judgments and deciding on political actions. This has been demonstrated, for instance, by research on the impact of uncertainty in perceptions of issue positions: Citizens who feel uncertain about the positions of political parties are less likely to base their judgment and voting decisions on them (Alvarez and Franklin, [1994](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0003)). Confidence is also strongly related with indifference and ambivalent views regarding politics and political candidates. Existing studies indicate that indifference and ambivalence reduce citizens' motivation to be politically active with uninformed voters overall less likely to vote or engage politically (for example, Huckfeldt *et al*., [2004](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0029); Mutz, [2006](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0045)). This point is also supported by Lee and Matsuo ([2018](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0040)) who show that confidence relates to the frequency of political discussions, which is an important antecedent of forming an opinion and participation in politics. As a result, citizens with low confidence in knowledge â the uninformed and partially informed citizens â may decide not to turn out to vote, or remain rather undecided. From this follows our last hypothesis:
> #### Hypothesis 3
> Regardless of the accuracy of knowledge, low confidence in knowledge about the EU is positively related to being undecided about remain or leave, or choosing to abstain in a hypothetical referendum on EU membership.
## III. Data and Methods
To evaluate the impact of accuracy of and confidence in EU knowledge on the evaluation of one's country's future in the EU, we make use of the data gathered by the RECONNECT and AUTNES project during the 2019 EP elections. As part of these projects, surveys were conducted simultaneously in eight EU countries, namely Austria, Denmark, France, Germany, Hungary, Italy, Poland and Spain (Aichholzer *et al*., [2020](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0065); Plescia *et al*., [2020](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0050)). The country sample covers a variety of EU democracies, including old and new member states as well as countries from East and West and North and South of Europe. The country sample also spans considerably different contexts in terms of longâstanding attitudes towards the EU (Hobolt and De Vries, [2016](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0027); Kritzinger *et al*., [2020](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0066)).
While the original study included two survey waves, for this paper, we will make exclusive use of the preâelection data that was gathered in April 2019 since this wave included all relevant measures of both our dependent and independent variables. The data were collected as quota samples via online access panels, with quotas closely mirroring the population distributions of key demographics, namely age, gender, education and region. In all analyses, in addition, postâstratification weights were applied to match population targets.
The dependent variable in our analysis is the question of how respondents would vote in a hypothetical referendum. We study vote choice in a hypothetical referendum on the EU which means that we will be able to focus on the impact of our main independent variable â that is, citizens' informedness on vote choice â net of the influence of the role of elites in shaping the information environment and campaign effects taking place during a real referendum campaign. [1](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-note-0001) The question wording is as follows: âIf there was a referendum about staying or leaving the EU in \[COUNTRY\], how would you decide?â. The answering options are â\[COUNTRY\] staying in the EUâ, â\[COUNTRY\] leaving the EUâ, âI am undecidedâ, and âI would not voteâ. We collapse the undecided and nonâvoters into one category as we have the same hypothesis for these two categories. As a result, our dependent variable groups respondents into three categories (Remain, Leave, and Undecided/NonâVoter).
With regards to our independent variables, the surveys included a battery of knowledge questions on the EU similar to those usually asked in other Europeâwide studies. The five questions covered, in particular, the major institutions of the EU involved in the policy process at the European level such as the European Parliament, the European Commission, and the Council of the European Union. The battery also included one question on EU policies and the budget. These questions constitute conventional measures of EU politics since they refer to the functioning of the EU political system and the actors involved, and are all relevant to EU politics as well as the daily lives of EU citizens. [Appendix A](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-supitem-0001) includes the full question wording. All knowledge questions can be considered ideologically neutral since they are not necessarily more or less ideologically convenient for respondents preferring their country to remain an EU member or rather to leave the EU (our dependent variable). [2](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-note-0002) Further below we discuss robustness checks showing that the results are robust to the use of partial subsets of the knowledge items.
Each knowledge question offered four answering options, with one being correct and three being false. Respondents were instructed to give their best guess if they did not know the answer. This means that there was no explicit âDo not Knowâ response option available to respondents. This is first, to avoid that unequal propensities to opt for a âDo not Knowâ answer affect the results (Mondak and Creel Davis, [2001](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0044)), and second, to accommodate for the substantial gender differences in the use of such an answer category (Fraile, [2013](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0021)). Instead, after answering each of the knowledge questions, respondents are asked in a followâup question to indicate how certain they are that their answer is correct on a 11âpoint scale from 0 to 10, capturing the respondents' confidence in knowledge in the same way as suggested by previous research evaluating the role of misinformedness (Kuklinski *et al*., [2000](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0036); Lee and Matsuo, [2018](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0040)).
Figure [2](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-fig-0002) shows the distributions of the responses on the knowledge questions with respondents answering some questions more correctly than others. The question on the EP members being elected by citizens was answered correctly by 69 per cent of the respondents, whereas 31 per cent answered incorrectly. A slim majority, 52 per cent, also answered the question on the approval vote for the President of the European Commission correctly. The remaining three questions were answered incorrectly by a majority of the respondents. Sixty per cent were not able to identify the statement regarding the administrative costs being the largest item of the EU budget as false. Sixtyâeight per cent could not identify the institution at the EU level in which national governments are being represented by their ministers. And, 71 per cent could not name the European Commission as the institution with the formal right to initiate laws at the EU level. These apparently were harder knowledge questions.
### Figure 2.

[Open in a new tab](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/figure/jcms13316-fig-0002/)
Accuracy of and Confidence in EU Knowledge **Note*: Pooled data for Austria, Denmark, France, Germany, Hungary, Italy, Poland and Spain (*N* = 16.523, weighted).*
Despite the variation in difficulty across the items measuring the accuracy of knowledge, there are fewer differences in the level of confidence, as shown by the rightâhand panel in Figure [2](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-fig-0002). Respondents felt the most confident when answering the question on the EP, with 51 per cent indicating that they felt rather confident about their answer being correct. [3](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-note-0003) For the remaining questions the level of confidence was slightly lower ranging from 33 to 43 per cent. Overall, the patterns suggest that confidence in knowledge varies less across items than accuracy.
To build a scale of the accuracy of EU knowledge, we fit a twoâparameter logistic IRT model using the binary knowledge items (Thissen and Orlando, [2001](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0058)). The twoâparameter model allows for varying difficulty and discrimination of the items, and is commonly identified by assuming that the latent knowledge variable follows a standard normal distribution (Bock and Lieberman, [1970](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0009)). The item characteristic curves in Figure [3](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-fig-0003) confirm that the item on the EP was a fairly easy one, whereas the item of the Commission's right to initiate new laws was the hardest. At the lower end of the latent scale, the probability to answer any of the items correctly is fairly low. In contrast, at higher levels of the knowledge scale, the respondents have a fairly high propensity to answer all items correctly. The items on the EP members and the Council of the EU show the steepest slopes, meaning that they possess high discriminatory value. We extract the latent scores from the response model and use them as our measure of EU knowledge accuracy in the subsequent analyses.
### Figure 3.

[Open in a new tab](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/figure/jcms13316-fig-0003/)
Item Characteristics Curves and Correlation Matrix **Note*: Pooled data for Austria, Denmark, France, Germany, Hungary, Italy, Poland and Spain (*N* = 16.523).*
To build a scale of confidence in knowledge, we ran a factor analysis on the 11âpoint scales capturing confidence. The results suggest that these items strongly load on one single factor. The rightâhand panel in Figure [3](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-fig-0003) shows the correlation matrix between the individual items and the extracted factor scores. We can observe that all items are strongly correlated with this scale of confidence in knowledge. The factor scores will enter the analysis as our measure of EU knowledge confidence. [4](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-note-0004)
The correlation between our scale of accuracy of and confidence in knowledge is 0.34. Thus, although there is a moderate positive association between accuracy and confidence, we can confirm in line with previous research (Lee and Matsuo, [2018](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0040)) that the two distinct analytical concepts are also empirically distinguishable.
The analysis proceeds in two steps: First, we explore the univariate and bivariate distributions of the dependent and main independent variables. Then, we run a multinomial logistic regression model as our dependent variable has three (unordered) categories. As our research design is crossâsectional, it is particularly important to include a broad array of control variables to account for potential confounders. Several sociodemographic and nonâsociodemographic factors have been used to explain why people have chosen to vote to leave or remain in the Brexit referendum. Thereby, Leave voters were predominantly found among the more economically disadvantaged working classes, the less educated, and older voters (Goodwin and Heath, [2016](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0023)). Further research indicated that also the lack of political trust, the absence of a European identity, rightâwing political leanings, antiâimmigration, antiâfree trade and antiâestablishment attitudes played a role in the vote to leave (Hobolt, [2016](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0026)).
We therefore include as control variables key sociodemographic factors such as age, gender, and education as well as various measures of political attitudes and political involvement. We specifically include retrospective assessments of national and personal economic conditions, political selfâplacement on the leftâright and the European integration dimension, attitudes towards immigration (âimmigrants take away jobsâ, ârestricted access to welfare for immigrantsâ) and free trade (âfree is a good vs. bad thingâ), trust in national and European institutions, a measure of European identity (âfeeling close to Europeâ), and satisfaction with democracy at the EU level. We also control for political interest and a measure of internal political efficacy. Political interest is measured on a fourâpoint scale (from 0 ânot interested at allâ to 3 âvery interestedâ). The scale of internal political efficacy was formed based on two items (âI have a good understanding of the important political issues facing the European Unionâ and âI consider myself well qualified to participate in EU politicsâ) using factor analysis. In the same way, the measure of antiâestablishment attitudes was constructed based on two items (âGovernment is run by a few big interestsâ, âGovernment officials use power to improve people's livesâ, reversed coding). We also include countryâfixed effects along with clustered standard errors.
Apart from the control variables, the models include the aboveâdescribed scales of EU knowledge accuracy and confidence as well as an interaction between these two primary independent variables. The interaction term is particularly critical as it allows testing for the distinct effect of misinformedness, when people think they do know, but in truth they do not. If misinformedness plays a role in shaping the preference to vote leave or remain, we should see that confidence in EU knowledge is related to a preference to vote to leave at low levels accuracy, whereas it is expected to be associated with voting to remain at high level of accuracy of EU knowledge.
## IV. Analysis and Results
Figure [4](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-fig-0004) shows the distribution of preferences to remain and to leave the EU in the eight member states. In all countries under scrutiny, a majority of citizens would vote to remain in the EU. However, in some countries this majority is fairly slim, with 50 per cent in Italy, 52 per cent in France, and 55 per cent in Austria. The preference for leaving the EU is strongest in Denmark, Italy, Austria, and France, with values ranging from 20 to 24 per cent. It is smallest in the Eastern European member states, Poland and Hungary, and in Spain, with about 10 to 11 per cent. Germany, with 15 per cent of leavers, lies in the midfield. Although preferences to leave are a minority position, this minority is quite sizable in some member states. It is also worth noting that a sizable minority is undecided or preferring not to vote on this question, with the share of respondents in this group ranging from 15 to 28 per cent.
### Figure 4.

[Open in a new tab](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/figure/jcms13316-fig-0004/)
Preferences to Leave or Remain in the EU.
How are these preferences distributed across levels of EU knowledge accuracy and confidence? Figure [5](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-fig-0005) shows the heatmap of the preference to leave and remain as well as for undecided/nonâvoters along the two dimensions of EU knowledge. The first map on the leftâhand side shows the share of preferences to remain. The highest shares can be found in the upper right quadrant (dark grey and black) where 73 to 81 per cent (and more) would vote to remain in a hypothetical referendum. This quadrant includes the wellâinformed voters with above average accuracy (*x*âaxis) and confidence in their EU knowledge (*y*âaxis).
### Figure 5.

[Open in a new tab](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/figure/jcms13316-fig-0005/)
Informedness and the Preference to Leave or Remain in the EU **Note*: Pooled data for Austria, Denmark, France, Germany, Hungary, Italy, Poland and Spain (*N* = 16.523, weighted).*
The second heatmap in the middle of the plot shows the distribution of preferences to leave. The maximum support is found in the most up left corner, with more than 40 per cent showing a preference to leave. But also slightly below that, at low levels of accuracy with fairly high levels of confidence, the support for leave is fairly strong. Leave support is lower at the highest levels of accurate information, in particular, among those who feel confident in their knowledge about the EU.
Finally, the third heatmap shows the distribution of the undecided and nonâvoters. The highest share of undecided and nonâvoters can be found in the lower left quadrant. But also in the lower right quadrant some undecided/nonâvoting citizens can be found. The minimum values for undecidedness/nonâvoting can be found in the upper right quadrant, hence, among the wellâinformed. Overall, these descriptive results give a first support for our three hypotheses, but we now move to the multivariate analysis.
We conduct a multinomial regression analysis of EU membership preferences, including our measures of accuracy and confidence as well as an interaction term among them alongside with our control variables. For the full estimation table, see Table B1 in [Appendix B](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-supitem-0001). As interaction effects are notoriously difficult to interpret in nonâlinear models, we opt for a visual inspection of the continuousâbyâcontinuous interaction relying on average marginal effects calculated based on the observed value approach (Hanmer and Kalkan, [2013](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0025)). Specifically, we plot the average marginal effect of confidence over the range of accuracy (Figure [6](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-fig-0006)) as well as the average marginal effect of accuracy over varying levels of confidence (Figure [7](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-fig-0007)). [5](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-note-0005) If our three hypotheses are confirmed, we should see in Figure [6](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-fig-0006) that confidence at high levels of accuracy is associated with a higher probability to prefer to remain (Hypothesis [1](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-mathstat-0001)), that confidence at low levels of accuracy is associated with a higher probability to prefer to leave (Hypothesis [2](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-mathstat-0002)), and that confidence should coincide with greater chances of being undecided/nonvoting, at all levels of accuracy (Hypothesis [3](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-mathstat-0003)). Likewise, Figure [7](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-fig-0007) should show that accuracy at high levels of confidence relates to a greater probability of a preference to remain and to a lower chance to vote to leave.
### Figure 6.

[Open in a new tab](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/figure/jcms13316-fig-0006/)
Average Marginal Effects of EU Knowledge Confidence **Note*: The dots show the average marginal effects of confidence in knowledge across varying levels of accuracy with 95% confidence intervals.*
### Figure 7.

[Open in a new tab](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/figure/jcms13316-fig-0007/)
Average Marginal Effects of EU Knowledge Accuracy **Note*: The dots show the average marginal effects of accuracy in knowledge across varying levels of confidence with 95% confidence intervals.*
Figures [6](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-fig-0006) and [7](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-fig-0007) confirm all three of these expectations. The first panel of Figure [6](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-fig-0006) shows the marginal effect of confidence across varying levels of accuracy on the preference to remain. In line with Hypothesis [1](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-mathstat-0001), we see that at the highest levels of accuracy, a unit shift in confidence is significantly associated with a higher probability of approximately 2 percentage points to vote to remain. In other words, wellâinformed citizens who have a very accurate understanding of the EU and great confidence in their judgment are more likely to vote to remain in a hypothetical referendum. For the preference to leave, in line with Hypothesis [2](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-mathstat-0002), we see a reversed pattern in the second panel of Figure [6](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-fig-0006). At the lowest level of accuracy, a unit shift in confidence is significantly associated with a higher probability of voting to leave, of about 3.5 percentage points. In other words, misinformed voters who hold highly inaccurate EU views but who strongly feel confident about their (inaccurate) EU knowledge, are more likely to vote leave. Finally, confirming Hypothesis [3](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-mathstat-0003), we see in the right panel of Figure [6](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-fig-0006) a constant negative association of a unit shift in confidence on the chances of being undecided/nonâvoting, with no significant variation across levels of EU knowledge accuracy. This suggests that voters who fundamentally lack confidence in how much or how little they know about the EU are most likely to remain undecided or to not vote at all â independent of their knowledge accuracy. Lastly, Figure [7](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-fig-0007) adds further confirmation to Hypotheses 1 and 2 showing that at high levels of confidence accuracy is with a higher probability to prefer remain and a lower probability of voting to leave. [6](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-note-0006)
The full results for our control variables, we document in [Appendix B](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-supitem-0001) and only briefly summarise the main observed patterns here. We find that male respondents are more opinionated, preferring more often to vote to remain as well as to leave than female respondents, who are more likely to remain undecided or not vote at all. In line with previous research, we find that the highly educated are more likely to vote to remain and less likely to vote to leave. Interestingly, we see no significant associations with the assessment of national and personal economic conditions. In terms of political attitudes, we find that leftâwing voters prefer to vote to remain whereas rightâwing voters show a preference for leaving. Without great surprise, respondents in favour of further EU integration prefer remaining and disfavour leaving. Antiâimmigration attitudes and, most notably, perceived labour market competition (âimmigrants take away jobsâ) are associated with a greater preference to leave and lower chance to vote remain. A proâfreeâtrade attitude is correlated with a higher chance to prefer remaining in the EU. When it comes to trust, we see that respondents trusting the EP show a greater chance to vote to remain rather than to leave. The same pattern emerges for a European identity and satisfaction with EU democracy: Those feeling close to Europe and those satisfied with EU democracy are more likely to vote to remain and less likely to vote to leave. In contrast, citizens with an antiâestablishment attitude, prefer to vote to leave. Concerning political involvement, we see that politically interested respondents are less likely to be undecided or not voting. For internal political efficacy â the general subjective feeling of competence in EU matters â we find that voters feeling more competent are more likely to vote to leave.
## V. Robustness Checks and Discussion
The analysis thus far shows that the misinformed are more likely to prefer voting to leave the EU whereas wellâinformed citizens prefer to remain. Is this a methodological artefact based on a biased selection of knowledge questions? What are the underlying causal mechanisms?
To investigate whether our knowledge items offer a particularly beneficial portrayal of the EU, we conduct two robustness checks. First, we drop two of the items that may seem to shed a somewhat beneficial light on the EU, namely the item on the approval vote for the EC president and the share of administrative costs in the budget. We rerun all steps of the analysis excluding those two items to see whether the inclusion of the specific items produced our results. This, however, is not the case as all substantial results remain completely unchanged (see [Appendix C1](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-supitem-0001)).
Second, to assess whether misinformed voters selectively guessed more negative answers, we compare the patterns of the responses for each item between uninformed and misinformed respondents. We find that the response patterns for uninformed and misinformed voters to be fairly similar (see [Appendix C2](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-supitem-0001)). If anything, misinformed voters selected answers that we would expect to shed a more positive light on the EU. For instance, misinformed voters more often believed that the right to propose new laws resides with the EP than uninformed or wellâinformed voters. Based on these robustness checks, we conclude that our findings are not driven by single items or a particularly beneficial portrayal of EU politics. [7](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-note-0007)
The statistical association we find can be the result of two different underlying causal processes based on the theory of motivated reasoning (Lodge and Taber, [2013](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0042); Druckman and McGrath, [2019](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0018)): (1) Accuracyâmotivated citizens may try to seek out objective information from sources that they subjectively believe to be highly credible and update their preferences accordingly, or (2) directionallyâmotivated citizens may deliberately seek out and selectively absorb information which confirms their prior beliefs. While the goal of accuracyâmotivated reasoners is to arrive at accurate conclusions, the directionallyâmotivated reasoners instead are driven by some directional goal such as maintaining their identity or affinity to a group status. Unfortunately, as Druckman and McGrath ([2019](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0018)) point out, these two processes are often observationally equivalent, and even cleverly designed experimental designs have struggled to disentangle those mechanisms. Previous research in general seems to suggest that the relationship between attitudes and knowledge is a mutual one (Kim *et al*., [2010](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0033)). Therefore, we wish to acknowledge that reverse causality may have produced or contributed to the patterns observed.
We believe that our analysis provides a number of relevant insights and theoretical and practical conclusions that can be drawn based on the observed patterns. First, the analysis confirms that both of the two dimensions of knowledge matter and are related to preference formation in distinct ways, with the lack of confidence being associated with less opinionation and willingness to participate. Second, simply providing the misinformed with correct information may not change their views, giving their high levels of confidence in inaccurate information regarding the EU. Likewise, a part of the electorate might be quite resilient against the spread of misinformation online or elsewhere as a nonânegligible proportion of citizens already hold accurate information confidently. Finally, given that we control for various confounders, we can establish that our measurement of knowledge does not simply capture underlying motivations that have already been demonstrated to be associated with preferences regarding EU membership, but we rather add one factor relevant to our understanding of the support and opposition to the EU.
Having said that, it should also be stated that the magnitude of the association with the two dimensions of knowledge are relatively modest. Hence, if voters were to become more misinformed, it would most likely only make a substantial difference if the vote margin in a referendum would be close, which currently is not the case in the postâBrexit EU member states. At the same time, concerns about misinformed voters should not be underestimated either, given the potentially farâreaching consequences and as, most notably, we already know that referendum preferences can develop in highly dynamic ways, once an actual campaign is underway (LeDuc, [2009](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0039)). As soon as this happens, it might be too late to build resilience against false information as this may require longâterm efforts of educating citizens about EU politics.
## Conclusion
In recent years, the concern about voters being misinformed about EU politics has been growing. The shock of the Brexit referendum has caused fears about similar events happening elsewhere and led many to question whether people understand the EU properly. While previous research has often pointed to voters being largely uninformed as a problem for democracy, voters being misinformed pose an even bigger threat to democracy. As discussed in this paper, there are good reasons to suspect that EU referendums are particularly likely to be affected by the consequences of voters being misinformed.
Based on a twoâdimensional conception of knowledge, we review the literature and identify several strands of research that link the two dimensions of knowledge with EU membership preferences. We expect misinformed voters to prefer voting to leave and wellâinformed voters to prefer to vote remain. The uninformed and partially informed voters, in contrast, we expect to remain undecided or not to vote. We evaluate these expectations by making use of an original dataset covering eight EU member states and including a newly designed battery to measure different types of informedness.
The results confirm our theoretical expectations. Even when controlling for various other factors influencing preferences to leave or to remain in the EU, citizens who hold inaccurate views about the EU with great confidence are more likely to prefer voting to leave. In contrast, voters holding accurate beliefs about EU democracy with great confidence prefer voting to remain. Uninformed and partially informed voters, those with a lack of confidence in their knowledge about the EU, in general are less likely to express a clear preference. They mostly are undecided or prefer not to vote.
The fact that the preference of voting to leave is associated with citizens being misinformed has important implications for understanding the opposition to the EU.
Most notably, debunking inaccurate information about the EU by factâchecking and educating citizens as an attempt to increase EU support among the misinformed might be deemed to fail given the high level of confidence in this group. Classical approaches such as information campaigns and factâchecking could still, though, be effective for the uninformed and partially informed to prevent them from drifting into the group of the misinformed. As overall this group is considerably large, this is an important task for the future efforts.
Future research should focus, in particular, on examining the sources of confidence and lack of accuracy and the design of effective counterstrategies, taking into account the underlying cognitive structure of the misinformed mind. Additionally, it should also look into who is misinformed and who is uninformed about the EU, how these distributions evolve over time, and also explore the linkage between factual knowledge about the EU and systemic knowledge about political affairs.
Eventually, future research should also try to unpack the complex causal relationship between accuracy of and confidence in political knowledge on the one hand, and EU membership preferences on the other. Such tests will require longitudinal data to assess the extent to which one influences the other. This paper shows indeed that the association between accuracy of, confidence in knowledge and political decisions is indeed noteworthy and relevant to further research.
## Funding
Data collection of the RECONNECT dataset was supported by the Horizon 2020 Framework Programme (Grant no. 770142) and data collection of the AUTNES dataset was supported by the Austrian Science Fund (Grant no. S10902âG11).
## Supporting information
**Table S1.** **B1**: Multinomial logistic regression for EU referendum preference.
**Figure S1. B1**: Average marginal effects for control variables.
**Figure S2. C1â1:** Item characteristics curves and correlation matrix (reduced scale).
**Figure S3. C1â2:** Informedness and the preference to leave or remain in the EU (reduced scale).
**Figure S4. C1â3:** Average marginal effects of EU knowledge confidence (reduced scale).
**Figure S5. C1â4:** Average marginal effects of EU knowledge accuracy (reduced scale).
**Table S6. C1â1**: Multinomial logistic regression for EU membership preference (reduced scale).
**Figure S7. C1â5**: Average marginal effects for control variables (reduced scale).
**Table S8. C2â1:** Shares of different types of informedness.
**Table S9. C2â2:** Response patterns across types of informedness.
**Figure S10. C3â1**: Item characteristics curves â by country.
**Figure S11. C3â2**: Correlation matrices â by country.
**Figure S12. C3â3**: Heatmaps â by country.
**Figure S13. C3â4**: Average marginal effects of EU knowledge confidence â by country.
**Figure S14. C3â5**: Average marginal effects of EU knowledge accuracy â by country.
**Figure S15. D1**: Univariate distribution of predicted scores for accuracy and confidence.
**Figure S16. D2**: Scree plot and correlation matrix.
**Table S17**. D1. Eigenvalues.
**Table S18**. D2. Factor loadings and unique variances.
**Figure S19. E1.** Predicted probabilities for accuracy at low and high levels of confidence.
**Figure S20. E2.** Predicted probabilities for confidence at low and high levels of accuracy.
[Click here for additional data file.](https://pmc.ncbi.nlm.nih.gov/articles/instance/9544071/bin/JCMS-60-1449-s001.docx) (3.9MB, docx)
PartheymĂźller, J. , Kritzinger, S. , and Plescia, C. (2022) Misinformedness about the European Union and the Preference to Vote to Leave or Remain. JCMS: Journal of Common Market Studies, 60: 1449â1469. 10.1111/jcms.13316.
## Footnotes
1
It is also worth noting that our survey took place more than a month before the EP elections 2019 and hence well before the various proâ and antiâEU messages could become part of the EP election campaign, which in the countries under scrutiny in this paper only started a few weeks before the elections (see Kritzinger *et al*., [2020](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0066)). In the countries we cover, even during the election campaign parties' proâ and antiâEU positions never really translated into a call for an EUâexit referendum since a majority of the population was clearly against it (see Kritzinger *et al*., [2020](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0066)).
2
Kuklinski *et al*. ([2000](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-bib-0036)) suggest that biased responses in their answer are suggestive of a certain direction (pro /antiâwelfare). In our case, we believe that being wrong (regardless of the direction) is most likely to lower support in the EU as it shows a lack of understanding of how the EU works. Even beliefs that suggest that the EU would be more democratic than it actually is, can lead to dissatisfaction by raising false expectations about what EU institutions can do. We believe that support for the EU requires a realistic perception of the EU to understand not only its legitimacy but also its constraints.
3
For visual representation the categories of the 11âpoint scale of confidence in knowledge were recoded as follows: 0â4 ârather unconfidentâ, 5 âmiddlingâ 6â10 ârather confidentâ.
4
[Appendix D](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-supitem-0001) shows the univariate distribution of the measures of accuracy and confidence and provides additional methodological details.
5
[Appendix E](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-supitem-0001) includes an alternative way of representing the continuousâbyâcontinuous interaction based on predicted probabilities.
6
We did not derive any expectation with regard to the effect of accuracy on the chances of being undecided or a nonâvoter. Yet, for completeness we also report in the third panel of Figure [7](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-fig-0007) the corresponding result. We see that accuracy at all levels of confidence decreases the chances of being undecided or nonâvoting.
7
We have reârun all our descriptive and multivariate analyses also countryâbyâcountry. The results can be found in [Appendix C3](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/#jcms13316-supitem-0001). No substantial country differences could be spotted, providing evidence for a consistent association between the type of informedness and support for EU membership across countries.
## References
1. Aichholzer, J. , PartheymĂźller, J. , Wagner, M. , Kritzinger, S. , Plescia, C. , Eberl, J.âM. , Meyer, T. , Berk, N. , Boomgaarden, H. & MĂźller, W.C. (2020) AUTNES Online Panel Study 2017â2019. Vienna: AUSSDA. 10.11587/QDETRI
\[[DOI](https://doi.org/10.11587/QDETRI)\] \[[Google Scholar](https://scholar.google.com/scholar_lookup?title=AUTNES%20Online%20Panel%20Study%202017%E2%80%902019&author=J.%20Aichholzer&author=J.%20Partheym%C3%BCller&author=M.%20Wagner&author=S.%20Kritzinger&author=C.%20Plescia&publication_year=2020&)\]
2. Allwood, C.M. and Montgomery, H. (1987) âResponse Selection Strategies and Realism of Confidence Judgmentsâ. Organizational Behavior and Human Decision Processes, Vol. 39, No. 3, pp. 365â383.
\[[Google Scholar](https://scholar.google.com/scholar_lookup?journal=Organizational%20Behavior%20and%20Human%20Decision%20Processes&title=Response%20Selection%20Strategies%20and%20Realism%20of%20Confidence%20Judgments&author=C.M.%20Allwood&author=H.%20Montgomery&volume=39&issue=3&publication_year=1987&pages=365-383&)\]
3. Althaus, S.L. (2003) Collective Preferences in Democratic Politics. Opinion Survey and the Will of the People (Cambridge: Cambridge University Press; ).
\[[Google Scholar](https://scholar.google.com/scholar_lookup?title=Collective%20Preferences%20in%20Democratic%20Politics.%20Opinion%20Survey%20and%20the%20Will%20of%20the%20People&author=S.L.%20Althaus&publication_year=2003&)\]
4. Alvarez, R.M. and Franklin, C.H. (1994) âUncertainty and Political Perceptionsâ. Journal of Politics, Vol. 56, No. 3, pp. 671â688.
\[[Google Scholar](https://scholar.google.com/scholar_lookup?journal=Journal%20of%20Politics&title=Uncertainty%20and%20Political%20Perceptions&author=R.M.%20Alvarez&author=C.H.%20Franklin&volume=56&issue=3&publication_year=1994&pages=671-688&)\]
5. Anderson, C.J. (1998) âWhen in Doubt, Use Proxies: Attitudes toward Domestic Politics and Support for European Integrationâ. Comparative Political Studies, Vol. 31, No. 5, pp. 569â601.
\[[Google Scholar](https://scholar.google.com/scholar_lookup?journal=Comparative%20Political%20Studies&title=When%20in%20Doubt,%20Use%20Proxies:%20Attitudes%20toward%20Domestic%20Politics%20and%20Support%20for%20European%20Integration&author=C.J.%20Anderson&volume=31&issue=5&publication_year=1998&pages=569-601&)\]
6. Baglioni, S. and Hurrelmann, A. (2016) âThe Eurozone Crisis and Citizen Engagement in EU Affairsâ. West European Politics, Vol. 39, No. 1, pp. 104â124.
\[[Google Scholar](https://scholar.google.com/scholar_lookup?journal=West%20European%20Politics&title=The%20Eurozone%20Crisis%20and%20Citizen%20Engagement%20in%20EU%20Affairs&author=S.%20Baglioni&author=A.%20Hurrelmann&volume=39&issue=1&publication_year=2016&pages=104-124&)\]
7. Banducci, S. , Giebler, H. and Kritzinger, S. (2017) âKnowing More from Less: How the Information Environment Increases Knowledge of Party Positionsâ. British Journal of Political Science, Vol. 47, No. 3, pp. 571â588.
\[[Google Scholar](https://scholar.google.com/scholar_lookup?journal=British%20Journal%20of%20Political%20Science&title=Knowing%20More%20from%20Less:%20How%20the%20Information%20Environment%20Increases%20Knowledge%20of%20Party%20Positions&author=S.%20Banducci&author=H.%20Giebler&author=S.%20Kritzinger&volume=47&issue=3&publication_year=2017&pages=571-588&)\]
8. Baumeister, R.F. , Campbell, J.D. , Krueger, J.I. and Vohs, K.D. (2003) âDoes High Selfâesteem Cause Better Performance, Interpersonal Success, Happiness, or Healthier Lifestyles?â Psychological Science in the Public Interest, Vol. 4, pp. 1â44.
\[[DOI](https://doi.org/10.1111/1529-1006.01431)\] \[[PubMed](https://pubmed.ncbi.nlm.nih.gov/26151640/)\] \[[Google Scholar](https://scholar.google.com/scholar_lookup?journal=Psychological%20Science%20in%20the%20Public%20Interest&title=Does%20High%20Self%E2%80%90esteem%20Cause%20Better%20Performance,%20Interpersonal%20Success,%20Happiness,%20or%20Healthier%20Lifestyles?&author=R.F.%20Baumeister&author=J.D.%20Campbell&author=J.I.%20Krueger&author=K.D.%20Vohs&volume=4&publication_year=2003&pages=1-44&pmid=26151640&doi=10.1111/1529-1006.01431&)\]
9. Bock, R.D. and Lieberman, M. (1970) âFitting a Response Model For n Dichotomously Scored Itemsâ. Psychometrika, Vol. 35, No. 2, pp. 179â197.
\[[Google Scholar](https://scholar.google.com/scholar_lookup?journal=Psychometrika&title=Fitting%20a%20Response%20Model%20For%20n%20Dichotomously%20Scored%20Items&author=R.D.%20Bock&author=M.%20Lieberman&volume=35&issue=2&publication_year=1970&pages=179-197&)\]
10. Castanho Silva, B. , Vegetti, F. and Littvay, L. (2017) âThe Elite Is up to Something: Exploring the Relation between Populism and Belief in Conspiracy Theoriesâ. Swiss Political Science Review, Vol. 23, No. 4, pp. 423â443.
\[[Google Scholar](https://scholar.google.com/scholar_lookup?journal=Swiss%20Political%20Science%20Review&title=The%20Elite%20Is%20up%20to%20Something:%20Exploring%20the%20Relation%20between%20Populism%20and%20Belief%20in%20Conspiracy%20Theories&author=B.%20Castanho%20Silva&author=F.%20Vegetti&author=L.%20Littvay&volume=23&issue=4&publication_year=2017&pages=423-443&)\]
11. Clarke, H.D. , Goodwin, M. and Whiteley, P. (2017) âWhy Britain Voted for Brexit: An IndividualâLevel Analysis of the 2016 Referendum Voteâ. Parliamentary Affairs, Vol. 70, No. 3, pp. 439â464.
\[[Google Scholar](https://scholar.google.com/scholar_lookup?journal=Parliamentary%20Affairs&title=Why%20Britain%20Voted%20for%20Brexit:%20An%20Individual%E2%80%90Level%20Analysis%20of%20the%202016%20Referendum%20Vote&author=H.D.%20Clarke&author=M.%20Goodwin&author=P.%20Whiteley&volume=70&issue=3&publication_year=2017&pages=439-464&)\]
12. Converse, P.E. (1990) âPopular Representation and the Distribution of Informationâ. In Ferejohn, J.A. and Kuklinski, J.H. (eds) Information and Democratic Processes (Urban: University of Illinois Press; ), pp. 369â388.
\[[Google Scholar](https://scholar.google.com/scholar_lookup?title=Information%20and%20Democratic%20Processes&author=P.E.%20Converse&publication_year=1990&)\]
13. Cromby, J. (2019) âThe Myths of Brexitâ. Journal of Community & Applied Social Psychology, Vol. 29, No. 1, pp. 56â66.
\[[Google Scholar](https://scholar.google.com/scholar_lookup?journal=Journal%20of%20Community%20&%20Applied%20Social%20Psychology&title=The%20Myths%20of%20Brexit&author=J.%20Cromby&volume=29&issue=1&publication_year=2019&pages=56-66&)\]
14. Dahl, R.A. (1989) Democracy and its Critics (New Haven: Yale University Press; ).
\[[Google Scholar](https://scholar.google.com/scholar_lookup?title=Democracy%20and%20its%20Critics&author=R.A.%20Dahl&publication_year=1989&)\]
15. Dancey, L. and Sheagley, G. (2013) âHeuristics Behaving Badly: Party Cues and Voter Knowledgeâ. American Journal of Political Science, Vol. 57, No. 2, pp. 312â325.
\[[Google Scholar](https://scholar.google.com/scholar_lookup?journal=American%20Journal%20of%20Political%20Science&title=Heuristics%20Behaving%20Badly:%20Party%20Cues%20and%20Voter%20Knowledge&author=L.%20Dancey&author=G.%20Sheagley&volume=57&issue=2&publication_year=2013&pages=312-325&)\]
16. De Vreese, C.H. (2007) âA Spiral of Euroscepticism: The Media's Fault?â Acta Politica, Vol. 42, No. 2â3, pp. 271â286.
\[[Google Scholar](https://scholar.google.com/scholar_lookup?journal=Acta%20Politica&title=A%20Spiral%20of%20Euroscepticism:%20The%20Media's%20Fault?&author=C.H.%20De%20Vreese&volume=42&issue=2%E2%80%933&publication_year=2007&pages=271-286&)\]
17. Delli Carpini, M.X. and Keeter, S. (1996) What Americans Know about Politics and Why It Matters (New Haven: Yale University Press; ).
\[[Google Scholar](https://scholar.google.com/scholar_lookup?title=What%20Americans%20Know%20about%20Politics%20and%20Why%20It%20Matters&author=M.X.%20Delli%20Carpini&author=S.%20Keeter&publication_year=1996&)\]
18. Druckman, J.N. and McGrath, M.C. (2019) âThe Evidence for Motivated Reasoning in Climate Change Preference Formationâ. Nature Climate Change, Vol. 9, No. 2, pp. 111â119.
\[[Google Scholar](https://scholar.google.com/scholar_lookup?journal=Nature%20Climate%20Change&title=The%20Evidence%20for%20Motivated%20Reasoning%20in%20Climate%20Change%20Preference%20Formation&author=J.N.%20Druckman&author=M.C.%20McGrath&volume=9&issue=2&publication_year=2019&pages=111-119&)\]
19. Flynn, D.J. , Nyhan, B. and Reifler, J. (2017) âThe Nature and Origins of Misperceptions: Understanding False and Unsupported Beliefs about Politicsâ. Political Psychology, Vol. 38, No. S1, pp. 127â150.
\[[Google Scholar](https://scholar.google.com/scholar_lookup?journal=Political%20Psychology&title=The%20Nature%20and%20Origins%20of%20Misperceptions:%20Understanding%20False%20and%20Unsupported%20Beliefs%20about%20Politics&author=D.J.%20Flynn&author=B.%20Nyhan&author=J.%20Reifler&volume=38&issue=S1&publication_year=2017&pages=127-150&)\]
20. Follesdal, A. and Hix, S. (2006) âWhy There Is a Democratic Deficit in the EU: A Response to Majone and Moravcsikâ. JCMS: Journal of Common Market Studies, Vol. 44, No. 3, pp. 533â562.
\[[Google Scholar](https://scholar.google.com/scholar_lookup?journal=JCMS:%20Journal%20of%20Common%20Market%20Studies&title=Why%20There%20Is%20a%20Democratic%20Deficit%20in%20the%20EU:%20A%20Response%20to%20Majone%20and%20Moravcsik&author=A.%20Follesdal&author=S.%20Hix&volume=44&issue=3&publication_year=2006&pages=533-562&)\]
21. Fraile, M. (2013) âDo InformationâRich Contexts Reduce Knowledge Inequalities? The Contextual Determinants of Political Knowledge in Europeâ. Acta Politica, Vol. 48, No. 2, pp. 119â143.
\[[Google Scholar](https://scholar.google.com/scholar_lookup?journal=Acta%20Politica&title=Do%20Information%E2%80%90Rich%20Contexts%20Reduce%20Knowledge%20Inequalities?%20The%20Contextual%20Determinants%20of%20Political%20Knowledge%20in%20Europe&author=M.%20Fraile&volume=48&issue=2&publication_year=2013&pages=119-143&)\]
22. Gabel, M. (1998) âPublic Support for European Integration: An Empirical Test of Five Theoriesâ. Journal of Politics, Vol. 60, No. 2, pp. 333â354.
\[[Google Scholar](https://scholar.google.com/scholar_lookup?journal=Journal%20of%20Politics&title=Public%20Support%20for%20European%20Integration:%20An%20Empirical%20Test%20of%20Five%20Theories&author=M.%20Gabel&volume=60&issue=2&publication_year=1998&pages=333-354&)\]
23. Goodwin, M.J. and Heath, O. (2016) âThe 2016 Referendum, Brexit and the Left Behind: An AggregateâLevel Analysis of the Resultâ. Political Quarterly, Vol. 87, No. 3, pp. 323â332.
\[[Google Scholar](https://scholar.google.com/scholar_lookup?journal=Political%20Quarterly&title=The%202016%20Referendum,%20Brexit%20and%20the%20Left%20Behind:%20An%20Aggregate%E2%80%90Level%20Analysis%20of%20the%20Result&author=M.J.%20Goodwin&author=O.%20Heath&volume=87&issue=3&publication_year=2016&pages=323-332&)\]
24. Griffin, D. and Tversky, A. (1992) âThe Weighing of Evidence and the Determinants of Confidenceâ. Cognitive Psychology, Vol. 24, No. 3, pp. 411â435.
\[[Google Scholar](https://scholar.google.com/scholar_lookup?journal=Cognitive%20Psychology&title=The%20Weighing%20of%20Evidence%20and%20the%20Determinants%20of%20Confidence&author=D.%20Griffin&author=A.%20Tversky&volume=24&issue=3&publication_year=1992&pages=411-435&)\]
25. Hanmer, M.J. and Kalkan, K.O. (2013) âBehind the Curve: Clarifying the Best Approach to Calculating Predicted Probabilities and Marginal Effects from Limited Dependent Variable Modelsâ. American Journal of Political Science, Vol. 57, No. 3, pp. 263â277.
\[[Google Scholar](https://scholar.google.com/scholar_lookup?journal=American%20Journal%20of%20Political%20Science&title=Behind%20the%20Curve:%20Clarifying%20the%20Best%20Approach%20to%20Calculating%20Predicted%20Probabilities%20and%20Marginal%20Effects%20from%20Limited%20Dependent%20Variable%20Models&author=M.J.%20Hanmer&author=K.O.%20Kalkan&volume=57&issue=3&publication_year=2013&pages=263-277&)\]
26. Hobolt, S.B. (2016) âThe Brexit Vote: A Divided Nation, a Divided Continentâ. Journal of European Public Policy, Vol. 23, No. 9, pp. 1259â1277.
\[[Google Scholar](https://scholar.google.com/scholar_lookup?journal=Journal%20of%20European%20Public%20Policy&title=The%20Brexit%20Vote:%20A%20Divided%20Nation,%20a%20Divided%20Continent&author=S.B.%20Hobolt&volume=23&issue=9&publication_year=2016&pages=1259-1277&)\]
27. Hobolt, S.B. and De Vries, C.E. (2016) âPublic Support for European Integrationâ. Annual Review of Political Science, Vol. 19, pp. 413â432.
\[[Google Scholar](https://scholar.google.com/scholar_lookup?journal=Annual%20Review%20of%20Political%20Science&title=Public%20Support%20for%20European%20Integration&author=S.B.%20Hobolt&author=C.E.%20De%20Vries&volume=19&publication_year=2016&pages=413-432&)\]
28. Hochschild, J.L. and Einstein, K.L. (2015) Do Facts Matter? Information and Misinformation in American Politics (Norman: University of Oklahoma Press; ).
\[[Google Scholar](https://scholar.google.com/scholar_lookup?title=Do%20Facts%20Matter?%20Information%20and%20Misinformation%20in%20American%20Politics&author=J.L.%20Hochschild&author=K.L.%20Einstein&publication_year=2015&)\]
29. Huckfeldt, R. , Morehouse Mendez, J. and Osborn, T. (2004) âDisagreement, Ambivalence, and Engagement: The Political Consequences of Heterogeneous Networksâ. Political Psychology, Vol. 25, No. 1, pp. 65â95.
\[[Google Scholar](https://scholar.google.com/scholar_lookup?journal=Political%20Psychology&title=Disagreement,%20Ambivalence,%20and%20Engagement:%20The%20Political%20Consequences%20of%20Heterogeneous%20Networks&author=R.%20Huckfeldt&author=J.%20Morehouse%20Mendez&author=T.%20Osborn&volume=25&issue=1&publication_year=2004&pages=65-95&)\]
30. Inglehart, R. (1970) âCognitive Mobilization and European Identityâ. Comparative Politics, Vol. 3, No. 1, pp. 45â70.
\[[Google Scholar](https://scholar.google.com/scholar_lookup?journal=Comparative%20Politics&title=Cognitive%20Mobilization%20and%20European%20Identity&author=R.%20Inglehart&volume=3&issue=1&publication_year=1970&pages=45-70&)\]
31. Janssen, J.I.H. (1991) âPostmaterialism, Cognitive Mobilization and Public Support for European Integrationâ. British Journal of Political Science, Vol. 21, No. 4, pp. 443â468.
\[[Google Scholar](https://scholar.google.com/scholar_lookup?journal=British%20Journal%20of%20Political%20Science&title=Postmaterialism,%20Cognitive%20Mobilization%20and%20Public%20Support%20for%20European%20Integration&author=J.I.H.%20Janssen&volume=21&issue=4&publication_year=1991&pages=443-468&)\]
32. Karp, J.A. , Banducci, S.A. and Bowler, S. (2003) âTo Know It Is to Love It? Satisfaction with Democracy in the European Unionâ. Comparative Political Studies, Vol. 36, No. 3, pp. 271â292.
\[[Google Scholar](https://scholar.google.com/scholar_lookup?journal=Comparative%20Political%20Studies&title=To%20Know%20It%20Is%20to%20Love%20It?%20Satisfaction%20with%20Democracy%20in%20the%20European%20Union&author=J.A.%20Karp&author=S.A.%20Banducci&author=S.%20Bowler&volume=36&issue=3&publication_year=2003&pages=271-292&)\]
33. Kim, S. , Taber, C.S. and Lodge, M. (2010) âA Computational Model of the Citizen as Motivated Reasoner: Modeling the Dynamics of the 2000 Presidential Electionâ. Political Behavior, Vol. 32, No. 1, pp. 1â28.
\[[Google Scholar](https://scholar.google.com/scholar_lookup?journal=Political%20Behavior&title=A%20Computational%20Model%20of%20the%20Citizen%20as%20Motivated%20Reasoner:%20Modeling%20the%20Dynamics%20of%20the%202000%20Presidential%20Election&author=S.%20Kim&author=C.S.%20Taber&author=M.%20Lodge&volume=32&issue=1&publication_year=2010&pages=1-28&)\]
34. Kling, K.C. , Hyde, J. , Showers, C. and Buswell, B.N. (1999) âGender Differences in SelfâEsteem: A MetaâAnalysisâ. Psychological Bulletin, Vol. 125, No. 4, pp. 470â500.
\[[DOI](https://doi.org/10.1037/0033-2909.125.4.470)\] \[[PubMed](https://pubmed.ncbi.nlm.nih.gov/10414226/)\] \[[Google Scholar](https://scholar.google.com/scholar_lookup?journal=Psychological%20Bulletin&title=Gender%20Differences%20in%20Self%E2%80%90Esteem:%20A%20Meta%E2%80%90Analysis&author=K.C.%20Kling&author=J.%20Hyde&author=C.%20Showers&author=B.N.%20Buswell&volume=125&issue=4&publication_year=1999&pages=470-500&pmid=10414226&doi=10.1037/0033-2909.125.4.470&)\]
35. Koch, J.W. (2003) âBeing Certain versus Being Right: Citizen Certainty and Accuracy of House Candidates' Ideological Orientationsâ. Political Behavior, Vol. 25, No. 3, pp. 221â246.
\[[Google Scholar](https://scholar.google.com/scholar_lookup?journal=Political%20Behavior&title=Being%20Certain%20versus%20Being%20Right:%20Citizen%20Certainty%20and%20Accuracy%20of%20House%20Candidates'%20Ideological%20Orientations&author=J.W.%20Koch&volume=25&issue=3&publication_year=2003&pages=221-246&)\]
36. Kritzinger, S. , Plescia, C. , Raube, K. , Wilhelm, J. & Wouters, J. (2020) Assessing the 2019 European Parliament Elections. London: Routledge.
\[[Google Scholar](https://scholar.google.com/scholar_lookup?title=Assessing%20the%202019%20European%20Parliament%20Elections&author=S.%20Kritzinger&author=C.%20Plescia&author=K.%20Raube&author=J.%20Wilhelm&author=J.%20Wouters&publication_year=2020&)\]
37. Kuklinski, J.H. , Quirk, P.J. , Jerit, J. , Schwieder, D. and Rich, R.F. (2000) âMisinformation and the Currency of Democratic Citizenship of Democratic Citizenshipâ. Journal of Politics, Vol. 62, No. 3, pp. 790â816.
\[[Google Scholar](https://scholar.google.com/scholar_lookup?journal=Journal%20of%20Politics&title=Misinformation%20and%20the%20Currency%20of%20Democratic%20Citizenship%20of%20Democratic%20Citizenship&author=J.H.%20Kuklinski&author=P.J.%20Quirk&author=J.%20Jerit&author=D.%20Schwieder&author=R.F.%20Rich&volume=62&issue=3&publication_year=2000&pages=790-816&)\]
38. Kuklinski, J.H. , Quirk, P.J. , Schwieder, D.W. and Rich, R.F. (1998) ââJust the Facts, Ma'amâ: Political Facts and Public Opinionâ. Annals of the American Academy of Political and Social Science, Vol. 560, No. 1, pp. 143â154.
\[[Google Scholar](https://scholar.google.com/scholar_lookup?journal=Annals%20of%20the%20American%20Academy%20of%20Political%20and%20Social%20Science&title=%E2%80%9CJust%20the%20Facts,%20Ma'am%E2%80%9D:%20Political%20Facts%20and%20Public%20Opinion&author=J.H.%20Kuklinski&author=P.J.%20Quirk&author=D.W.%20Schwieder&author=R.F.%20Rich&volume=560&issue=1&publication_year=1998&pages=143-154&)\]
39. Kwak, N. (1999) âRevisiting the Knowledge Gap Hypothesis: Education, Motivation, and Media Useâ. Communication Research, Vol. 26, No. 4, pp. 385â413.
\[[Google Scholar](https://scholar.google.com/scholar_lookup?journal=Communication%20Research&title=Revisiting%20the%20Knowledge%20Gap%20Hypothesis:%20Education,%20Motivation,%20and%20Media%20Use&author=N.%20Kwak&volume=26&issue=4&publication_year=1999&pages=385-413&)\]
40. LeDuc, L. (2009) âCampaign Tactics and Outcomes in Referendumsâ. In Setälä, M. and Schiller, T. (eds) Referendums and Representative Democracy: Responsiveness, Accountability and Deliberation (Abingdon: Routledge; ), pp. 139â161.
\[[Google Scholar](https://scholar.google.com/scholar_lookup?title=Referendums%20and%20Representative%20Democracy:%20Responsiveness,%20Accountability%20and%20Deliberation&author=L.%20LeDuc&publication_year=2009&)\]
41. Lee, S. and Matsuo, A. (2018) âDecomposing Political Knowledge: What Is Confidence in Knowledge and Why It Mattersâ. Electoral Studies, Vol. 51, pp. 1â13.
\[[Google Scholar](https://scholar.google.com/scholar_lookup?journal=Electoral%20Studies&title=Decomposing%20Political%20Knowledge:%20What%20Is%20Confidence%20in%20Knowledge%20and%20Why%20It%20Matters&author=S.%20Lee&author=A.%20Matsuo&volume=51&publication_year=2018&pages=1-13&)\]
42. Lewandowsky, S.W. , Stritzke, G.K. , Oberauer, K. and Morales, M. (2005) âMemory for Fact, Fiction, and Misinformation: The Iraq War 2003â. Psychological Science, Vol. 16, No. 3, pp. 190â195.
\[[DOI](https://doi.org/10.1111/j.0956-7976.2005.00802.x)\] \[[PubMed](https://pubmed.ncbi.nlm.nih.gov/15733198/)\] \[[Google Scholar](https://scholar.google.com/scholar_lookup?journal=Psychological%20Science&title=Memory%20for%20Fact,%20Fiction,%20and%20Misinformation:%20The%20Iraq%20War%202003&author=S.W.%20Lewandowsky&author=G.K.%20Stritzke&author=K.%20Oberauer&author=M.%20Morales&volume=16&issue=3&publication_year=2005&pages=190-195&pmid=15733198&doi=10.1111/j.0956-7976.2005.00802.x&)\]
43. Lodge, M. and Taber, C.S. (2013) The Rationalizing Voter (Cambridge: Cambridge University Press; ).
\[[Google Scholar](https://scholar.google.com/scholar_lookup?title=The%20Rationalizing%20Voter&author=M.%20Lodge&author=C.S.%20Taber&publication_year=2013&)\]
44. Luskin, R.C. (1990) âExplaining Political Sophisticationâ. Political Behavior, Vol. 12, No. 4, pp. 331â361.
\[[Google Scholar](https://scholar.google.com/scholar_lookup?journal=Political%20Behavior&title=Explaining%20Political%20Sophistication&author=R.C.%20Luskin&volume=12&issue=4&publication_year=1990&pages=331-361&)\]
45. Mondak, J.J. and Creel Davis, B. (2001) âAsked and Answered: Knowledge Levels When We Will Not Take âDon't Knowâ for an Answerâ. Political Behavior, Vol. 23, No. 3, pp. 199â224.
\[[Google Scholar](https://scholar.google.com/scholar_lookup?journal=Political%20Behavior&title=Asked%20and%20Answered:%20Knowledge%20Levels%20When%20We%20Will%20Not%20Take%20%E2%80%98Don't%20Know%E2%80%99%20for%20an%20Answer&author=J.J.%20Mondak&author=B.%20Creel%20Davis&volume=23&issue=3&publication_year=2001&pages=199-224&)\]
46. Mutz, D.C. (2006) Hearing the Other Side: Deliberative versus Participatory Democracy (Cambridge: Cambridge University Press; ).
\[[Google Scholar](https://scholar.google.com/scholar_lookup?title=Hearing%20the%20Other%20Side:%20Deliberative%20versus%20Participatory%20Democracy&author=D.C.%20Mutz&publication_year=2006&)\]
47. Niederle, M. and Vesterlund, L. (2011) âGender and Competitionâ. Annual Review of Economics, Vol. 3, pp. 601â630.
\[[Google Scholar](https://scholar.google.com/scholar_lookup?journal=Annual%20Review%20of%20Economics&title=Gender%20and%20Competition&author=M.%20Niederle&author=L.%20Vesterlund&volume=3&publication_year=2011&pages=601-630&)\]
48. Ortoleva, P. and Snowberg, E. (2015) âOverconfidence in Political Behaviorâ. American Economic Review, Vol. 105, No. 2, pp. 504â535.
\[[Google Scholar](https://scholar.google.com/scholar_lookup?journal=American%20Economic%20Review&title=Overconfidence%20in%20Political%20Behavior&author=P.%20Ortoleva&author=E.%20Snowberg&volume=105&issue=2&publication_year=2015&pages=504-535&)\]
49. Page, B.I. and Shapiro, R.Y. (1992) The Rational Public: Fifty Years of Trends in Americans, *Policy Preferences* (Chicago: University of Chicago Press; ).
\[[Google Scholar](https://scholar.google.com/scholar_lookup?title=The%20Rational%20Public:%20Fifty%20Years%20of%20Trends%20in%20Americans&author=B.I.%20Page&author=R.Y.%20Shapiro&publication_year=1992&)\]
50. Park, C.W. , Mothersbaugh, D.L. and Feick, L. (1994) âConsumer Knowledge Assessmentâ. Journal of Consumer Research, Vol. 21, No. 1, pp. 71â82.
\[[Google Scholar](https://scholar.google.com/scholar_lookup?journal=Journal%20of%20Consumer%20Research&title=Consumer%20Knowledge%20Assessment&author=C.W.%20Park&author=D.L.%20Mothersbaugh&author=L.%20Feick&volume=21&issue=1&publication_year=1994&pages=71-82&)\]
51. Plescia, C. , Wilhelm, J. , Kritzinger, S. , SchĂźberl, T. and PartheymĂźller, J. (2020) RECONNECT 2019 European Parliament Election Panel Survey (Vienna: AUSSDA; ). 10.11587/MOV0EZ
\[[DOI](https://doi.org/10.11587/MOV0EZ)\] \[[Google Scholar](https://scholar.google.com/scholar_lookup?title=RECONNECT%202019%20European%20Parliament%20Election%20Panel%20Survey&author=C.%20Plescia&author=J.%20Wilhelm&author=S.%20Kritzinger&author=T.%20Sch%C3%BCberl&author=J.%20Partheym%C3%BCller&publication_year=2020&)\]
52. Popkin, S.L. (1991) The Reasoning Voter. Communication and Persuasion in Presidential Campaigns (Chicago: University of Chicago Press; ).
\[[Google Scholar](https://scholar.google.com/scholar_lookup?title=The%20Reasoning%20Voter.%20Communication%20and%20Persuasion%20in%20Presidential%20Campaigns&author=S.L.%20Popkin&publication_year=1991&)\]
53. Radecki, C.M. and Jaccard, J. (1995) âPerceptions of Knowledge, Actual Knowledge, and Information Search Behaviorâ. Journal of Experimental Social Psychology, Vol. 31, No. 2, pp. 107â138.
\[[Google Scholar](https://scholar.google.com/scholar_lookup?journal=Journal%20of%20Experimental%20Social%20Psychology&title=Perceptions%20of%20Knowledge,%20Actual%20Knowledge,%20and%20Information%20Search%20Behavior&author=C.M.%20Radecki&author=J.%20Jaccard&volume=31&issue=2&publication_year=1995&pages=107-138&)\]
54. Rapeli, L. (2014) âComparing Local, National and EU Knowledge: The Ignorant Public Reassessedâ. Scandinavian Political Studies, Vol. 37, No. 4, pp. 428â446.
\[[Google Scholar](https://scholar.google.com/scholar_lookup?journal=Scandinavian%20Political%20Studies&title=Comparing%20Local,%20National%20and%20EU%20Knowledge:%20The%20Ignorant%20Public%20Reassessed&author=L.%20Rapeli&volume=37&issue=4&publication_year=2014&pages=428-446&)\]
55. Schlipphak, B. and Treib, O. (2017) âPlaying the Blame Game on Brussels: The Domestic Political Effects of EU Interventions against Democratic Backslidingâ. Journal of European Public Policy, Vol. 24, No. 3, pp. 352â365.
\[[Google Scholar](https://scholar.google.com/scholar_lookup?journal=Journal%20of%20European%20Public%20Policy&title=Playing%20the%20Blame%20Game%20on%20Brussels:%20The%20Domestic%20Political%20Effects%20of%20EU%20Interventions%20against%20Democratic%20Backsliding&author=B.%20Schlipphak&author=O.%20Treib&volume=24&issue=3&publication_year=2017&pages=352-365&)\]
56. Soll, J. and Klayman, J. (2004) âOverconfidence in Interval Estimatesâ. Journal of Experimental Psychology: Learning, Memory, and Cognition, Vol. 30, pp. 299â314.
\[[DOI](https://doi.org/10.1037/0278-7393.30.2.299)\] \[[PubMed](https://pubmed.ncbi.nlm.nih.gov/14979805/)\] \[[Google Scholar](https://scholar.google.com/scholar_lookup?journal=Journal%20of%20Experimental%20Psychology:%20Learning,%20Memory,%20and%20Cognition&title=Overconfidence%20in%20Interval%20Estimates&author=J.%20Soll&author=J.%20Klayman&volume=30&publication_year=2004&pages=299-314&pmid=14979805&doi=10.1037/0278-7393.30.2.299&)\]
57. Stimson, J.A. (2015) Tides of Consent: How Public Opinion Shapes American Politics (New York: Cambridge University Press; ).
\[[Google Scholar](https://scholar.google.com/scholar_lookup?title=Tides%20of%20Consent:%20How%20Public%20Opinion%20Shapes%20American%20Politics&author=J.A.%20Stimson&publication_year=2015&)\]
58. Thissen, D. and Orlando, M. (2001) âItem Response Theory for Items Scored in Two Categoriesâ. In Thissen, D. and Wainer, H. (eds) Test Scoring (Lawrence Erlbaum Associates Publishers; ), pp. 73â140.
\[[Google Scholar](https://scholar.google.com/scholar_lookup?title=Test%20Scoring&author=D.%20Thissen&author=M.%20Orlando&publication_year=2001&)\]
59. Tiedens, L.Z. and Linton, S. (2001) âJudgment under Emotional Certainty and Uncertainty: The Effect of Specific Emotions on Information Processingâ. Journal of Personality and Social Psychology, Vol. 81, No. 6, pp. 973â988.
\[[DOI](https://doi.org/10.1037//0022-3514.81.6.973)\] \[[PubMed](https://pubmed.ncbi.nlm.nih.gov/11761319/)\] \[[Google Scholar](https://scholar.google.com/scholar_lookup?journal=Journal%20of%20Personality%20and%20Social%20Psychology&title=Judgment%20under%20Emotional%20Certainty%20and%20Uncertainty:%20The%20Effect%20of%20Specific%20Emotions%20on%20Information%20Processing&author=L.Z.%20Tiedens&author=S.%20Linton&volume=81&issue=6&publication_year=2001&pages=973-988&pmid=11761319&doi=10.1037//0022-3514.81.6.973&)\]
60. van Kessel, S. , Sajuria, J. and Van Hauwaert, S.M. (2021) âInformed, Uninformed or Misinformed? A Crossânational Analysis of Populist Party Supporters across European Democraciesâ. West European Politics, Vol. 44, No. 3, pp. 585â610.
\[[Google Scholar](https://scholar.google.com/scholar_lookup?journal=West%20European%20Politics&title=Informed,%20Uninformed%20or%20Misinformed?%20A%20Cross%E2%80%90national%20Analysis%20of%20Populist%20Party%20Supporters%20across%20European%20Democracies&author=S.%20van%20Kessel&author=J.%20Sajuria&author=S.M.%20Van%20Hauwaert&volume=44&issue=3&publication_year=2021&pages=585-610&)\]
61. van Prooijen, J.âW. and Douglas, K.M. (2018) âBelief in Conspiracy Theories: Basic Principles of an Emerging Research Domainâ. European Journal of Social Psychology, Vol. 48, No. 7, pp. 897â908.
\[[DOI](https://doi.org/10.1002/ejsp.2530)\] \[[PMC free article](https://pmc.ncbi.nlm.nih.gov/articles/PMC6282974/)\] \[[PubMed](https://pubmed.ncbi.nlm.nih.gov/30555188/)\] \[[Google Scholar](https://scholar.google.com/scholar_lookup?journal=European%20Journal%20of%20Social%20Psychology&title=Belief%20in%20Conspiracy%20Theories:%20Basic%20Principles%20of%20an%20Emerging%20Research%20Domain&author=J.%E2%80%90W.%20van%20Prooijen&author=K.M.%20Douglas&volume=48&issue=7&publication_year=2018&pages=897-908&pmid=30555188&doi=10.1002/ejsp.2530&)\]
62. van Prooijen, J.âW. and Krouwel, A. (2019) âOverclaiming Knowledge Predicts Antiâestablishment Votingâ. Social Psychological and Personality Science, Vol. 11, No. 3, pp. 356â363.
\[[Google Scholar](https://scholar.google.com/scholar_lookup?journal=Social%20Psychological%20and%20Personality%20Science&title=Overclaiming%20Knowledge%20Predicts%20Anti%E2%80%90establishment%20Voting&author=J.%E2%80%90W.%20van%20Prooijen&author=A.%20Krouwel&volume=11&issue=3&publication_year=2019&pages=356-363&)\]
63. Weary, G. and Jacobson, J.A. (1997) âCausal Uncertainty Beliefs and Diagnostic Information Seekingâ. Journal of Personality and Social Psychology, Vol. 73, No. 4, pp. 839â848.
\[[Google Scholar](https://scholar.google.com/scholar_lookup?journal=Journal%20of%20Personality%20and%20Social%20Psychology&title=Causal%20Uncertainty%20Beliefs%20and%20Diagnostic%20Information%20Seeking&author=G.%20Weary&author=J.A.%20Jacobson&volume=73&issue=4&publication_year=1997&pages=839-848&)\]
## Associated Data
*This section collects any data citations, data availability statements, or supplementary materials included in this article.*
### Supplementary Materials
**Table S1.** **B1**: Multinomial logistic regression for EU referendum preference.
**Figure S1. B1**: Average marginal effects for control variables.
**Figure S2. C1â1:** Item characteristics curves and correlation matrix (reduced scale).
**Figure S3. C1â2:** Informedness and the preference to leave or remain in the EU (reduced scale).
**Figure S4. C1â3:** Average marginal effects of EU knowledge confidence (reduced scale).
**Figure S5. C1â4:** Average marginal effects of EU knowledge accuracy (reduced scale).
**Table S6. C1â1**: Multinomial logistic regression for EU membership preference (reduced scale).
**Figure S7. C1â5**: Average marginal effects for control variables (reduced scale).
**Table S8. C2â1:** Shares of different types of informedness.
**Table S9. C2â2:** Response patterns across types of informedness.
**Figure S10. C3â1**: Item characteristics curves â by country.
**Figure S11. C3â2**: Correlation matrices â by country.
**Figure S12. C3â3**: Heatmaps â by country.
**Figure S13. C3â4**: Average marginal effects of EU knowledge confidence â by country.
**Figure S14. C3â5**: Average marginal effects of EU knowledge accuracy â by country.
**Figure S15. D1**: Univariate distribution of predicted scores for accuracy and confidence.
**Figure S16. D2**: Scree plot and correlation matrix.
**Table S17**. D1. Eigenvalues.
**Table S18**. D2. Factor loadings and unique variances.
**Figure S19. E1.** Predicted probabilities for accuracy at low and high levels of confidence.
**Figure S20. E2.** Predicted probabilities for confidence at low and high levels of accuracy.
[Click here for additional data file.](https://pmc.ncbi.nlm.nih.gov/articles/instance/9544071/bin/JCMS-60-1449-s001.docx) (3.9MB, docx)
***
Articles from Journal of Common Market Studies are provided here courtesy of **Wiley**

## ACTIONS
- [View on publisher site](https://doi.org/10.1111/jcms.13316)
- [PDF (2.7 MB)](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/pdf/JCMS-60-1449.pdf)
- Cite
- Collections
- Permalink
## PERMALINK
Copy
## RESOURCES
### Similar articles
### Cited by other articles
### Links to NCBI Databases
## Cite
- Copy
- [Download .nbib .nbib](https://pmc.ncbi.nlm.nih.gov/articles/PMC9544071/ "Download a file for external citation management software")
- Format:
## Add to Collections
Follow NCBI
[NCBI on X (formerly known as Twitter)](https://twitter.com/ncbi)
[NCBI on Facebook](https://www.facebook.com/ncbi.nlm)
[NCBI on LinkedIn](https://www.linkedin.com/company/ncbinlm)
[NCBI on GitHub](https://github.com/ncbi)
[NCBI RSS feed](https://ncbiinsights.ncbi.nlm.nih.gov/)
Connect with NLM
[NLM on X (formerly known as Twitter)](https://twitter.com/nlm_nih)
[NLM on Facebook](https://www.facebook.com/nationallibraryofmedicine)
[NLM on YouTube](https://www.youtube.com/user/NLMNIH)
[National Library of Medicine 8600 Rockville Pike Bethesda, MD 20894](https://www.google.com/maps/place/8600+Rockville+Pike,+Bethesda,+MD+20894/%4038.9959508,%0A%20%20%20%20%20%20%20%20%20%20%20%20-77.101021,17z/data%3D!3m1!4b1!4m5!3m4!1s0x89b7c95e25765ddb%3A0x19156f88b27635b8!8m2!3d38.9959508!%0A%20%20%20%20%20%20%20%20%20%20%20%204d-77.0988323)
- [Web Policies](https://www.nlm.nih.gov/web_policies.html)
- [FOIA](https://www.nih.gov/institutes-nih/nih-office-director/office-communications-public-liaison/freedom-information-act-office)
- [HHS Vulnerability Disclosure](https://www.hhs.gov/vulnerability-disclosure-policy/index.html)
- [Help](https://support.nlm.nih.gov/)
- [Accessibility](https://www.nlm.nih.gov/accessibility.html)
- [Careers](https://www.nlm.nih.gov/careers/careers.html)
- [NLM](https://www.nlm.nih.gov/)
- [NIH](https://www.nih.gov/)
- [HHS](https://www.hhs.gov/)
- [USA.gov](https://www.usa.gov/)
Back to Top |
| Readable Markdown | null |
| Shard | 129 (laksa) |
| Root Hash | 7295144728021232729 |
| Unparsed URL | gov,nih!nlm,ncbi,pmc,/articles/PMC9544071/ s443 |