We use cookies to distinguish you from other users and to provide you with a better experience on our websites. Close this message to accept cookies or find out how to manage your cookie settings.
To save content items to your account,
please confirm that you agree to abide by our usage policies.
If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account.
Find out more about saving content to .
To save content items to your Kindle, first ensure no-reply@cambridge.org
is added to your Approved Personal Document E-mail List under your Personal Document Settings
on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part
of your Kindle email address below.
Find out more about saving to your Kindle.
Note you can select to save to either the @free.kindle.com or @kindle.com variations.
‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi.
‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.
We elaborate a general workflow of weighting-based survey inference, decomposing it into two main tasks. The first is the estimation of population targets from one or more sources of auxiliary information. The second is the construction of weights that calibrate the survey sample to the population targets. We emphasize that these tasks are predicated on models of the measurement, sampling, and nonresponse process whose assumptions cannot be fully tested. After describing this workflow in abstract terms, we then describe in detail how it can be applied to the analysis of historical and contemporary opinion polls. We also discuss extensions of the basic workflow, particularly inference for causal quantities and multilevel regression and poststratification.
Social scientists are frequently interested in how populations evolve over time. Creating poststratification weights for surveys, for example, requires information on the weighting variables’ joint distribution in the target population. Typically, however, population data are sparsely available across time periods. Even when population data are observed, the content and structure of the data—which variables are observed and whether their marginal or joint distributions are known—differ across time, in ways that preclude straightforward interpolation. As a consequence, survey weights are often based only on the small subset of auxiliary variables whose joint population distribution is observed regularly over time, and thus fail to take full advantage of auxiliary information. To address this problem, we develop a dynamic Bayesian ecological inference model for estimating multivariate categorical distributions from sparse, irregular, and noisy data on their marginal (or partially joint) distributions. Our approach combines (1) a Dirichlet sampling model for the observed margins conditional on the unobserved cell proportions; (2) a set of equations encoding the logical relationships among different population quantities; and (3) a Dirichlet transition model for the period-specific proportions that pools information across time periods. We illustrate this method by estimating annual U.S. phone-ownership rates by race and region based on population data irregularly available between 1930 and 1960. This approach may be useful in a wide variety of contexts where scholars wish to make dynamic ecological inferences about interior cells from marginal data. A new R package estsubpop implements the method.
Using new scaling methods and a comprehensive public opinion dataset, we develop the first survey-based time-series–cross-sectional measures of policy ideology in European mass publics. Our dataset covers 27 countries and 36 years and contains nearly 2.7 million survey responses to 109 unique issue questions. Estimating an ordinal group-level IRT model in each of four issue domains, we obtain biennial estimates of the absolute economic conservatism, relative economic conservatism, social conservatism, and immigration conservatism of men and women in three age categories in each country. Aggregating the group-level estimates yields estimates of the average conservatism in national publics in each biennium between 1981–82 and 2015–16. The four measures exhibit contrasting cross-sectional cleavages and distinct temporal dynamics, illustrating the multidimensionality of mass ideology in Europe. Subjecting our measures to a series of validation tests, we show that the constructs they measure are distinct and substantively important and that they perform as well as or better than one-dimensional proxies for mass conservatism (left–right self-placement and median voter scores). We foresee many uses for these scores by scholars of public opinion, electoral behavior, representation, and policy feedback.
Survey experiments often manipulate the description of attributes in a hypothetical scenario, with the goal of learning about those attributes’ real-world effects. Such inferences rely on an underappreciated assumption: experimental conditions must be information equivalent (IE) with respect to background features of the scenario. IE is often violated because subjects, when presented with information about one attribute, update their beliefs about others too. Labeling a country “a democracy,” for example, affects subjects’ beliefs about the country’s geographic location. When IE is violated, the effect of the manipulation need not correspond to the quantity of interest (the effect of beliefs about the focal attribute). We formally define the IE assumption, relating it to the exclusion restriction in instrumental-variable analysis. We show how to predict IE violations ex ante and diagnose them ex post with placebo tests. We evaluate three strategies for achieving IE. Abstract encouragement is ineffective. Specifying background details reduces imbalance on the specified details and highly correlated details, but not others. Embedding a natural experiment in the scenario can reduce imbalance on all background beliefs, but raises other issues. We illustrate with four survey experiments, focusing on an extension of a prominent study of the democratic peace.
Using eight decades of data, we examine the magnitude, mechanisms, and moderators of dynamic responsiveness in the American states. We show that on both economic and (especially) social issues, the liberalism of state publics predicts future change in state policy liberalism. Dynamic responsiveness is gradual, however; large policy shifts are the result of the cumulation of incremental responsiveness over many years. Partisan control of government appears to mediate only a fraction of responsiveness, suggesting that, contrary to conventional wisdom, responsiveness occurs in large part through the adaptation of incumbent officials. Dynamic responsiveness has increased over time but does not seem to be influenced by institutions such as direct democracy or campaign finance regulations. We conclude that our findings, though in some respects normatively ambiguous, on the whole paint a reassuring portrait of statehouse democracy.
Following David Lee's pioneering work, numerous scholars have applied the regression discontinuity (RD) design to popular elections. Contrary to the assumptions of RD, however, we show that bare winners and bare losers in U.S. House elections (1942–2008) differ markedly on pretreatment covariates. Bare winners possess large ex ante financial, experience, and incumbency advantages over their opponents and are usually the candidates predicted to win by Congressional Quarterly's pre-election ratings. Covariate imbalance actually worsens in the closest House elections. National partisan tides help explain these patterns. Previous works have missed this imbalance because they rely excessively on model-based extrapolation. We present evidence suggesting that sorting in close House elections is due mainly to activities on or before Election Day rather than postelection recounts or other manipulation. The sorting is so strong that it is impossible to achieve covariate balance between matched treated and control observations, making covariate adjustment a dubious enterprise. Although RD is problematic for postwar House elections, this example does highlight the design's advantages over alternatives: RD's assumptions are clear and weaker than model-based alternatives, and their implications are empirically testable.
Over the past eight decades, millions of people have been surveyed on their political opinions. Until recently, however, polls rarely included enough questions in a given domain to apply scaling techniques such as IRT models at the individual level, preventing scholars from taking full advantage of historical survey data. To address this problem, we develop a Bayesian group-level IRT approach that models latent traits at the level of demographic and/or geographic groups rather than individuals. We use a hierarchical model to borrow strength cross-sectionally and dynamic linear models to do so across time. The group-level estimates can be weighted to generate estimates for geographic units. This framework opens up vast new areas of research on historical public opinion, especially at the subnational level. We illustrate this potential by estimating the average policy liberalism of citizens in each U.S. state in each year between 1972 and 2012.
Poole and Rosenthal's NOMINATE scores have been a boon to the study of Congress, but they are not without limitations. We focus on two limitations that are especially important in historical applications. First, the dimensions uncovered by NOMINATE do not necessarily have a consistent ideological meaning over time. Our case study of the 1920s highlights the challenge of interpreting NOMINATE scores in periods when party lines do not map well onto the main contours of ideological debate in political life. Second, the commonly used DW-NOMINATE variant of these scores makes assumptions that are not well suited to dealing with rapid or non-monotonic ideological change. A case study of Southern Democrats in the New Deal era suggests that a more flexible dynamic item-response model provides a better fit for this important period. These applications illustrate the feasibility and value of tailoring one's model and data to one's research goals rather than relying on off-the-shelf NOMINATE scores.
Reputation has long been considered central to international relations, but unobservability, strategic selection, and endogeneity have handicapped quantitative research. A rare source of haphazard variation in the cultural origins of leaders-the fact that one-third of US presidents were raised in the American South, a well-studied example of a culture of honor-provides an opportunity to identify the effects of heightened concern for reputation for resolve. A formal theory that yields several testable predictions while accounting for unobserved selection into disputes is offered. The theory is illustrated through a comparison of presidents John F. Kennedy and Lyndon B. Johnson and systematically tested using matching, permutation inference, and the nonparametric combination of tests. Interstate conflicts under Southern presidents are shown to be twice as likely to involve uses of force, last on average twice as long, and are three times more likely to end in victory for the United States than disputes under non-Southern presidents. Other characteristics of Southern presidencies do not seem able to account for this pattern of results. Theresults provide evidence that concern for reputation is an important cause of interstate conflict behavior.
The seemingly wide opening for liberal domestic policy innovation by the U.S. federal government in the early-to-mid-1930s gave way to a much more limited agenda in the late 1930s and 1940s. The latter years saw the consolidation and gradual extension of several key programs (e.g., Social Security and Keynesian macroeconomic management), but also the frustration of liberal hopes for an expansive “cradle-to-grave” welfare state marked by strong national unions, national health insurance, and full employment policies. Drawing upon rarely used early public opinion polls, we explore the dynamics of public opinion regarding New Deal liberalism during this pivotal era. We argue that a broadly based reaction against labor unions created a difficult backdrop for liberal programmatic advances. We find that this anti-labor reaction was especially virulent in the South but divided even Northern Democrats, thus creating an effective wedge issue for Republicans and their Southern conservative allies. More generally, we find that the mass public favored most of the specific programs created by the New Deal, but was hardly clamoring for major expansions of the national government's role in the late 1930s and 1940s. These findings illuminate the role played by the South in constraining New Deal liberalism while also highlighting the tenuousness of the liberal majority in the North.
Recommend this
Email your librarian or administrator to recommend adding this to your organisation's collection.