Hostname: page-component-78c5997874-8bhkd Total loading time: 0 Render date: 2024-11-13T04:12:55.776Z Has data issue: false hasContentIssue false

Outdated Views of Qualitative Methods: Time to Move On

Published online by Cambridge University Press:  04 January 2017

David Collier*
Affiliation:
Department of Political Science, University of California, Berkeley, 210 Barrows Hall #1950, Berkeley, CA 94720
Henry E. Brady
Affiliation:
Department of Political Science, University of California, Berkeley, 210 Barrows Hall #1950, Berkeley, CA 94720. e-mail: hbrady@berkeley.edu
Jason Seawright
Affiliation:
Department of Political Science, Northwestern University, Scott Hall, 601 University Place, Evanston, IL 60208. e-mail: j-seawright@northwestern.edu
*
e-mail: dcollier@berkeley.edu (corresponding author)

Abstract

Both qualitative and quantitative research routinely fall short, producing misleading causal inferences. Because these weaknesses are in part different, we are convinced that multimethod strategies are productive. Each approach can provide additional leverage that helps address shortcomings of the other. This position is quite distinct from that of Beck, who believes that the two types of analysis cannot be adjoined. We review examples of adjoining that Beck dismisses, based on what we see as his outdated view of qualitative methods. By contrast, we show that these examples demonstrate how qualitative and quantitative analysis can work together.

Type
Research Article
Copyright
Copyright © The Author 2010. Published by Oxford University Press on behalf of the Society for Political Methodology 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

Authors' note: This response is dedicated to the statistician David A. Freedman, who thought it was late in the game for quantitative researchers still to be skeptical about qualitative methods. We received valuable suggestions and assistance from Tara Buss, F. Daniel Hidalgo, Jody LaPorte, and especially Christopher Chambers-Ju, Maria Gould, and Miranda Yaver.

References

Achen, Christopher H. 2002. Toward a new political methodology: Microfoundations and ART. Annual Review of Political Science 5: 423–50.Google Scholar
Beck, Nathaniel. 2006. Is causal-process observation an oxymoron? Political Analysis 14: 347–52.Google Scholar
Beck, Nathaniel. 2010. Causal process “observation”: Oxymoron or (fine) old wine? Political Analysis 18(4): 499505.Google Scholar
Bennett, Andrew. 2008. Process tracing: A Bayesian perspective. In Oxford handbook of political methodology, ed. Box-Steffensmeier, J., Brady, H. E., and Collier, D., 702–21. Oxford: Oxford University Press.Google Scholar
Berk, Richard A. 2004. Regression analysis: A constructive critique. Thousand Oaks, CA: Sage Publications.CrossRefGoogle Scholar
Berk, Richard A., and Freedman, David A. 2008. On weighting regressions by propensity scores. Evaluation Review 32: 392409.Google Scholar
Brady, Henry E. 2004. Data-set observations versus causal-process observations: The 2000 U.S. presidential election. In Rethinking social inquiry: Diverse tools, shared standards, ed. Brady, H. E. and Collier, D., 267–71. Lanham, MD: Rowman & Littlefield.Google Scholar
Brady, Henry E., and Collier, David. 2004. Rethinking social inquiry: Diverse tools, shared standards. Lanham, MD: Rowman & Littlefield. Given Jason Seawright's coauthorship of many chapters, the in-text reference is BCS 2004.Google Scholar
Brady, Henry E., Collier, David, and Seawright, Jason. 2006. Toward a pluralistic vision of methodology. Political Analysis 14: 353–68.Google Scholar
Campbell, Donald T., and Laurence Ross, H. 1968. Connecticut crackdown on speeding: Time-series data in quasi-experimental analysis. Law and Society Review 3(1): 3353.CrossRefGoogle Scholar
Campbell, Donald T., and Stanley, Julian C. 1963. Experimental and quasi-experimental designs for research. Chicago: Rand McNally.Google Scholar
Diaconis, Persi. 1998. A place for philosophy? The rise of modeling in statistical science. Quarterly of Applied Mathematics 56: 797805.Google Scholar
Dunning, Thad. 2004. Conditioning the effects of aid: Cold War politics, donor credibility, and democracy in Africa. International Organization 58: 409–23.Google Scholar
Dunning, Thad. 2010. Design-based inference: Beyond the pitfalls of regression analysis? In Rethinking social inquiry: Diverse tools, shared standards. 2nd ed., ed. Brady, H. E. and Collier, D., 273311. Lanham, MD: Rowman & Littlefield.Google Scholar
Freedman, David A. 1991. Statistical models and shoe leather. Sociological Methodology 21: 291313.Google Scholar
Freedman, David A. 2008. On types of scientific inquiry: The role of qualitative reasoning. In Oxford handbook of political methodology, ed. Box-Steffensmeier, J., Brady, H. E., and Collier, D., 300–18. Oxford: Oxford University Press.Google Scholar
Heckman, James J. 2000. Causal parameters and policy analysis in economics: A twentieth century retrospective. Quarterly Journal of Economics 115: 4597.CrossRefGoogle Scholar
Hidalgo, F. Daniel, Naidu, Suresh, Nichter, Simeon, and Richardson, Neal. 2010. Economic determinants of land invasions. Review of Economics and Statistics 92(3): 505–23.Google Scholar
Johnston, Richard, Blais, André, Brady, Henry E., and Crête, Jean. 1992. Letting the people decide: Dynamics of a Canadian election. Stanford, CA: Stanford University Press.Google Scholar
Lieberman, Evan S. 2003. Race and regionalism in the politics of taxation in Brazil and South Africa. New York: Cambridge University Press.CrossRefGoogle Scholar
Mahoney, James. 2010. After KKV: The new methodology of qualitative research. World Politics 62(1): 120–47.Google Scholar
Post, Alison. 2010. Liquid assets and fluid contracts: Explaining the uneven effects of water and sanitation privatization. Berkeley, CA: Department of Political Science, University of California.Google Scholar
Schrodt, Philip. 2006. Beyond the linear frequentist orthodoxy. Political Analysis 14: 335–39.Google Scholar
Seawright, Jason. 2010. Regression-based inference: A case-study in failed causal assessment. In Rethinking social inquiry. 2nd ed., ed. Brady, H. E. and Collier, D., 247–71. Lanham, MD: Rowman & Littlefield.Google Scholar
Sekhon, Jasjeet. 2009. Opiates for the matches: Matching methods for causal inference. Annual Review of Political Science 12: 487508.Google Scholar
Stokes, Susan. 2001. Mandates and democracy: Neoliberalism by surprise in Latin America. New York: Cambridge University Press.CrossRefGoogle Scholar
Tannenwald, Nina. 1999. The nuclear taboo: The United States and the normative basis for nuclear non-use. International Organization 53: 433–68.Google Scholar
Winship, Christopher, and Mare, Robert D. 1992. Models for sample selection bias. Annual Review of Sociology 18: 327–50.Google Scholar