Book contents
- Multiverse Analysis
- Analytical Methods for Social Research
- Multiverse Analysis
- Copyright page
- Contents
- Figures
- Tables
- Acknowledgments
- Part I Introduction
- Part II The Computational Multiverse
- Part III Expanding the Multiverse
- 9 Functional Form Robustness
- 10 Data Processing
- 11 Data Processing Multiverse Analysis of Regnerus and Critics
- 12 Retractions in Social Science
- 13 Weighting the Multiverse
- 14 Conclusion
- Appendix: Coding with MULTIVRS in Stata
- References
- Index
9 - Functional Form Robustness
from Part III - Expanding the Multiverse
Published online by Cambridge University Press: 28 February 2025
- Multiverse Analysis
- Analytical Methods for Social Research
- Multiverse Analysis
- Copyright page
- Contents
- Figures
- Tables
- Acknowledgments
- Part I Introduction
- Part II The Computational Multiverse
- Part III Expanding the Multiverse
- 9 Functional Form Robustness
- 10 Data Processing
- 11 Data Processing Multiverse Analysis of Regnerus and Critics
- 12 Retractions in Social Science
- 13 Weighting the Multiverse
- 14 Conclusion
- Appendix: Coding with MULTIVRS in Stata
- References
- Index
Summary
Functional form assumptions are central ingredients of a model specification. Just as there are many possible control variables, there is also an abundance of estimation commands and strategies one could invoke, including ordinary least squares (OLS), logit, matching, and many more. How much do empirical results depend on the choice of functional form? In this chapter we demonstrate the functional form multiverse with two empirical applications: how job loss affects wellbeing in panel data and the effect of education on voting for Trump. We find in our cases that OLS and logit produce very similar results, but that matching estimators can be surprisingly unstable. We also reconsider an important many-analysts study and find that human researchers produce a much wider range of results than does the multiverse algorithm.
Keywords
- Type
- Chapter
- Information
- Multiverse AnalysisComputational Methods for Robust Results, pp. 125 - 153Publisher: Cambridge University PressPrint publication year: 2025