Skip to main content Accessibility help

We use cookies to distinguish you from other users and to provide you with a better experience on our websites. Close this message to accept cookies or find out how to manage your cookie settings.

Close cookie message
×
Hostname: page-component-cd9895bd7-q99xh Total loading time: 0 Render date: 2024-12-26T17:16:10.326Z Has data issue: false hasContentIssue false

6 - Inferential Statistics

from Part II - Foundations

Published online by Cambridge University Press:  15 February 2019

By
Patricia Haden
Edited by
Sally A. Fincher  and
Anthony V. Robins
Sally A. Fincher
Affiliation:
University of Kent, Canterbury
Anthony V. Robins
Affiliation:
University of Otago, New Zealand
Get access

Summary

This chapter provides a pragmatic overview of the concepts and techniques commonly used in inferential data analysis for computing education research. The logic of null hypothesis significance testing (NHST) is discussed in detail. Examples of common inferential tests are provided, along with consideration of when to use each test and how to interpret test results. Common errors in inferential analysis are described, to enable researchers to recognise such errors in the literature and to avoid them in their own research. The emphasis of the chapter is on the practical application and interpretation of inferential techniques, not on the underlying computational formulae.
Type
Chapter
Information
The Cambridge Handbook of Computing Education Research , pp. 133 - 172
Publisher: Cambridge University Press
Print publication year: 2019

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Campbell, S. (1974). Flaws and Fallacies in Statistical Thinking. Upper Saddle River, NJ: Prentice Hall.Google Scholar
Corder, G. W., & Foreman, D. L. (2014). Nonparametric Statistics: A Step-by-Step Approach, 2nd edn. Hoboken, NJ: Wiley.Google Scholar
Edwards, W., Lindman, H., & Savage, L. J. (1963). Bayesian statistical inference for psychological research. Psychological Review, 70(3), 193–242.CrossRefGoogle Scholar
Francis, G. (2017). Equivalent statistics and data interpretation. Behavior Research Methods, 49, 1524–1538Google Scholar
Gravetter, F., & Wallnau, W. B. (2012). Essentials of Statistics for the Behavioral Sciences, 8th edn. Boston, MA: Wadsworth Publishing.Google Scholar
Ioannidis, J. P. (2005). Why most published research findings are false. PLoS Medicine, 2, e124.Google Scholar
Maxwell, B. A., & Taylor, S. R. (2017). Comparing outcomes across different contexts in CS1. In Proceedings of the 48th ACM Technical Symposium on Computer Science Education (SIGCSE ‘17) (pp. 399–403). New York: ACM.Google Scholar
McDonald, J. H (2015). Handbook of Biological Statistics (online edition). Retrieved from www.biostathandbook.com/multiplecomparisons.htmlGoogle Scholar
Miller, J., & Haden, P. (2006). Statistical Analysis with the General Linear Model. Retrieved from www.otago.ac.nz/psychology/otago039309.pdfGoogle Scholar
Nickerson, R. S. (2000). Null hypothesis significance testing: A review of an old and continuing controversy. Psychological Methods, 5(2), 241–301.CrossRefGoogle ScholarPubMed
Pearce, S. C. (1992). Introduction to Fisher (1925): Statistical methods for research workers. In Kotz, S. & Johnson, N. L. (Eds.), Breakthroughs in Statistics: Volume 2: Methodology and Distributions (pp. 59–65). New York: Springer-Verlag.Google Scholar
Rosenthal, R. (1979). The file drawer problem and tolerance for null results. Psychological Bulletin, 86(3), 638–641.Google Scholar
Simes, R. J. (1986). An improved Bonferroni procedure for multiple tests of significance. Biometrika, 73(3), 751–754.Google Scholar
Smith, M. (2012) Common Misteaks Mistakes in Using Statistics: Spotting and Avoiding Them. Retrieved from www.ma.utexas.edu/users/mks/statmistakes/StatisticsMistakes.htmlGoogle Scholar
Van de Schoot, R., Kaplan, D., Denissen, J., Asendorpf, J. B., Neyer, F. J., & van Aken, M. A. G. (2014). A gentle introduction to Bayesian analysis: Applications to developmental research. Child Development, 85, 842–860.CrossRefGoogle ScholarPubMed
Wagenmakers, E. J. (2007). A practical solution to the pervasive problems of p values. Psychonomic Bulletin & Review, 14, 779–804.Google Scholar
Wood, K., Parsons, D., Gasson, J., & Haden, P. (2013). It’s never too early: Pair programming in CS1. In Proceedings of the Fifteenth Australasian Computing Education Conference (pp.13–21). Darlinghurst, Australia: Australian Computer Society.Google Scholar
Yarkoni, T. (2011). Solving the file drawer problem by making the internet the drawer. Retrieved from www.talyarkoni.org/blog/2009/11/26/solving-the-file-drawer-problem-by-making-the-internet-the-drawer/Google Scholar

Save book to Kindle

To save this book to your Kindle, first ensure no-reply@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about saving to your Kindle.

Note you can select to save to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

Available formats
×

Save book to Dropbox

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Dropbox.

Available formats
×

Save book to Google Drive

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Google Drive.

Available formats
×