Hostname: page-component-cd9895bd7-gxg78 Total loading time: 0 Render date: 2024-12-28T18:42:08.325Z Has data issue: false hasContentIssue false

Fallability in the Visual Assessment of Behavioural Interventions: Time-Series Statistics to Analyse Time-Series Data

Published online by Cambridge University Press:  06 October 2014

Christopher Sharpley*
Affiliation:
Monash University
*
Faculty of Education, Monash University, Clayton, Victoria 3168, Australia
Get access

Abstract

The use of visual analysis alone to determine the presence of significant and generalizable effects in typical behavioural interventions is subject to a series of possible errors which result in high levels of unreliability when data are analysed in this way. The presence of autocorrelation in most behavioural data poses a serious threat to visual and traditional analysis of such data, a threat which can be avoided by use of the more appropriate interrupted time-series (TMS) statistics. Although previously suggested as reasons for not using TMS procedures, the issues of model-identification and number of data points required for TMS are discussed and shown to be invalid arguments against the use of TMS. A case is made for visual analysis of behavioural data as an appropriate procedure only under certain constrained clinical conditions.

Type
Article
Copyright
Copyright © The Author(s) 1986

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

REFERENCES

Baer, D.M. (1977). Perhaps it would be better not to know everything. Journal of Applied Behavior Analysis, 10, 167172.CrossRefGoogle Scholar
Bailey, D.B. (1984). Effects of lines of progress and semilogarithmic charts on ratings of charted data. Journal of Applied Behavior Analysis, 17, 359366.CrossRefGoogle ScholarPubMed
Ballard, K.D. (1983). The visual analysis of time series data: issues affecting the assessment of behavioural interventions. New Zealand Journal of Psychology, 12, 6973.Google Scholar
Bandura, A. (1978). The self system in reciprocal determinism. American Psychologist, 33, 344358.CrossRefGoogle Scholar
Box, G.E.P., & Jenkins, G.M. (1970). Time-series analysis: forecasting and control. San Francisco. Holden Day.Google Scholar
Campbell, S.K. (1974). Flaws and fallacies in statistical thinking. Englewood Cliffs, N.J.: Prentice-Hall.Google Scholar
De Prospero, A., & Cohen, S. (1979). Inconsistent visual analyses of intrasubject data. Journal of Applied Behavior Analysis, 12, 573579.CrossRefGoogle Scholar
Glass, G.V., Willson, V.L., & Gottman, J.M. (1975). Design and analysis of time-series experiments. Boulder, Colorado: Colorado Associated Univeristy Press.Google Scholar
Gottman, J.M. (1981). Time-series analysis. London: Cambridge University Press.Google Scholar
Gottman, J.M. & Glass, G.V. (1978). Analysis of interrupted time-series experiments. In Kratochwill, T.R. (Ed.) Single subject research: Strategies for evaluating change, (pp. 197236). New York: Academic Press.Google Scholar
Hartmann, D.P.Gottman, J.M., Jones, R.R., Gardner, W., Kazdin, A.E., & Vaught, R.S. (1980). Interrupted time-series analysis and its application to behavioral data. Journal of Applied Behavior Analysis, 13, 543559.CrossRefGoogle ScholarPubMed
Jones, R.R., Vaught, R.S., & Weinrott, M. (1977). Time-series analysis in operant research. Journal of Applied Behavior Analysis, 10, 151166.CrossRefGoogle ScholarPubMed
Jones, R.R., Weinrott, M., & Vaught, R.S. (1978). Effects of serial dependency on the agreement between visual and statistical inference. Journal of Applied Behavior Analysis, 11, 277283.CrossRefGoogle ScholarPubMed
Kazdin, A.E. (1984). Statistical analyses for single-case experimental designs. In Barlow, D.H. & Hersen, M. (Eds.) Single case experimental designs, (pp.285324). New York: Pergamon.Google Scholar
McCain, L.J. & McCleary, R. (1979). The statistical analysis of the simple interrupted time-series quasi-experiment. In Cook, T. D. & Campbell, D.T. (Eds.), Quasiexperimentation: design and analysis issues for field settings (pp.233294). Chicago: Rand McNally College Publishing Co.Google Scholar
Mohr, C., & Sharpley, C.F. (1985). Elimination of self-injurious behaviour in an autistic child by use of overcorrection. Behaviour Change, 2, 143147.CrossRefGoogle Scholar
Parsonson, B.S., & Baer, D.M. (1978). The analysis and presentation of graphic data. In Kratochwill, T.R. (Ed.) Single subject research: strategies for evaluating change, (pp. 101166). New York: Academic Press.CrossRefGoogle Scholar
Sharpley, C.F. (1981). Time-series analysis of counseling research. Measurement and Evaluation in Guidance, 3, 149157.CrossRefGoogle Scholar
White, O.R. (1971). Pragmatic approaches to progress in the single case. Doctoral dissertation, University of Oregon, University Microfilms No. 72-8618, Ann Arbor, Michigan.Google Scholar