Hostname: page-component-78c5997874-g7gxr Total loading time: 0 Render date: 2024-11-14T23:38:48.259Z Has data issue: false hasContentIssue false
  • English
  • Français

An analysis of psychotherapy versus placebo studies

Published online by Cambridge University Press:  04 February 2010

Leslie Prioleau ,
Martha Murdock  and
Nathan Brody
Leslie Prioleau
Affiliation:
Department of Psychology, Wesleyan University, Middletown, Conn., 06457
Martha Murdock
Affiliation:
Department of Psychology, Wesleyan University, Middletown, Conn., 06457
Nathan Brody
Affiliation:
Department of Psychology, Wesleyan University, Middletown, Conn., 06457
Get access Rights & Permissions [Opens in a new window]

Abstract

Smith, Glass, and Miller (1980) have reported a meta-analysis of over 500 studies comparing some form of psychological therapy with a control condition. They report that when averaged over all dependent measures of outcome, psychological therapy is. 85 standard deviations better than the control treatment. We examined the subset of studies included in the Smith et al. metaanalysis that contained a psychotherapy and a placebo treatment. The median of the mean effect sizes for these 32 studies was. 15. There was a nonsignificant inverse relationship between mean outcome and the following: sample size, duration of therapy, use of measures of outcome other than undisguised self-report, measurement of outcome at follow-up, and use of real patients rather than subjects solicited for the purposes of participation in a research study. A qualitative analysis of the studies in terms of the type of patient involved indicates that those using psychiatric outpatients had essentially zero effect sizes and that none using psychiatric inpaticnts provide convincing evidence for psychotherapeutic effectiveness. The onty studies clearly demonstrating significant effects of psychotherapy were the ones that did not use real patients. For the most part, these studies involved small samples of subjects and brief treatments, occasionally described in quasibeliavioristic language. It was concluded that for real patients there is no evidence that the benefits of psychotherapy are greater than those of placebo treatment.

Keywords

mcta-analysismethodologyoutcome researchplacebopsychotherapy
Type
Target Article
Information
Behavioral and Brain Sciences , Volume 6 , Issue 2 , June 1983 , pp. 275 - 285
Copyright
Copyright © Cambridge University Press 1983

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Alper, T. B. & Kranzler, C. D. (1970) A comparison of the effectiveness of behavioral and client-centered approaches for the behavior problems of elementary school children. Elementary School Guidance and Counseling 5:35–43. [taLP]Google Scholar
Andrews, G., Guitar, B. & Howie, p. (1980) Meta-analysis of the effects of stuttering treatment. Journal of Speech and Hearing Disorders 45:287–307. [CA]Google Scholar
Andrews, G. & Harvey, R. (1981 a) Does psychotherapy benefit neurotic patients? A reanalysis of the Smith, Glass, and Miller data. Archives of General Psychiatry 38:1203–8. [CA, NBr, RPC]CrossRefGoogle Scholar
Andrews, G. (1981 b) Regression to the mean in pretreatment measures of stuttering severity. journal of Speech and Hearing Disorders 46:204–7. [GA]CrossRefGoogle Scholar
Andrews, G., MacMahon, S. W., Austin, A. & Byrne, D. B. (1982) Hypertension: A comparison of drug and nondrug treatments. British Medical Journal 284: 1523–26. [GA]CrossRefGoogle Scholar
Baer, D. M. & Stolz, S. B. (1978) A descriptioms of the Erhard seminars training (est) in the terms of behavior analysis. Behaciorisin 6: 45–70. [JDF]Google Scholar
Bandura, A. (1977) Self-efficacy: Toward a unifying theory of behavioral change. Psychological Reciew 84: 191–215. [E E]Google Scholar
Bandura, A. (1978). The self system in reciprocal determinism. American Psychologist 33: 344–58. [EE]CrossRefGoogle Scholar
Barber, T. X. (1969) Hypnosis: A scientific approach. Van Nostrand- Reinhold. [JMF]Google Scholar
Barber, T. X., Spanos, N. P. & Chaves, J. F. (1974) Hypnotism: Imagination and hutnan potentialities. Pergamon. [JMF]Google Scholar
Bergin, A. E. & Lainbert, M. J. (1978) The evaluation of therapeutic outcomes. In: Handbook of psychotherapy and behavior change: An empirical analysis, ed. Garfield, S. L. & Bergin, A. E., pp. 139–89. Wiley. [taLP, TLR]Google Scholar
Bootzin, R. R. & Lick, J. R. (1979) Expectancies in therapy research: Interpretive artifact or mediating mechanism? Journal of Consulting and Clinical Psychology 47:852–55. [DSC]CrossRefGoogle ScholarPubMed
Brill, N. Q., Koegler, R. R., Epstein, L. J. & Forgy, E. W. (1964) Controlled study of psychiatric outpatient treatment. Archives of General Psychiatry 10:581–95. [CA, RPC. tarLP]CrossRefGoogle ScholarPubMed
Brody, N. (1983) Human motivation: Commentary on goal-directed action. New York: Academic Press. [rNB]Google Scholar
Bruce, J. (1971) The effects of group counseling on selected vocational rehabilitation clients. Ph.D. dissertation, Florida State University. [taLP]Google Scholar
Bruyere, D. H. (1975) The effects of client centered and behavioral group counseling on classroom behavior and self concept of junior high school students who exhibited disruptive classroom behavior. Ph.D. dissertation, University of Oregon. [DSC, taLP]Google Scholar
Catanese, R. A., Rosenthal, T. L. & Kelley, J. E. (1978) Strange bedfellows: Reward, punishment, and impersonal distraction strategies in treating dysphoria. Cognitive Therapy and Research 3:229–305. [TLH]Google Scholar
Cattell, R. B. & Kline, P. (1977) The scientific analysis of personality and motivation. Academic Press. [PK]Google Scholar
Chertok, L. N. & Fontaine, M. (1963) Psychosomatics in Veterinary Medicine. Journal of Psychosomatic Research 7:229–35. [TAS]CrossRefGoogle ScholarPubMed
Coche, E. & Douglas, A. A. (1977) Therapeutic effects of problem-solving training and play-reading groups.journal of Clinical Psychology 33:820–27. [GVG, taLP]3.0.CO;2-2>CrossRefGoogle ScholarPubMed
Coche, E. & Flick, A. (1975) Problem-solving training groups for hospitalized patients. journal of Psychology 91:19–29. [GVG, taLP]Google Scholar
Cohen, J. (1969) Statistical power analysis for the behavioral sciences. Academic Press. [taLP]Google Scholar
Coinas-Diáz, L. (1981) Effects of cognitive and behavioral group treatment on the depressive syinptomatology of Puerto Rican women. journal of Consulting and Clinical Psychology 49:627–32. [GVG, tarLP]Google Scholar
Conley, J. J. (1982) Longitudinal consistency of adult personality: Neuroticismn and social introversion-extroversion over forty-five years. Unpublished manuscript, Wesleyan University, Department of Psychology. [rNB]Google Scholar
Cook, T. D. & Leviton, L. C. (1980) Reviewing the literature: A comparison of traditional methods with meta-analysis. Journal of Personality 48:449–72. [DAS]CrossRefGoogle Scholar
Cordray, D. S. & Orwin, R. C. (1983) Facilitating the quality of research: Interconnections among primary research, secondary analysis aisd quantitative syisthesis. In: Evaluation studies reeiew annual, ed. Light, R.. Sage Publications (in press). [DSC]Google Scholar
Desrats, R. G. (1975) The effects of developmental and modeling group counseling on adolescents in childcare institutionsM. Ph.D. dissertation, Lehigh University. [taLP]Google Scholar
DiLoreto, A. O. (1971) Comparative psychology. Aldine-Atherton. [JDF, taLP, DAS]Google Scholar
Dohrenwend, B. P., Oksenberg, L., Shrout, P. E., Dohrenwemid, B. S. &Cook, D. (1982) what brief psychiatric screening scales measure. In:Proceedings of the Third Biennial Conference on health Survey Research Methods, May, 1979, ed. Suclman, S.. National Center for Health Services Statistics, in press. [JDF]Google Scholar
Duncan, J. W. & Laird, J. D. (1980) Positive and reverse placebo effects as a function of differences in cues used in self-perception. journal of Personality and Social Psychology 39:1024–36. [taLP]Google Scholar
Durlac, J. A. (1979) Comparative effectiveness of paraprofessional and professional helpers. Psychological Bulletin 86:80–92. [tarLP]Google Scholar
Bandura, A.(1952) The effects of Psyclsotherapy: An evaluation. journal of Consulting Psychology 16:319–24. [HJE, taLP]Google Scholar
Bandura, A. (1966) The effects of psychotherapy. International Science Press. [taLP, DAS]Google Scholar
Bandura, A.(1978) An exercise in mega-silliness. American Psychologist 33:517. [taLP]Google Scholar
(in press a) Meta-analysis. An abuse of research integration. Journal of Special Education. [HJE]Google Scholar
(in press b) Special review: The benefits of psychotherapy. A battlefield revisited. Behaviour Research and Therapy. [rNB. HJE]Google Scholar
Fish, J. M. (1973) Placebo therapy. Jossey-Bass. [JMF]Google Scholar
Fisher, S. & Creenberg, R. P. (1977) The scientific credibility of Freud's theories and therapy. Basic Books. [BPC]Google Scholar
Foster, J. C. (1971) Enquiry into the practice and effects of scientology. H.M.S.O. [MS]Google Scholar
Frank, J. D. (1973) Persuasion and healing: A comparatice study of psychotherapy. Rev. ed. Johns Hopkins Press. [JMF]Google Scholar
Frank, J. D. (1974) Therapeutic components of psychotherapy. journal of Nervous and Mental Disease 159:325–42. [MNE]Google Scholar
Frank, J. D. (1978) Expectation and therapeutic outcome – the placebo effect and the role induction interview. In: Effective ingredients of successful psychotherapy, ed Frank, J. D., Hoehn-Saric, H., Imber, S. D.Liberman, B. L. & Stone, A. R., pp. 1–34. Brunner/Mazel. [JDF]Google Scholar
Garfield, S. L. (1980) Psychotherapy: A 40-year appraisal. American Psychologist 36:174–83. [SLC]Google Scholar
(in press) The effectiveness of psychotherapy: TIse perennial controversy. Professional Psychology. [S LC]Google Scholar
Gillan, P. & Rachman, S. (1974) An experimental investigation of desensitization and phobic patients. British journal of Psychology 124:392–401. [CA, EE, SLC, tarLP, TLR]Google Scholar
Gist, R. & Stolz, S. B. (1982) Mental health promotion and the media: Community response to the Kansas City hotel disaster. American Psychologist 37:1136–39. [BM]CrossRefGoogle Scholar
Class, C. V. & Kliegl, B. M. (1982) An apology for research integration in the study of psychotherapy. journal of Consulting and Clinical Psychology 50 (in press). [GVG]Google Scholar
Grande, L. M. (1975) A comparison of rational-emotive therapy, attention placebo and no-treatment groups in the reduction of interpersonal anxiety. Ph.D. dissertation, Arizona State University. [JDF, taLP, TLH]Google Scholar
Greenberg, R. P. & Staller, J. (1981) On personal therapy for therapists. American Journal of Psychiatry 138:1467–71. [RPG]Google Scholar
Grünbaum, A. (1981) The placebo concept. Behauior Research and Therapy 19:157–67. [MNE, tarLP]Google Scholar
Haley, J. (1977) Uncomnwn therapy: The psychiatric techniques of Milton II. Erickson. Norton. [taLP]Google Scholar
Hedges, L. V. (1981) Distribution theory for Class's estimator of effect size and related estimators.journal of Educational Statistics 6:107–28. [LVH, taLP, RH]CrossRefGoogle Scholar
Hedges, L. V. (1982 a) Estimation of effect size from a series of independent experiments. Psychological Bulletin 92:490–99. [LVH, RB]Google Scholar
Hedges, L. V. (1982 b) Fitting categorical models to effect sizes from a series of experiments.journal of Educational Statistics 7:119–37. [LVH]Google Scholar
Hedquist, F. S. & Weimshold, B. K. (1970) Behavioral group counseling with socially anxious and unassertive college students.journal of Counseling Psychology 17:237–42. [taLP]Google Scholar
Herman, B. (1972) An investigation to determine the relationship of anxiety and reading disability and to study the effects of group anti individual counseling on reading improvement. Ph.D. dissertation, University of New Mexico. [taLP]Google Scholar
Hogan, D. (1980) The regulation of psychotherapists, vol. 1. Ballinger. [MS]Google Scholar
Hogan, H. A. & Kirchner, J. H. (1968) Implosive, eclectic, verbal and bibliotherapies in the treatment of fears of snakes. Behaeior Research and Therapy 6:167–71. [taLP]Google Scholar
House, R.M. (1970) The effects of nondirective group play therapy upon the sociometric status and self-concept of selected second grade children. Ph.D. dissertation, Oregon State University. [LVH, taLP]Google Scholar
Janov, A. (1970) Pri owl therapy: The cure for neurosis. Putnam. [JDF]Google Scholar
Jarinon, D. D. (1972) Differential effectiveness of rational-emotive therapy, bibliotherapy and attention–placebo in the treatment of speech anxiety. Ph.D. dissertation. Southern Illinois University. [SLG, taLP]Google Scholar
Jong, K. (1977) Hotc to sace your own life. Secker & Warburg. [GA]Google Scholar
Kahiwmamm, D., Slovic, P. & Tversky, A. (1982) Judgment under uncertainty: heuristics and biases. Cambridge University Press. [rNB]Google Scholar
Kandel, E. R. (1979) Psychotherapy and the single synapse: The impact of chiatric thought on neurobiologic research. New England Journal of Medicine 301:1028–37. [DF]Google Scholar
Kazdin, A. E. (1980) Research design in clinical psychology. Harper & How. [AEK, GTW]Google Scholar
Kazdin, A. E. & Wilson, G. T. (1978) Ecaluation of behacior therapy: Issues, eridence and research strategies. Ballinger. [GTW]Google Scholar
Kazrin, A., Durac, J. & Agteros, T. (1979) Meta-analysis: a new method for evaluating therapy outcome. Behariour Research and Therapy 17:397–99. [GA]Google Scholar
Kiesler, D. J. (1966) Some myths of psychotherapy research and time search for a paradigm. Psychological Bulletiu 65:110–36. [PK, GTW]CrossRefGoogle Scholar
Kirsch, I. & Henry, D. (1977) Extinction versus credibility in the desensitization of test anxiety. Journal of Consulting and Clinical Psychology 45:1052–59. [TLR]CrossRefGoogle Scholar
Klein, D. F. (1981) Auxiety miscouceistualized. In: Anxiety, new research and changing concepts, ed. Klein, D. F. & Rabkin, J. C., pp. 235–63. Raven Press. [JDF]Google Scholar
Kline, P. (1981) Fact and fantasy in Freudian theroy. 2nd cc1. Metlmsien. [PK]Google Scholar
Landnsau, J. T. & Dawes, R. M. (1982) Psychotherapy outcome: Smith and Glass' conclusions stand up under scrutiny. American Psychologist 37:504–16. [CA, RPC, SLC. taLP, RB]Google Scholar
Lester, B. G. (1973) A comparison of relationship counseling and relationship counseling combined with modified systematic desensitization in reducing test anxiety in middle school pupils. Ph.D. dissertation, University of Virginia. [taLP]Google Scholar
Lick, J. B. & Bootzin, R. R. (1975) Expectancy factors in the treatment of fear: Methodological ansi theoretical issues. Psychological Bulletin 82:917–31. [DSC]Google Scholar
London, P. & Klerman, C. L. (1982) Evaluating psychotherapy. American Journal ef Psychiatry 139:709–17. [BM]Google Scholar
Lorr, M, McNair, D. M. & Weinstein, G. J. (1963) Early effects of chlordiazepoxide' (Librium) used with psychotherapy. Journal of Psychiatric Research 1:257–70. [GA, NINE, RPG, taLP]CrossRefGoogle ScholarPubMed
Luborsky, L., Chandler, M., Auerbach, A. H., Cohen, J. & Bachraclm, H. M.Factors influencing the outcome of psychotherapy: A review of quantitative research. Psychological Bulletin 75:145–85. [ RPG]Google Scholar
Luborsky, L., Nliittz, J., Aucrbacls, A., Christoph, P., Bachrach, H., Todd, T., Johnson, M., Cohen, M. & O'Brien, C. (1980) Predicting the outcome of psychotherapy: Findings of the Penn psychotherapy project. Archiites of General Psychiatry 37:471–81. [ H D]Google Scholar
Lykken, D. T. (1982) Research with tsvins: The concept of emergenesis. Psychophysiology 19:361–373. [rNB]Google Scholar
Maher, B. A. (1981) Mandatory insurance coverage for psychotherapy: A tax on the subscriber and a subsidy to the practitioner. Clinical Psychologist 1:9–12. [BM]Google Scholar
Malan, D. (1959) On assessing the results in psychotherapy. British journal of Medical Psychology 32:86–105. [PK]Google Scholar
Marks, J. (1981) Behavioral treatment and drugs in anxiety symptoms. In:Anxiety, new research and changing concepts, ed. Klein, D. F. & Habkin, J. C., pp. 265–89. Haven Press. [JDF]Google Scholar
Matthews, D. B. (1972) The effects of reality therapy on reported self- concept, social adjustment, reading achievement, and discipline of fourth and fifth grades in two elementary schools. Pim. D. dissertation, University of Sommthermm California. [taLP]Google Scholar
MlcClynn, F. D., Kinjo, K. & Doherty, C. (1978) Effects of cue-controlled relaxation, a placebo treatment, and no treatment on changes in self– reporte'cl test anxiety among college students. Journal of Clinical Psychology 34:707–14. [TLH]Google Scholar
McLean, P. D. & Hakstian, A. H. (1979) Clinical depression: Comparative eflIcacv of outpcmtie-nt treatments. Journal of Consulting and Clinical Psychology 47:818–36. [GA, rNB, NINE, GVG, taLP]Google Scholar
Mechl, P. K. (1955) Psychotherapy. Annual Reciew of Psychology 6:357–79, [taLP]Google Scholar
Meichenbaum, D. H., Gilmore, J. B. & Fecloraviciotis, . (1972) Group insight versus group desensitization in treating speech anxiety. In: Psychotherapy 1971, ed. Matarazzo, J. D.. pp. 513–23. Aldine-Atherton. [JDF, taLP]Google Scholar
Meltzoff, J. & Kornreich, M. (1970) Research in psychotherapy. AlelineAtherton. [SLG, taLP]Google Scholar
Milgram, S. (1974) Obedience to authority. Harper and How. [rNB]Google Scholar
Miller, J. (1978) The body in question. Random House. [TAS]Google Scholar
Morgan, R., Luborsky, L., Crits-Christoph, P., Curtis, H. & Solomon, J. (1982) Predicting the outcomes of psychotherapy by the Penn helping alliance rating method. Archiees of General Psychiatry 39:397–402. [HD]Google Scholar
Mommntcastle, V. B. (1975) The view from within: Pathways to the study of perception. Johns hopkins Medical journal 136:109–31. [J DF]Google Scholar
Mtmrdock, M. N. (1982) A meta-analysis of psychotherapy outcome research: “Sentence first – verdict afterwards?” Honors thesis, Wesleyan University. [taLP]Google Scholar
Nisbett, R. E. & Wilson, T. DeC. (1977) Telling more than we cats know: Verbal reports on mental processes. Psychological Reciew 84:231–259. [rNB]Google Scholar
Orlov, L. (1972) An experimental stmmdy of the effects of group coummseling with behavior problem children at time elemeistary school level. Ph. D. dissertatiomm, The Catholic Ummiversity of America. [taLP]Google Scholar
Parloff, M. B. (1979) Camm psychotherapy research guide time policyimmaker? American Psychologist 34:296–306. [MS]Google Scholar
Parloff, M. B. (1980) Psychotherapy and research: Aim ammaclitic depression. Psychiatry 43:279–93. [JDF]Google Scholar
Parloff, M. B. (1982) Psychotherapy research evidence and reimnbmmrsememmt decisions: Bambi meets Coelzilla. American Jon rnal of Psychiatry 139:718–27. [BM]Google Scholar
Parloff, M. B., Waskow, l. E. & Wolfe, B. E. (1978) Research on therapist variables imm relation to process amid outcome. In: Hlandbook of psychotherapy and behaeior change, ed. Garfield, S. L. & Bergin, A. E., pp. 233–82. Wiley. [HPG]Google Scholar
Paul, G. L. (1964) Effects of insight, desensitization and attention–placebo treatment of anxiety: An approach to outcome research in psychotherapy. Ph.D. dissertation, University of Illinois. [GA, taLP, DPS, GTW]Google Scholar
Paul, C. (1969) Outcome of systematic desensitization. II Controlled investigations of individual treatment, technique variations and current status. In: Behaeior therapy: Appraisal amid status, ed. Frammks, C. M.. McGraw-Hill. [EE]Google Scholar
Paykel, E., DiMascio, A., Haskell, D. & Prusoff, B. (1975) Effects of maintenance amitriptytimme and psychotlmerapy 0n symptoms of depression. Psychological Medicine 5:67–77. [GA, taLP]Google Scholar
Platt, J. M. (1970) Efficacy of time Adlerian model imm elememmtary school counselimmg. Ph.D. dissertatiomm, University of Arizona. [taLP, LVH]Google Scholar
Presby, S. (1978) Overly broad categories obscure importammt differences. Americamm Psychologist 33:514–15. [LVH]Google Scholar
Prioleau, L. A. (1982) A meta-analysis of psychotherapy outcome research: “Sentence first – verdict afterwards?” Master's thesis, Wesleyamm University. [taLP]Google Scholar
Quality Assurance Project. (1982) A treatmnemmt outline for agoraphobia. Australian and New Zealand Journal of Psychiatry 16:25–33. [GA]Google Scholar
Rachman, S. & Wilsoim, G. T. (1980). The effects of psychological therapy. Pergamon Press. [rNB, EE, HJE, SLG, GTW]Google Scholar
Rehm, L. P. & Marston, A. H. (1968) Reduction of social anxiety timrough modification of self-reinforcememmt: An investigation timerapy techniciue. Journal of Consulting and Clinical Psychology 32:5. [taLP]CrossRefGoogle Scholar
Roessler, B., Cook, D. & Lillard, D. (1977) Effects of systematic and group counseling on work adjustmemmt clients.journal of Consulting Psychology 24:313–17. [LVH, taLP]Google Scholar
Rosen, D. (1977) A primal primer for psychotherapists. American Journal of Psychiatry 134:445–46. [JDF]Google Scholar
Rosenthal, R. (1978) Combining results of independent studies. Psychological Bulletin 85:185–93. [RR]Google Scholar
Rosenthal, R. (1983) Assessing tlse statistical smmd social importance of the effects of psychotherapy. journal of Consulting and Clinical Psychology 51:4–13. [RR]Google Scholar
Rosenthal, R. & Rubin, D. B. (1978) Interpersonal expectancy efficts: The first 345 studies. Behavioral and Brain Sciences 3:377–415. [RR]Google Scholar
Rosenthal, R. (1982a) Comparing effect sizes of independemmt studies. Psychological Bulletin 92:500–4. [LVH, RR]Google Scholar
Rosenthal, R. (1982b) Further meta-analytic procedures for assessing cognitive gemseler differences. Journal of Educational Psychology 74:708–12. [RR]Google Scholar
Rosenthal, R. (1982c) A simple, general purpose display of magnitude of experimental effect. Journal of Educational Psychology 74:166–69. [RR]Google Scholar
Rosenthal, T. L. (1980) Social cueimmg processes. In: Progress in behaeior modification, vol. 10, ed. Hersen, M., Eisler, H. M. & Miller, P. M., pp. 111–46. Academic Press. [TLR]Google Scholar
Rosentover, I. (1974) Group counseling of the underachieving high school student as related to self-image and academic success. Ph.D. dissertation, Rutgers University. [taLP]Google Scholar
Rush, A. J., Beck, A. T., Kovacs, M. & Hollon, S. (1977) Comparative effects of cognitive therapy and pharmacotherapy in the treatment of depressed outpatients. Cognitive Therapy and Research 1:17–37. [JDF]Google Scholar
Russell, M. A. H., Armstrong, E. & Patel, U. A. (1976) Temporal contiguity in electric aversion therapy for smoking. Behaviour Research and Therapy 14:103–23. [TLR]Google Scholar
Schwartz, J. L. & Dubitzky, M. (1967) Clinical reduction of smoking. Addictions 14:35–44. [taLP]Google Scholar
Sebeok, T. A. (1981) The play of musement. Indiana University Press. [TAS]Google Scholar
Shapiro, A. K. & Morris, L. A. (1978) Placebo effects in medical and psychological therapies. In: Handbook of psychotherapy and behavior change: An empirical analysis, ed. Garfield, S. L. & Bergin, A. E., pp. 396–410. Wiley. [taLP]Google Scholar
Shapiro, D. A. (1981) Comparative credibility of treatment rationales: Three tests of expectancy theory. British journal of Clinical Psychology 21:111–22. [DAS]Google Scholar
Shapiro, D. A. & Shapiro, D. (1981) Meta-analysis of comparative therapy outcome studies. MRC/SSRC Social and Applied Psychology Memo No. 438, Department of Psychology, University of Sheffield. [GA]Google Scholar
Shapiro, D. A. (1982a) Mesa-analysis of comparative therapy outcome research: A critical appraisal. Behavioural Psychotherapy 10:4–25. [PK, DAS]Google Scholar
Shapiro, D. A. (1982d) Meta-analysis of comparative therapy outcome research: A reply to Wilson. Behavioural Psychotherapy 10:307–10. [PK]Google Scholar
Shapiro, D. A. (1982c) Meta-analysis of comparative therapy outcome studies: A replication and refinement. Psychological Bulletin 92:581–604. [rNB, DAS]Google Scholar
Shapiro, D. A. (1982b) Comparative therapy outcome research: Methodological implications of meta-aisalysis. journal of Consulting and Clinical Psychology, in press. [DAS]Google Scholar
(in press) Meta-analysis of comparative therapy outcome studies: A replicatiois and refinement. Psychological Bulletin. [SLG]Google Scholar
Shapiro, S. B. & Knapp, D. M. (1971) The effect of ego therapy on personality integration. Psychotherapy: Theory, Research and Practice 8:208–12. [taLP]CrossRefGoogle Scholar
Shepherd, M. (1979) Psychoanalysis, psychotherapy, and health services. British Medical journal 2:1557–59. [MS]Google Scholar
Shepherd, M. (1980) The statutory registration of psychotherapists? Bulletin of the Royal College of Psychiatrists 11, pp. 166–69. [MS]CrossRefGoogle Scholar
Sloane, R. B., Staples, F. R., Cristol, A. H., Yorkston, N. J. & Whipple, K. (1970) Psychotherapy versus behavior therapy. Harvard University Press. [EE, JDF, tarLP]Google Scholar
Smith, M. L. & Glass, G. V. (1977) Meta-analysis of psychotherapy outcome studies. American Psychologist 32:752–60. [SLC, AEK]Google Scholar
Smith, M. L., Glass, G. V. & Miller, T. I. (1980) The benefits of psychotherapy. Johns Hopkins University Press. [GA, rNB, DSC, HD, HJE, MNE, JDF, GVC, RPC, SLG, AEK, PK, BM, trLP, RR, TLR, DAS, CTW]Google Scholar
Strahan, R. F. (1978) Six ways of looking at an elephant. American Psychologist 33:693. [taLP]Google Scholar
Strube, M. J. & Hartmann, D. P. (1982) A critical appraisal of meta-analysis. British journal of Clinical Psychology 21:129–39. [DAS]Google Scholar
Strupp, H. (1973) Psychotherapy: Clinical research and theoretical issues. Aronson. [taLP]Google Scholar
Strupp, H. (1977) Psychotherapy for better or worse. The problem of negative effects. Aronson. [taLP]Google Scholar
Strupp, H. H. & Hadley, S. W. (1979) Specific vs. nonspecific factors in psychotherapy. Archives of General Psychiatry 36:1125–36. [rNB, GTW]Google Scholar
Time (1979) Psychiatry on the couch. 2 04, p. 74. [MS]Google Scholar
Trexler, L. D. & Karst, T. O. (1972) Rational-emotive therapy, placebo, and no-treatment effects on public-speaking anxiety. Journal of Abnormal Psychology 79:60–67. [JDF, taLP]Google Scholar
Vanden, Bos G. & Pino, C. (1980) Research on the outcome of psychotherapy. In: Psychotherapy: Practice, research, policy, ed. Bos, G. Vanden. Sage Publications. [EE]Google Scholar
Warner, H. (1969) An investigation of the effectiveness of verbal reinforcement and model reinforcement counseling on alienated high school students. Ph.D. dissertation, State University of New York – Buffalo. [DSC, taLP]Google Scholar
Weissman, M. M., Klerman, G. O., Prusoff, B. A. et al. (1981) Depressed outpatients. Archives of General Psychiatry 38:51–55. [GA, rNB]Google Scholar
Weissman, M. M., Prusoff, B. A., DiMascio, A. et al. (1979) The efficacy of drugs and psychotherapy in the treatment of acute depressive episodes. American Journal of Psychiatry 136:555–58. [GA, rNB]Google Scholar
West, W. B. (1969) An investigation of the significance of client-centered play therapy as a counseling technique. Ph.D. dissertation, North Texas State University. [taLP, DPS]Google Scholar
Wilson, G. T. (1982) How useful is meta-analysis in evaluating the effects of different psychological therapies? Behavioural Psychotherapy 10:221–31. [PK, DAS]Google Scholar
Wilson, G. T. & Rachman, S. (1982) Meta-analysis and the evaluation of psychotherapy outcome: Limitations and liabilities. journal of Consulting and Clinical Psychology, in press. [GTW]Google Scholar
Winkler, R. C., Teigland, J. J., Munger, P. F. & Kranzler, G. D. (1965) The effects of selected counseling and remedial techniques on underachieving elementary school students. journal of Counseling Psychology 12:384. [taLP]Google Scholar
Zeiss, A. M., Lewinsohn, P. N. & Munoz, R. F. (1979) Nonspecific improvement effects in depression using interpersonal skill training, pleasant activity schedules, or cognitive training. journal of Consulting and Clinical Psychology 47:427–39. [TLR]Google Scholar