Randomized controlled versus naturalistic studies: A new research agenda
- 1 June 2004
- journal article
- review article
- Published by Guilford Publications in Bulletin of the Menninger Clinic
- Vol. 68 (2), 137-151
- https://doi.org/10.1521/bumc.68.2.137.35952
Abstract
The present article addresses the question of what kind of evidence is required to demonstrate that a method of psychotherapy works. Referring to recent conceptualizations of the logical structure of scientific theories, that is, the structuralistic view of theories, the author shows that randomized controlled studies (RCTs) and naturalistic studies (effectiveness studies) refer to different domains of intended applications (laboratory vs. field). This view has several important implications: (1) RCTs and naturalistic studies do not differ concerning their internal and external validity; (2) naturalistic studies do not necessarily provide lower-level evidence than RCTs; (3) evidence from RCTs cannot be transferred to psychotherapeutic practice in the field; (4) naturalistic studies are required to demonstrate that a form of therapy works in the field; (5) The proposed catalogues for levels of evidence focus on RCTs; thus, they cannot be applied to the question if a therapy works in the field; (6) It is necessary to define separate criteria for levels of evidence of naturalistic studies; and (7) a new research agenda for naturalistic studies can be derived, which is analogous to that of efficacy studies. In this article, a proposal is made to define levels of evidence of naturalistic studies. A gold standard for naturalistic studies is proposed.Keywords
This publication has 29 references indexed in Scilit:
- Where oh where are the specific ingredients? A meta-analysis of component studies in counseling and psychotherapy.Journal of Counseling Psychology, 2001
- Empirically Supported Psychological Interventions: Controversies and EvidenceAnnual Review of Psychology, 2001
- Psychosocial Treatments for Cocaine Dependence: National Institute on Drug Abuse Collaborative Cocaine Treatment StudyArchives of General Psychiatry, 1999
- Group cognitive behavior therapy for depression in a community setting: A clinical replication seriesBehavior Therapy, 1998
- Transporting an empirically supported treatment for panic disorder to a service clinic setting: A benchmarking strategy.Journal of Consulting and Clinical Psychology, 1998
- The implications of psychotherapy research for clinical practice and service development: Lessons and limitationsJournal of Mental Health, 1997
- A component analysis of cognitive-behavioral treatment for depression.Journal of Consulting and Clinical Psychology, 1996
- Users' guides to the medical literature. IX. A method for grading health care recommendations. Evidence-Based Medicine Working GroupJAMA, 1995
- The effectiveness of psychotherapy: The Consumer Reports study.American Psychologist, 1995
- Abuse of the drug metaphor in psychotherapy process-outcome researchClinical Psychology Review, 1989