A New Approach to Integrating Data From Multiple Informants in Psychiatric Assessment and Research: Mixing and Matching Contexts and Perspectives
- 1 September 2003
- journal article
- Published by American Psychiatric Association Publishing in American Journal of Psychiatry
- Vol. 160 (9), 1566-1577
- https://doi.org/10.1176/appi.ajp.160.9.1566
Abstract
When there exists no single source of information (informant) to validly measure a characteristic, it is typically recommended that data from multiple informants be used. In psychiatric assessment and research, however, multiple informants often provide discordant data, which further confuse the measurement. Strategies such as arbitrarily choosing one informant or using the data from all informants separately generate further problems. This report proposes a theory to explain observed patterns of interinformant discordance and suggests a new approach to using data from multiple informants to measure characteristics of interest. Using the example of assessment of developmental psychopathology in children, the authors propose a model in which the choice of informants is based on conceptualizing the contexts and perspectives that influence expression of the characteristic of interest and then identifying informants who represent those contexts and perspectives in such a way as to have the weaknesses of one informant canceled by the strengths of another. Applications of this approach to several datasets indicate that when these principles are followed, a more reliable and valid consensus measure is obtained, and failure to obtain a reliable, valid measure is indicative of some deviation from the principles. In obtaining a consensus measure, the issue is not determining how many informants are needed but choosing the right set of informants.Keywords
This publication has 23 references indexed in Scilit:
- The Twin Inventory of Relationships and Experiences (TIRE): psychometric properties of a measure of the non-shared and shared environmental experiences of twins and singletonsInternational Journal of Methods in Psychiatric Research, 2001
- A 14-Month Randomized Clinical Trial of Treatment Strategies for Attention-Deficit/Hyperactivity DisorderArchives of General Psychiatry, 1999
- INTERVIEWS VERSUS CHECKLISTS: ADEQUACY FOR CLASSIFYING CHILDHOOD PSYCHIATRIC DISORDER BASED ON ADOLESCENT REPORTSInternational Journal of Methods in Psychiatric Research, 1996
- THE RELATIVE DIAGNOSTIC UTILITY OF CHILD AND PARENT REPORTS OF OPPOSITIONAL DEFIANT BEHAVIORSInternational Journal of Methods in Psychiatric Research, 1996
- Recent Developments in the Assessment and Diagnosis of Child PsychopathologyEuropean Journal of Psychological Assessment, 1995
- Taxonomy and comorbidity of conduct problems: Evidence from empirically based approachesDevelopment and Psychopathology, 1993
- Combining discrepant diagnostic information from multiple sources: Are complex algorithms better than simple ones?Journal of Abnormal Child Psychology, 1992
- Age Differences in the Reliability of Parent and Child Reports of Child Anxious Symptomatology Using a Structured InterviewJournal of the American Academy of Child & Adolescent Psychiatry, 1992
- Enhancing the outcomes of low-birth-weight, premature infants. A multisite, randomized trial. The Infant Health and Development ProgramJAMA, 1990
- Intuitive interactionism in person perception: Effects of situation-behavior relations on dispositional judgments.Journal of Personality and Social Psychology, 1989