Agreement between face-to-face and telephone-administered versions of the depression section of the NIMH diagnostic interview schedule

doi:10.1016/0022-3956(88)90006-4

Journal of Psychiatric Research

Volume 22, Issue 3, 1988, Pages 207-220

https://doi.org/10.1016/0022-3956(88)90006-4 Get rights and content

Abstract

To increase the feasibility of identifying persons with depressive disorders in a large-scale health policy study, we tested the concordance between face-to-face and telephone-administered versions of the depression section of the NIMH Diagnostic Interview Schedule (DIS). This section was administered over the telephone to 230 English-speaking participants of the Los Angeles site of the NIMH Epidemiologic Catchment Area Program (ECA) after their completion of a face-to-face interview (Wave II) with the full DIS. Time lag between interviews was 3 months, on the average. Persons with depressive symptoms were oversampled. Using the face-to-face version as the criterion measure, the sensitivity, specificity, and positive predictive value of the telephone version for identifying the presence or absence of any lifetime unipolar depressive disorder were 71, 89, and 63 percent, respectively; the kappa statistic was 0.57, and agreement was unbiased. The comparable figures for concordance between two face-to-face interviews administered one year apart to the same subjects were 54, 89, and 60 percent and 0.45 (kappa), respectively. Thus, disagreement was due primarily to test-retest unreliability of the DIS rather than the method of administration.

References (29)

C. Alfred et al.
Telephone surveys in public health research
Med. Care.
(1986)
C.S. Aneshensel et al.
Tests for the comparability of a casual model of depression under two conditions of interviewing
J. Personal. Soc. Psychol.
(1985)
C. Aneshensel et al.
Measuring depression in the community: a comparison of telephone and personal interviews
Pub. Opinion Q.
(1982)
C. Aneshensel et al.
Telephone versus in-person surveys of community health status
Am. J. Pub. Hlth
(1982)
J.C. Anthony et al.
Comparison of the lay diagnostic interview schedule and a standardized psychiatric diagnosis: experience in eastern Baltimore
Archs gen. Psychiat.
(1985)
J. Colombotos
Personal versus telephone interviews: effect on responses
Pub. Hlth Rep.
(1969)
J. Endicott et al.
A diagnostic interview—the schedule for affective disorders and schizophrenia
Archs gen. Psychiat.
(1978)
J.L. Fleiss
Statistical Methods for Rates and Proportions
J.H. Greist et al.
Psychiatric diagnosis: what role for the computer?
Hosp. Com. Psychiat.
(1984)
J.H. Greist et al.
Psychiatric diagnosis: what role for the computer?
Hosp. Com. Psychiat.
(1984)

J.E. Helzer et al.

A comparison of clinical and diagnostic interview schedule diagnoses—physician reexamination of lay-interviewed cases in the general population

Archs gen. Psychiat.

(1985)

R. Henson et al.

Personal versus telephone interviews: the effects of telephone reinterviews on reporting of psychiatric symptomatology

Also in DHEW Publication No. (HRA) 78-3204, pp. 205–212. Survey Research Center, University of Michigan, Ann...

J.R. Hochstim

A critical comparison of the strategies of collecting data from households

J. Am. Statist. Ass.

(1967)

Cited by (216)

Comparison of four brief depression screening instruments in ovarian cancer patients: Diagnostic accuracy using traditional versus alternative cutpoints
2017, Gynecologic Oncology
We compared the diagnostic accuracy of 4 depression screening scales, using traditional and alternative scoring methods, to the gold standard Structured Clinical Interview-DSM IV major depressive episode (MDE) in ovarian cancer patients on active treatment.
At the beginning of a new chemotherapy regimen, ovarian cancer patients completed the following surveys on the same day: the Center for Epidemiological Studies Depression Scale (CES-D), the Beck Depression Inventory Fast-Screen for Primary Care (BDI-FastScreen), the Patient Health Questionnaire-9 (PHQ-9), and a 1-item screener (“Are you depressed?”). Each instrument's sensitivity, specificity, positive predictive value (PPV) and negative predictive value were calculated with respect to major depression. To control for antidepressant use, the analyses were re-run for a subsample of patients who were not on antidepressants.
One hundred fifty-three ovarian cancer patients were enrolled into the study. Only fourteen participants met SCID criteria for current MDE (9%). When evaluating all patients regardless of whether they were already being treated with antidepressants, the two-phase scoring approach with an alternate cutpoint of 6 on the PHQ-9 had the best positive predictive value (PPV = 32%). Using a traditional cutpoint of 16 on the CES-D resulted in the lowest PPV (5%); using a more stringent cutpoint of 22 resulted in a slightly improved but still poor PPV, 7%.
Screening with a two-phase PHQ-9 proved best overall, and its accuracy was improved when used with patients who were not already being treated with antidepressants.
Procedural validity of the AUDADIS-5 depression, anxiety and post-traumatic stress disorder modules: Substance abusers and others in the general population
2015, Drug and Alcohol Dependence
Citation Excerpt :
Centralized PRISM-5 telephone administration facilitated efficient, cost-effective, closely-supervised interviews, but left unanswered whether concordance would be higher if administration mode were constant in the two interviews. Nevertheless, telephone vs. in-person modes appear not to influence findings (Aziz and Kenford, 2004; Kessler et al., 2009; Sobin et al., 1993; Wells et al., 1988), so discordance was likely due to other factors. Finally, other participant characteristics may impact validity, warranting future investigation.
Little is known about the procedural validity of lay-administered, fully-structured assessments of depressive, anxiety and post-traumatic stress (PTSD) disorders in the general population as determined by comparison with clinical re-appraisal, and whether this differs between current regular substance abusers and others. We evaluated the procedural validity of the Alcohol Use Disorder and Associated Disabilities Interview Schedule, DSM-5 Version (AUDADIS-5) assessment of these disorders through clinician re-interviews.
Test−retest design among respondents from the National Epidemiologic Survey on Alcohol and Related Conditions-III (NESARC-III): (264 current regular substance abusers, 447 others). Clinicians blinded to AUDADIS-5 results administered the semi-structured Psychiatric Research Interview for Substance and Mental Disorders, DSM-5 version (PRISM-5). AUDADIS-5/PRISM-5 concordance was indicated by kappa (κ) for diagnoses and intraclass correlation coefficients (ICC) for dimensional measures (DSM-5 symptom or criterion counts). Results were compared between current regular substance abusers and others.
AUDADIS-5 and PRISM-5 concordance for DSM-5 depressive disorders, anxiety disorders and PTSD was generally fair to moderate (κ = 0.24−0.59), with concordance on dimensional scales much better (ICC = 0.53−0.81). Concordance differed little between regular substance abusers and others.
AUDADIS-5/PRISM-5 concordance indicated procedural validity for the AUDADIS-5 among substance abusers and others, suggesting that AUDADIS-5 diagnoses of DSM-5 depressive, anxiety and PTSD diagnoses are informative measures in both groups in epidemiological studies. The stronger concordance on dimensional measures supports the current movement toward dimensional psychopathology measures, suggesting that such measures provide important information for research in the NESARC-III and other datasets, and possibly for clinical purposes as well.
The Alcohol Use Disorder and Associated Disabilities Interview Schedule-5 (AUDADIS-5): Procedural validity of substance use disorders modules through clinical re-appraisal in a general population sample
2015, Drug and Alcohol Dependence
Citation Excerpt :
The present study leaves unanswered whether concordance would be higher if administration mode had been constant in the two interviews. Nevertheless, telephone vs. in-person mode of administration has been shown repeatedly not to influence findings, including for alcohol harms (Midanik and Greenfield, 2003), substance use disorders (Kessler et al., 2009; Sobin et al., 1993), and other symptomatology (Aziz and Kenford, 2004; Wells et al., 1988). As such, the literature suggests that discordant cases were likely due to other factors.
The purpose of this study was to assess the procedural validity of the substance disorder modules of the lay-administered Alcohol Use Disorder and Associated Disabilities Interview Schedule, Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition (DSM-5) Version (AUDADIS-5) through clinician re-appraisal re-interviews.
The study employed a test–retest design among 712 respondents from the National Epidemiologic Survey on Alcohol and Related Conditions-III (NESARC-III). A clinician-administered, semi-structured interview, the Psychiatric Research Interview for Substance and Mental Disorders, DSM-5 version (PRISM-5) was used as the re-appraisal. Kappa coeffients indicated concordance of the AUDADIS-5 and PRISM-5 for DSM-5 substance use disorder diagnoses, while intraclass correlation coefficients (ICC) indicated concordance on dimensional scales indicating the DSM-5 criteria count for each disorder.
With few exceptions, concordance of the AUDADIS-5 and the PRISM-5 for DSM-5 diagnoses of substance use disorders ranged from fair to good (κ = 0.40–0.72). Concordance on dimensional scales was excellent (ICC ≥ 0.75) for the majority of DSM-5 SUD diagnoses, and fair to good (ICC = 0.43–0.72) for most of the rest.
As indicated by concordance with a semi-structured clinician-administered re-appraisal, the procedural validity of the AUDADIS-5 DSM-5 substance use disorder diagnoses found in this study indicates that these AUDADIS-5 diagnoses are useful tools in epidemiologic studies. The considerably stronger concordance of the AUDADIS-5 and PRISM-5 dimensional DSM-5 SUD measures supports a current movement to place more emphasis on dimensional measures of psychopathology, and suggests that such measures may be more informative than binary diagnoses for research, and possibly for clinical purposes as well.
Parenting and the parent-child relationship in families of children with mild to borderline intellectual disabilities and externalizing behavior
2015, Research in Developmental Disabilities
This cross-sectional study examined the association between parenting behavior, the parent–child relationship, and externalizing child behavior in families of children with mild to borderline intellectual disabilities (MBID). The families of a child with MBID and accompanying externalizing behavior problems (n = 113) reported more positive discipline and physical punishment but less involvement, less positive parenting, less monitoring, a lower sense of parenting competence, less acceptance of the child, and less closeness to the child than the families of a child with MBID and no accompanying externalizing behavior problems (n = 71). The parent–child relationship was most strongly associated with externalizing child behavior, over and above parenting behaviors. In addition, the parent–child relationship was found to be associated with parenting behavior, over and above the child's externalizing behavior. Our results highlight the importance of both the parent–child relationship and parenting behavior in connection with the occurrence of externalizing behavior problems on the part of children with MBID. Parenting behavior and the parent–child relationship may thus be promising targets for interventions with this group of children.
Psychopathology in bariatric surgery candidates: A review of studies using structured diagnostic interviews
2014, Comprehensive Psychiatry
Psychiatric disorders are not uncommon among severely obese patients who present for bariatric surgery. This paper (1) reviews the results of the published studies using the structured interviews to assess psychopathology in bariatric surgery candidates; (2) compares the prevalence rates of psychiatric disorders across these studies with the data from other population samples; and (3) assesses whether sociodemographic variables appear to affect these prevalence rates. We searched online resources, PubMed, PsychINFO and reference lists of all the relevant articles to provide an overview of evidence so far and highlight some details in the assessment and comparisons of different samples in different countries. The prevalence estimates in the non-treatment obese group did not appear to differ substantially from the general population group in the US or the Italian population samples, although they were relatively higher for the German population. However, the rates of psychopathology in the bariatric surgery candidates were considerably higher than the other two population groups in all the samples. Overall, the most common category of lifetime Axis I disorders in all the studies was affective disorders, with anxiety disorders being the most common category of current Axis I disorders. Certain demographic characteristics are also associated with higher rates of psychopathology, such as, female gender, low socioeconomic status, higher BMI. Overall, methodological and sociodemographic differences make these studies difficult to compare and these differences should be taken into account when interpreting the results.
Is the Children's Depression Inventory Short version a valid screening tool in pediatric care? A comparison to its full-length version
2012, Journal of Psychosomatic Research
This is the first study to validate and to compare the Children's Depression Inventory (CDI) and its short version (CDI:S) as screening tools for medically ill children.
A sample of 406 pediatric hospital patients, aged 9 to 12 years (56.2% male, 77.1% inpatients), completed the German CDI. Criterion validity of the 26-item CDI and the 10-item CDI:S was calculated by receiver operating characteristic (ROC) curves. DSM-IV diagnoses of depression based on the structured diagnostic interview for mental disorders in children and adolescents (Kinder-DIPS) served as the reference standard. Areas under the ROC curves as well as sensitivities and specificities for the optimal cutoffs were compared for both versions.
Diagnoses of major or minor depression were established for 7.4% of the children. Areas under the curve for the 26-item CDI (87.7%) and the 10-item CDI:S (88.2%) were comparable. For the CDI, the cutoff ≥ 12 yielded the best balance between sensitivity (83.3%) and specificity (82.7%). At the optimal cutoff ≥ 3, the CDI:S resulted in a high sensitivity of 93.3% and a specificity of 70.7%. Thus, the CDI:S proved to be as sensitive as the CDI, but was less specific than the full-length version.
Both the CDI and the CDI:S are valid screening instruments for depression in medically ill children. The sensitive and brief CDI:S is a promising tool in time-pressed settings such as pediatric care, but has to be followed by a thorough diagnostic assessment to rule out false positive cases.

View all citing articles on Scopus

^☆: This research was supported by grants from the Robert Wood Johnson Foundation, the Henry J. Kaiser Family Foundation, The Pew Memorial Trust, and the National Institute of Mental Health. The conclusions are those of the authors and do not necessarily represent the views of the Foundations of NIMH.

View full text

Agreement between face-to-face and telephone-administered versions of the depression section of the NIMH diagnostic interview schedule☆

Abstract

Telephone surveys in public health research

Med. Care.

Tests for the comparability of a casual model of depression under two conditions of interviewing

J. Personal. Soc. Psychol.

Measuring depression in the community: a comparison of telephone and personal interviews

Pub. Opinion Q.

Telephone versus in-person surveys of community health status

Am. J. Pub. Hlth

Comparison of the lay diagnostic interview schedule and a standardized psychiatric diagnosis: experience in eastern Baltimore

Archs gen. Psychiat.

Personal versus telephone interviews: effect on responses

Pub. Hlth Rep.

A diagnostic interview—the schedule for affective disorders and schizophrenia

Archs gen. Psychiat.

Statistical Methods for Rates and Proportions

Psychiatric diagnosis: what role for the computer?

Hosp. Com. Psychiat.

Psychiatric diagnosis: what role for the computer?

Hosp. Com. Psychiat.

A comparison of clinical and diagnostic interview schedule diagnoses—physician reexamination of lay-interviewed cases in the general population

Archs gen. Psychiat.

Personal versus telephone interviews: the effects of telephone reinterviews on reporting of psychiatric symptomatology

A critical comparison of the strategies of collecting data from households

J. Am. Statist. Ass.