Skip to main content

Main menu

  • Home
  • Current Issue
  • Content
    • Current Issue
    • Early Access
    • Multimedia
    • Podcast
    • Collections
    • Past Issues
    • Articles by Subject
    • Articles by Type
    • Supplements
    • Plain Language Summaries
    • Calls for Papers
  • Info for
    • Authors
    • Reviewers
    • Job Seekers
    • Media
  • About
    • Annals of Family Medicine
    • Editorial Staff & Boards
    • Sponsoring Organizations
    • Copyrights & Permissions
    • Announcements
  • Engage
    • Engage
    • e-Letters (Comments)
    • Subscribe
    • Podcast
    • E-mail Alerts
    • Journal Club
    • RSS
    • Annals Forum (Archive)
  • Contact
    • Contact Us
  • Careers

User menu

  • My alerts

Search

  • Advanced search
Annals of Family Medicine
  • My alerts
Annals of Family Medicine

Advanced Search

  • Home
  • Current Issue
  • Content
    • Current Issue
    • Early Access
    • Multimedia
    • Podcast
    • Collections
    • Past Issues
    • Articles by Subject
    • Articles by Type
    • Supplements
    • Plain Language Summaries
    • Calls for Papers
  • Info for
    • Authors
    • Reviewers
    • Job Seekers
    • Media
  • About
    • Annals of Family Medicine
    • Editorial Staff & Boards
    • Sponsoring Organizations
    • Copyrights & Permissions
    • Announcements
  • Engage
    • Engage
    • e-Letters (Comments)
    • Subscribe
    • Podcast
    • E-mail Alerts
    • Journal Club
    • RSS
    • Annals Forum (Archive)
  • Contact
    • Contact Us
  • Careers
  • Follow annalsfm on Twitter
  • Visit annalsfm on Facebook
Research ArticleOriginal Research

Validation of the Computerized Adaptive Test for Mental Health in Primary Care

Andrea K. Graham, Alexa Minc, Erin Staab, David G. Beiser, Robert D. Gibbons and Neda Laiteerapong
The Annals of Family Medicine January 2019, 17 (1) 23-30; DOI: https://doi.org/10.1370/afm.2316
Andrea K. Graham
1Department of Medical Social Sciences, Northwestern University, Chicago, Illinois
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Alexa Minc
2Department of Medicine, Section of General Internal Medicine, The University of Chicago, Chicago, Illinois
BA, BFA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Erin Staab
2Department of Medicine, Section of General Internal Medicine, The University of Chicago, Chicago, Illinois
MPH
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
David G. Beiser
3Department of Medicine, Section of Emergency Medicine, The University of Chicago, Chicago, Illinois
MD, MS
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Robert D. Gibbons
4Departments of Medicine, Public Health Sciences, Psychiatry, and Comparative Human Development, The University of Chicago, Chicago, Illinois
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Neda Laiteerapong
2Department of Medicine, Section of General Internal Medicine, The University of Chicago, Chicago, Illinois
MD, MS
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: nlaiteer@medicine.bsd.uchicago.edu
  • Article
  • Figures & Data
  • eLetters
  • Info & Metrics
  • PDF
Loading

Article Figures & Data

Figures

  • Tables
  • Additional Files
  • Figure 1
    • Download figure
    • Open in new tab
    • Download powerpoint
    Figure 1

    Flow of participants in the study.

  • Figure 2
    • Download figure
    • Open in new tab
    • Download powerpoint
    Figure 2

    Predicted probability of a GAD diagnosis given CAT-ANX score.

Tables

  • Figures
  • Additional Files
    • View popup
    Table 1

    Participant Sociodemographic and Clinical Characteristics

    CharacteristicTotal (N = 271)Participants With MDDa (n = 31)Participants With GADa (n = 29)
    Age, mean (SD), y57 (17)53 (12)46 (14)
    Female, No. (%)191 (71)26 (84)24 (83)
    Ethnicity, No. (%)
     Hispanic11 (4)00
     Non-Hispanic254 (94)31 (100)29 (100)
     Prefer not to answer6 (2)00
    Race, No. (%)
     Black176 (65)27 (87)19 (66)
     White73 (27)3 (10)10 (34)
     Other8 (3)00
     Prefer not to answer13 (5)1 (3)0
    Level of education, No. (%)
     College degree or higher136 (50)7 (22)11 (39)
     Some college or junior college83 (31)12 (39)8 (27)
     High school graduate/GED34 (12)8 (26)8 (27)
     Some high school (grades 9-12) or less18 (7)4 (13)2 (7)
    Household income, No. (%)
     ≥$100,00144 (16)1 (4)3 (10)
     $50,001-$100,00084 (31)6 (20)10 (35)
     $25,001-$50,00060 (22)10 (33)6 (21)
     ≤$25,00043 (16)10 (33)7 (24)
     Prefer not to answer40 (15)3 (10)3 (10)
    Self-reported medical diagnoses, No. (%)
     Depression54 (20)23 (74)17 (59)
     Anxiety39 (14)18 (58)16 (55)
     Diabetes62 (23)8 (26)7 (12)
     Heart disease42 (15)5 (16)4 (14)
     Kidney disease18 (7)3 (10)0
     Liver disease14 (5)2 (6)1 (3)
     Stroke14 (5)5 (16)4 (14)
     Chronic pain43 (16)11 (35)9 (31)
    Non-skin cancer11 (4)00
    • DSM-5 = Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition; GAD = generalized anxiety disorder; GED = general equivalency diploma; MDD = major depressive disorder.

    • ↵a Based on diagnoses generated from the Structured Clinical Interview for DSM-5 Disorders (SCID).

    • View popup
    Table 2

    Performance of the Computerized Adaptive Tests and Brief Questionnaires Relative to the Reference-Standard Clinical Interview

    MeasureTest and Value(s)
    Screening for MDDCAD-MDDPHQ-9PHQ-2
    Sensitivity0.770.750.58
    Specificity0.930.940.93
    Positive predictive value0.570.620.52
    Negative predictive value0.970.970.95
    AUC (95% CI)0.85 (0.76-0.94)a0.84 (0.75-0.94)a0.76 (0.65-0.87)a
    Assessing anxiety severityCAT-ANXGAD-7−
    AUC (95% CI)0.93 (0.90-0.97)a0.97 (0.96-0.99)a−
    OR (95% CI) for 1-point increase in score1.10 (1.07-1.13)a1.58 (1.40-1.80)a−
    OR (95% CI) for 1-category increase in severity6.37 (3.72-10.91)a11.48 (5.76-22.88)a−
    • AUC = area under the curve; CAD-MDD = Computerized Adaptive Diagnostic Test for Major Depressive Disorder; CAT-ANX = Computerized Adaptive Test–Anxiety Inventory; GAD-7 = Generalized Anxiety Disorder 7-item Scale; MDD = major depressive disorder; OR = odds ratio; PHQ-2 = 2-item Patient Health Questionnaire; PHQ-9 = 9-item Patient Health Questionnaire.

    • ↵a P <.001.

Additional Files

  • Figures
  • Tables
  • Supplemental Figures

    Supplemental Figures

    Files in this Data Supplement:

    • Supplemental data: Figures - PDF file
  • The Article in Brief

    Validation of the Computerized Adaptive Test for Mental Health in Primary Care

    Andrea K. Graham , and colleagues

    Background While screening questionnaires for depression and anxiety exist in primary care settings, electronic health tools, such as computerized adaptive tests based on item response theory, could advance screening practices. This study evaluated the validity of the Computerized Adaptive Test for Mental Health as a tool for screening for major depressive disorder and assessing severity of anxiety and major depressive disorder among adult primary care patients.

    What This Study Found Computerized adaptive testing is a valid tool for screening for major depressive disorder in primary care and offers a format that is well received by patients. The research compared computerized adaptive tests, which personalize assessments by adaptively varying questions based on previous responses, with widely used paper screening tools (Patient Health Questionnaire-9, Patient Health Questionnaire-2, and Generalized Anxiety Disorder-7), and semi-structured interview, which is generally considered the gold standard in psychiatric assessment. The diagnostic accuracy of the Computerized Adaptive Diagnostic Test for Major Depressive Disorder was similar to the PHQ-9 and higher than the PHQ-2. Compared to interview, the accuracy of the Computerized Adaptive Test/Anxiety Inventory was similar to the Generalized Anxiety Disorder-7 for assessing anxiety severity. Participants preferred using tablet computers (53 percent), compared to interview (33 percent) and paper-and-pencil questionnaires (14 percent). The majority of participants (64 percent) rated paper-and-pencil questionnaire as their least preferred screening method.

    Implications

    • The widespread use of electronic health records in primary care presents new opportunities to leverage electronic tools for screening, the authors suggest, while multidimensional item response theory, used in computerized adaptive testing, can increase the efficiency of assessing mental and physical health.
PreviousNext
Back to top

In this issue

The Annals of Family Medicine: 17 (1)
The Annals of Family Medicine: 17 (1)
Vol. 17, Issue 1
January/February 2019
  • Table of Contents
  • Index by author
  • Back Matter (PDF)
  • Front Matter (PDF)
  • In Brief
Print
Download PDF
Article Alerts
Sign In to Email Alerts with your Email Address
Email Article

Thank you for your interest in spreading the word on Annals of Family Medicine.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Validation of the Computerized Adaptive Test for Mental Health in Primary Care
(Your Name) has sent you a message from Annals of Family Medicine
(Your Name) thought you would like to see the Annals of Family Medicine web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
10 + 7 =
Solve this simple math problem and enter the result. E.g. for 1+3, enter 4.
Citation Tools
Validation of the Computerized Adaptive Test for Mental Health in Primary Care
Andrea K. Graham, Alexa Minc, Erin Staab, David G. Beiser, Robert D. Gibbons, Neda Laiteerapong
The Annals of Family Medicine Jan 2019, 17 (1) 23-30; DOI: 10.1370/afm.2316

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Get Permissions
Share
Validation of the Computerized Adaptive Test for Mental Health in Primary Care
Andrea K. Graham, Alexa Minc, Erin Staab, David G. Beiser, Robert D. Gibbons, Neda Laiteerapong
The Annals of Family Medicine Jan 2019, 17 (1) 23-30; DOI: 10.1370/afm.2316
Twitter logo Facebook logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Jump to section

  • Article
    • Abstract
    • INTRODUCTION
    • METHODS
    • RESULTS
    • DISCUSSION
    • Footnotes
    • References
  • Figures & Data
  • eLetters
  • Info & Metrics
  • PDF

Related Articles

  • PubMed
  • Google Scholar

Cited By...

  • Associations Between Negative Social Ties and Accelerated Biological Aging, Inflammation, and Multiple Morbidities
  • Expanding the screening toolbox to promote athlete health: how the US Olympic & Paralympic Committee screened for health problems in 940 elite athletes
  • Implementing PROMs in routine clinical care: a qualitative exploration of GP perspectives
  • In This Issue: Humans of Primary Care Research
  • Google Scholar

More in this TOC Section

  • Neighborhood Determinants of Primary Care Access in Virginia
  • Proactive Deprescribing Among Older Adults With Polypharmacy: Barriers and Enablers
  • Artificial Intelligence Tools for Preconception Cardiomyopathy Screening Among Women of Reproductive Age
Show more Original Research

Similar Articles

Subjects

  • Domains of illness & health:
    • Mental health
  • Person groups:
    • Vulnerable populations
  • Methods:
    • Quantitative methods
  • Other topics:
    • Health informatics

Keywords

  • screening
  • depression
  • anxiety
  • mental health
  • symptom assessment
  • surveys and questionnaires
  • health informatics
  • electronic health records
  • vulnerable populations
  • primary care
  • practice-based research

Content

  • Current Issue
  • Past Issues
  • Early Access
  • Plain-Language Summaries
  • Multimedia
  • Podcast
  • Articles by Type
  • Articles by Subject
  • Supplements
  • Calls for Papers

Info for

  • Authors
  • Reviewers
  • Job Seekers
  • Media

Engage

  • E-mail Alerts
  • e-Letters (Comments)
  • RSS
  • Journal Club
  • Submit a Manuscript
  • Subscribe
  • Family Medicine Careers

About

  • About Us
  • Editorial Board & Staff
  • Sponsoring Organizations
  • Copyrights & Permissions
  • Contact Us
  • eLetter/Comments Policy

© 2025 Annals of Family Medicine