Skip to main content

Main menu

  • Home
  • Current Issue
  • Content
    • Current Issue
    • Early Access
    • Multimedia
    • Podcast
    • Collections
    • Past Issues
    • Articles by Subject
    • Articles by Type
    • Supplements
    • Plain Language Summaries
    • Calls for Papers
  • Info for
    • Authors
    • Reviewers
    • Job Seekers
    • Media
  • About
    • Annals of Family Medicine
    • Editorial Staff & Boards
    • Sponsoring Organizations
    • Copyrights & Permissions
    • Announcements
  • Engage
    • Engage
    • e-Letters (Comments)
    • Subscribe
    • Podcast
    • E-mail Alerts
    • Journal Club
    • RSS
    • Annals Forum (Archive)
  • Contact
    • Contact Us
  • Careers

User menu

  • My alerts

Search

  • Advanced search
Annals of Family Medicine
  • My alerts
Annals of Family Medicine

Advanced Search

  • Home
  • Current Issue
  • Content
    • Current Issue
    • Early Access
    • Multimedia
    • Podcast
    • Collections
    • Past Issues
    • Articles by Subject
    • Articles by Type
    • Supplements
    • Plain Language Summaries
    • Calls for Papers
  • Info for
    • Authors
    • Reviewers
    • Job Seekers
    • Media
  • About
    • Annals of Family Medicine
    • Editorial Staff & Boards
    • Sponsoring Organizations
    • Copyrights & Permissions
    • Announcements
  • Engage
    • Engage
    • e-Letters (Comments)
    • Subscribe
    • Podcast
    • E-mail Alerts
    • Journal Club
    • RSS
    • Annals Forum (Archive)
  • Contact
    • Contact Us
  • Careers
  • Follow annalsfm on Twitter
  • Visit annalsfm on Facebook
Research ArticleOriginal Research

Quality, Accuracy, and Bias in ChatGPT-Based Summarization of Medical Abstracts

Joel Hake, Miles Crowley, Allison Coy, Denton Shanks, Aundria Eoff, Kalee Kirmer-Voss, Gurpreet Dhanda and Daniel J. Parente
The Annals of Family Medicine March 2024, 22 (2) 113-120; DOI: https://doi.org/10.1370/afm.3075
Joel Hake
Department of Family Medicine and Community Health, University of Kansas Medical Center, Kansas City, Kansas
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Miles Crowley
Department of Family Medicine and Community Health, University of Kansas Medical Center, Kansas City, Kansas
MD, MPH
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Allison Coy
Department of Family Medicine and Community Health, University of Kansas Medical Center, Kansas City, Kansas
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Denton Shanks
Department of Family Medicine and Community Health, University of Kansas Medical Center, Kansas City, Kansas
DO, MPH
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Aundria Eoff
Department of Family Medicine and Community Health, University of Kansas Medical Center, Kansas City, Kansas
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Kalee Kirmer-Voss
Department of Family Medicine and Community Health, University of Kansas Medical Center, Kansas City, Kansas
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Gurpreet Dhanda
Department of Family Medicine and Community Health, University of Kansas Medical Center, Kansas City, Kansas
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Daniel J. Parente
Department of Family Medicine and Community Health, University of Kansas Medical Center, Kansas City, Kansas
MD, PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: dparente@kumc.edu
  • Article
  • Figures & Data
  • eLetters
  • Info & Metrics
  • PDF
Loading

Article Information

vol. 22 no. 2 113-120
DOI 
https://doi.org/10.1370/afm.3075
PubMed 
38527823

Published By 
The Annals of Family Medicine
Print ISSN 
1544-1709
Online ISSN 
1544-1717
History 
  • Received for publication April 21, 2023
  • Revision received October 13, 2023
  • Accepted for publication November 17, 2023
  • Published online March 25, 2024.

Copyright & Usage 
© 2024 Annals of Family Medicine, Inc.

Author Information

  1. Joel Hake, MD,
  2. Miles Crowley, MD, MPH,
  3. Allison Coy, MD,
  4. Denton Shanks, DO, MPH,
  5. Aundria Eoff, MD,
  6. Kalee Kirmer-Voss, MD,
  7. Gurpreet Dhanda, MD and
  8. Daniel J. Parente, MD, PhD⇑
  1. Department of Family Medicine and Community Health, University of Kansas Medical Center, Kansas City, Kansas
  1. CORRESPONDING AUTHOR Daniel J. Parente, 3901 Rainbow Blvd, MS 4010, Kansas City, KS 66160, dparente{at}kumc.edu

Statistics from Altmetric.com

Article usage

Article usage: March 2024 to April 2025

AbstractFullPdf
Mar 20241983308305
Apr 20245971075337
May 2024393588208
Jun 20244817048
Jul 20244812249
Aug 2024388542
Sep 2024388438
Oct 2024478355
Nov 2024467734
Dec 2024385739
Jan 2025297648
Feb 20254710345
Mar 2025319987
Apr 20253120452

Cited By...

  • 15 Citations
  • Google Scholar
PreviousNext
Back to top

In this issue

The Annals of Family Medicine: 22 (2)
The Annals of Family Medicine: 22 (2)
Vol. 22, Issue 2
March/April 2024
  • Table of Contents
  • Index by author
  • Front Matter (PDF)
  • Plan-Language Summaries
Print
Download PDF
Article Alerts
Sign In to Email Alerts with your Email Address
Email Article

Thank you for your interest in spreading the word on Annals of Family Medicine.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Quality, Accuracy, and Bias in ChatGPT-Based Summarization of Medical Abstracts
(Your Name) has sent you a message from Annals of Family Medicine
(Your Name) thought you would like to see the Annals of Family Medicine web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
5 + 14 =
Solve this simple math problem and enter the result. E.g. for 1+3, enter 4.
Citation Tools
Quality, Accuracy, and Bias in ChatGPT-Based Summarization of Medical Abstracts
Joel Hake, Miles Crowley, Allison Coy, Denton Shanks, Aundria Eoff, Kalee Kirmer-Voss, Gurpreet Dhanda, Daniel J. Parente
The Annals of Family Medicine Mar 2024, 22 (2) 113-120; DOI: 10.1370/afm.3075

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Get Permissions
Share
Quality, Accuracy, and Bias in ChatGPT-Based Summarization of Medical Abstracts
Joel Hake, Miles Crowley, Allison Coy, Denton Shanks, Aundria Eoff, Kalee Kirmer-Voss, Gurpreet Dhanda, Daniel J. Parente
The Annals of Family Medicine Mar 2024, 22 (2) 113-120; DOI: 10.1370/afm.3075
Twitter logo Facebook logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Jump to section

  • Article
    • Abstract
    • INTRODUCTION
    • METHODS
    • RESULTS
    • DISCUSSION
    • Footnotes
    • References
  • Figures & Data
  • eLetters
  • Info & Metrics
  • PDF

Related Articles

  • PubMed
  • Google Scholar

Cited By...

  • Use of AI in Family Medicine Publications: A Joint Editorial from Journal Editors
  • Use of AI in family medicine publications: a joint editorial from journal editors
  • Use of artificial intelligence in family medicine publications: Joint statement from journal editors
  • Use of AI in Family Medicine Publications: A Joint Editorial From Journal Editors
  • Generative artificial intelligence and social media: insights for tobacco control
  • Utilizing AI-Generated Plain Language Summaries to Enhance Interdisciplinary Understanding of Ophthalmology Notes: A Randomized Trial
  • Google Scholar

More in this TOC Section

  • Agile Implementation of a Digital Cognitive Assessment for Dementia in Primary Care
  • Authorship Inequity in Global Health Research Conducted in Low- and Middle-Income Countries and Published in High-Income Country Family Medicine Journals
  • Feasibility and Acceptability of Implementing a Digital Cognitive Assessment for Alzheimer Disease and Related Dementias in Primary Care
Show more Original Research

Similar Articles

Subjects

  • Methods:
    • Quantitative methods

Keywords

  • artificial intelligence
  • large language models
  • ChatGPT
  • primary care research
  • critical assessment of scientific literature
  • bias
  • text mining
  • text analysis

Content

  • Current Issue
  • Past Issues
  • Early Access
  • Plain-Language Summaries
  • Multimedia
  • Podcast
  • Articles by Type
  • Articles by Subject
  • Supplements
  • Calls for Papers

Info for

  • Authors
  • Reviewers
  • Job Seekers
  • Media

Engage

  • E-mail Alerts
  • e-Letters (Comments)
  • RSS
  • Journal Club
  • Submit a Manuscript
  • Subscribe
  • Family Medicine Careers

About

  • About Us
  • Editorial Board & Staff
  • Sponsoring Organizations
  • Copyrights & Permissions
  • Contact Us
  • eLetter/Comments Policy

© 2025 Annals of Family Medicine