Skip to main content

Main menu

  • Home
  • Current Issue
  • Content
    • Current Issue
    • Early Access
    • Multimedia
    • Podcast
    • Collections
    • Past Issues
    • Articles by Subject
    • Articles by Type
    • Supplements
    • Plain Language Summaries
    • Calls for Papers
  • Info for
    • Authors
    • Reviewers
    • Job Seekers
    • Media
  • About
    • Annals of Family Medicine
    • Editorial Staff & Boards
    • Sponsoring Organizations
    • Copyrights & Permissions
    • Announcements
  • Engage
    • Engage
    • e-Letters (Comments)
    • Subscribe
    • Podcast
    • E-mail Alerts
    • Journal Club
    • RSS
    • Annals Forum (Archive)
  • Contact
    • Contact Us
  • Careers

User menu

  • My alerts

Search

  • Advanced search
Annals of Family Medicine
  • My alerts
Annals of Family Medicine

Advanced Search

  • Home
  • Current Issue
  • Content
    • Current Issue
    • Early Access
    • Multimedia
    • Podcast
    • Collections
    • Past Issues
    • Articles by Subject
    • Articles by Type
    • Supplements
    • Plain Language Summaries
    • Calls for Papers
  • Info for
    • Authors
    • Reviewers
    • Job Seekers
    • Media
  • About
    • Annals of Family Medicine
    • Editorial Staff & Boards
    • Sponsoring Organizations
    • Copyrights & Permissions
    • Announcements
  • Engage
    • Engage
    • e-Letters (Comments)
    • Subscribe
    • Podcast
    • E-mail Alerts
    • Journal Club
    • RSS
    • Annals Forum (Archive)
  • Contact
    • Contact Us
  • Careers
  • Follow annalsfm on Twitter
  • Visit annalsfm on Facebook
Research ArticleOriginal Research

A Nationwide Flash-Mob Study for Suspected Acute Coronary Syndrome

Angel M.R. Schols, Robert T. A. Willemsen, Tobias N. Bonten, Martijn H. Rutten, Patricia M. Stassen, Bas L. J. H. Kietselaer, Geert-Jan Dinant and Jochen W.L. Cals
The Annals of Family Medicine July 2019, 17 (4) 296-303; DOI: https://doi.org/10.1370/afm.2401
Angel M.R. Schols
1Department of Family Medicine, Care and Public Health Research Institute (CAPHRI), Maastricht University, Maas-tricht, The Netherlands
MD, PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Robert T. A. Willemsen
1Department of Family Medicine, Care and Public Health Research Institute (CAPHRI), Maastricht University, Maas-tricht, The Netherlands
MD, PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Tobias N. Bonten
2Department of Public Health and Primary Care, Leiden University Medical Center, Leiden, The Netherlands
MD, PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Martijn H. Rutten
3Radboud Institute for Health Sciences, Scientific Center for Quality of Healthcare (IQ Healthcare), Radboud University Medical Center, Nijmegen, The Netherlands
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Patricia M. Stassen
4Department of Internal Medicine, Division of General Medicine, Section of Acute Medicine, Care and Public Health Research Institute (CAPHRI), Maastricht University Medical Center, Maastricht, The Netherlands
MD, PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Bas L. J. H. Kietselaer
5Department of Cardiology, Zuyderland Medical Center, Heerlen and Sittard, The Netherlands
MD, PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Geert-Jan Dinant
1Department of Family Medicine, Care and Public Health Research Institute (CAPHRI), Maastricht University, Maas-tricht, The Netherlands
MD, PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jochen W.L. Cals
1Department of Family Medicine, Care and Public Health Research Institute (CAPHRI), Maastricht University, Maas-tricht, The Netherlands
MD, PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: j.cals@maastrichtuniversity.nl
  • Article
  • Figures & Data
  • eLetters
  • Info & Metrics
  • PDF
Loading

Article Figures & Data

Figures

  • Tables
  • Additional Files
  • Figure 1
    • Download figure
    • Open in new tab
    • Download powerpoint
    Figure 1

    Implementation of the flash-mob method in the present study.

    a Specialized FPs receive a special 2-year training in heart and vascular disease or acute medicine.

  • Figure 2
    • Download figure
    • Open in new tab
    • Download powerpoint
    Figure 2

    Patient inclusion and follow-up.

  • Figure 3
    • Download figure
    • Open in new tab
    • Download powerpoint
    Figure 3

    ROC curves for FP assessment of ACS probability and the Marburg Heart Score in patients referred for suspected ACS (n = 186).

    ACS = acute coronary syndrome; AUC = area under the curve; FP = family physician; ROC = receiver operating characteristic.

Tables

  • Figures
  • Additional Files
    • View popup
    Table 1

    Components of the Marburg Heart Score1–3

    Score ComponentAssigned Points
    Age/sex (female aged ≥65 y, male aged ≥55 y)1
    Known clinical vascular diseasea1
    Patient assumes cardiac origin of pain1
    Pain worse with exercise1
    Pain not reproducible by palpation1
    • ↵a Including coronary heart disease, cerebrovascular disease, or peripheral artery disease.

    • Note: 1 point is assigned to each score variable; 3 different risk categories are derived (low risk = 0-2 points; intermediate risk = 3 points; high risk = 4-5 points).

    • View popup
    Table 2

    Patient Characteristics, Investigated Predictors, and Univariate Analyses of Possible ACS Predictors

    TotalACSNo ACSOdds Ratio (95% CI)P Value
    Mean age, y (SD)64 (13.3)67 (12.6)63 (13.3)
    Male, n/N (%)127/243 (52.3)34/45 (75.6)93/198 (47.0)3.49 (1.67-7.28)<.01
    Sex-adjusted age; female aged ≥65 y, male aged ≥55 y, n/N (%)a153/243 (63.0)36/45 (80.0)117/198 (59.1)2.77 (1.27-6.06).01
    Duration of symptoms, n/N (%)
     <1 h23/243 (9.5)3/45 (6.7)20/198 (10.1)
     1-24 h138/243 (56.8)23/45 (51.1)115/198 (58.1)
     >24 h82/243 (33.7)19/45 (42.2)63/198 (31.8)
    FP immediately suspected a serious condition, n/N (%)120/243 (49.4)26/45 (57.8)94/198 (47.5)1.51 (0.79-2.91).21
    History of clinical vascular disease, n/N (%)a106/243 (43.6)22/45 (48.9)84/198 (42.4)1.30 (0.68-2.48).43
    Patient assumes cardiac origin of pain, n/N (%)a136/242 (56.2)28/45 (62.2)108/197 (54.8)1.36 (0.70-2.64).37
    Chest pain, n/N (%)215/243 (88.5)39/45 (86.7)176/198 (88.9)0.81 (0.31-2.14).67
     Pain worse with exercise, n/N (%)a86/188 (45.7)17/36 (47.2)69/152 (45.4)1.08 (0.52-2.23).84
     Pain feels like pressure, n/N (%)185/212 (87.3)31/39 (79.5)154/173 (89.0)0.48 (0.19-1.19).11
     Pain not reproducible by palpation, n/N (%)a179/210 (85.2)36/39 (92.3)143/171 (83.6)2.35 (0.68-8.16).17
    ECG performed, n/N (%)115/239 (48.1)23/44 (52.3)92/195 (47.2)
     ECG shows ischemic changes, n/N (%)37/115 (32.2)17/23 (73.9)20/92 (21.7)10.20 (3.55-29.28)<.01
    FP assessment of ACS probability, median (IQR)6 (3)7 (3)6 (3)
    Marburg Heart Score,b median (IQR)3 (2)4 (2)3 (2)
    • ACS = acute coronary syndrome; ECG = electrocardiography; FP = family physician; IQR = interquartile range.

    • ↵a Component of the Marburg Heart Score.

    • ↵b See Table 1 for all of the components of the Marburg Heart Score.

    • View popup
    Table 3

    Test Characteristics of the Marburg Heart Score and the FP Assessment

    VariableACSNo ACSTotal
    MHS using a cut-off value of ≤2
    MHS >22784111
    MHS ≤296675
    Total36150186
    Sensitivity: 75.0% (95% CI, 57.5-87.3)Incidence ACS: 19.4% (95% CI, 14.1-25.9)
    Specificity: 44.0% (95% CI, 36.0-52.3)Incidence No ACS: 80.6% (95% CI, 74.1-85.9)
    PPV: 24.3% (95% CI, 16.9-33.6)OR: 2.36 (95% CI, 1.04-5.35)
    NPV: 88.0% (95% CI, 78.0-94.0)χ2: 0.04
    MHS using a cut-off value of ≤1
    MHS >134126160
    MHS ≤122426
    Total36150186
    Sensitivity: 94.4% (95% CI, 80.0-99.0)Incidence ACS: 19.4% (95% CI, 14.1-25.9)
    Specificity: 16.0% (95% CI, 10.7-23.1)Incidence No ACS: 80.6% (95% CI, 74.1-85.9)
    PPV: 21.3% (95% CI, 15.4-28.6)OR: 3.24 (95% CI, 0.73-14.39)
    NPV: 92.3% (95% CI, 73.4-98.7)χ2: 0.11
    FP probability assessment using a cut-off value of ≤5
    FP probability assessment high (>5)39116155
    FP probability assessment low (≤5)68288
    Total45198243
    Sensitivity: 86.7% (95% CI, 72.5-94.5)Incidence ACS: 18.5% (95% CI, 14.0-24.1)
    Specificity: 41.4% (95% CI, 34.5-48.6)Incidence No ACS: 81.5% (95% CI, 75.9-86.0)
    PPV: 25.2% (95% CI, 18.7-32.9)OR: 4.60 (95% CI, 1.86-11.36)
    NPV: 93.2% (95% CI, 85.2-97.2)χ2: <0.01
    Combined approach using the MHS and the FP assessments of probability
    MHS + FP probability assessment, 1-2a36115151
    MHS + FP probability assessment, 0b03535
    Total36150186
    Sensitivity: 100% (95% CI, 88.0-100)Incidence ACS: 19.4% (95% CI, 14.1-25.9)
    Specificity: 23.3% (95% CI, 17.0-31.1)Incidence No ACS: 80.6% (95% CI, 74.1-85.9)
    PPV: 23.8% (95% CI, 17.5-31.6)
    NPV: 100% (95% CI, 87.7-100)
    • ACS = acute coronary syndrome; FP = family physician; MHS = Marburg Heart Score; NPV = negative predictive value; OR = odds ratio; PPV = positive predictive value.

    • ↵a Either the MHS, the FP assessment, or both were positive using an MHS cut-off value of ≤2 and an FP assessment cut-off value of ≤5.

    • ↵b Both the MHS and the FP assessments were negative.

Additional Files

  • Figures
  • Tables
  • The Article in Brief

    A Nationwide Flash-Mob Study for Suspected Acute Coronary Syndrome

    Jochen W.L. Cals , and colleagues

    Background The dual aim of this study was to evaluate the Marburg Heart Score, a clinical decision rule, and/or develop an adapted clinical decision rule for family practitioners to safely rule out acute coronary syndrome in patients referred to secondary care for suspected ACS; and also to evaluate the feasibility of using a "flash mob" method, an innovative new study design, for large scale research in family medicine.

    What This Study Found This study finds that, in emergency care, acute coronary syndrome cannot be safely ruled out using the Marburg Heart Score or the family physicians' clinical assessment. In a period of only 2 weeks, researchers at Maastricht University collected data on 258 ACS-suspected patients by mobilizing 1 in 5 family physicians throughout the Netherlands to participate in the study. This mobilization was done by enlisting ambassadors among the FP community in the Netherlands who then spread the word through traditional professional and social networks. The study found that among 243 patients receiving a final diagnosis, 45 (18.5%) were diagnosed with acute coronary syndrome. Sensitivity for the FP rating was 86.7% and sensitivity for the MHS was 94.4%.

    Implications

    • While large, prospective studies can be time consuming and costly, this innovative flash mob method of research, named after the large-scale public collaborations/gatherings driven by social media, allowed for the fast investigation of one simple question on a large scale in a short timeframe.
PreviousNext
Back to top

In this issue

The Annals of Family Medicine: 17 (4)
The Annals of Family Medicine: 17 (4)
Vol. 17, Issue 4
July/August 2019
  • Table of Contents
  • Index by author
  • Back Matter (PDF)
  • Front Matter (PDF)
  • In Brief
Print
Download PDF
Article Alerts
Sign In to Email Alerts with your Email Address
Email Article

Thank you for your interest in spreading the word on Annals of Family Medicine.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
A Nationwide Flash-Mob Study for Suspected Acute Coronary Syndrome
(Your Name) has sent you a message from Annals of Family Medicine
(Your Name) thought you would like to see the Annals of Family Medicine web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
5 + 3 =
Solve this simple math problem and enter the result. E.g. for 1+3, enter 4.
Citation Tools
A Nationwide Flash-Mob Study for Suspected Acute Coronary Syndrome
Angel M.R. Schols, Robert T. A. Willemsen, Tobias N. Bonten, Martijn H. Rutten, Patricia M. Stassen, Bas L. J. H. Kietselaer, Geert-Jan Dinant, Jochen W.L. Cals
The Annals of Family Medicine Jul 2019, 17 (4) 296-303; DOI: 10.1370/afm.2401

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Get Permissions
Share
A Nationwide Flash-Mob Study for Suspected Acute Coronary Syndrome
Angel M.R. Schols, Robert T. A. Willemsen, Tobias N. Bonten, Martijn H. Rutten, Patricia M. Stassen, Bas L. J. H. Kietselaer, Geert-Jan Dinant, Jochen W.L. Cals
The Annals of Family Medicine Jul 2019, 17 (4) 296-303; DOI: 10.1370/afm.2401
Twitter logo Facebook logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Jump to section

  • Article
    • Abstract
    • INTRODUCTION
    • METHODS
    • RESULTS
    • DISCUSSION
    • Acknowledgments
    • Footnotes
    • References
  • Figures & Data
  • eLetters
  • Info & Metrics
  • PDF

Related Articles

  • PubMed
  • Google Scholar

Cited By...

  • Chest Pain in Primary Care: A Systematic Review of Risk Stratification Tools to Rule Out Acute Coronary Syndrome
  • Ruling out acute coronary syndrome in primary care with a clinical decision rule and a capillary, high-sensitive troponin I point of care test: study protocol of a diagnostic RCT in the Netherlands (POB HELP)
  • Prehospital risk assessment in patients suspected of non-ST-segment elevation acute coronary syndrome: a systematic review and meta-analysis
  • Performance of risk scores for coronary artery disease: a retrospective cohort study of patients with chest pain in urgent primary care
  • The Next Generation of Connectivity in Family Medicine Research
  • Google Scholar

More in this TOC Section

  • Performance-Based Reimbursement, Illegitimate Tasks, Moral Distress, and Quality Care in Primary Care: A Mediation Model of Longitudinal Data
  • Adverse Outcomes Associated With Inhaled Corticosteroid Use in Individuals With Chronic Obstructive Pulmonary Disease
  • Family-Based Interventions to Promote Weight Management in Adults: Results From a Cluster Randomized Controlled Trial in India
Show more Original Research

Similar Articles

Subjects

  • Domains of illness & health:
    • Acute illness
  • Methods:
    • Participatory / action research

Keywords

  • flash mob research
  • clinical decision rule
  • acute coronary syndrome
  • family medicine

Content

  • Current Issue
  • Past Issues
  • Early Access
  • Plain-Language Summaries
  • Multimedia
  • Podcast
  • Articles by Type
  • Articles by Subject
  • Supplements
  • Calls for Papers

Info for

  • Authors
  • Reviewers
  • Job Seekers
  • Media

Engage

  • E-mail Alerts
  • e-Letters (Comments)
  • RSS
  • Journal Club
  • Submit a Manuscript
  • Subscribe
  • Family Medicine Careers

About

  • About Us
  • Editorial Board & Staff
  • Sponsoring Organizations
  • Copyrights & Permissions
  • Contact Us
  • eLetter/Comments Policy

© 2025 Annals of Family Medicine