Skip to main content

Main menu

  • Home
  • Current Issue
  • Content
    • Current Issue
    • Early Access
    • Multimedia
    • Podcast
    • Collections
    • Past Issues
    • Articles by Subject
    • Articles by Type
    • Supplements
    • Plain Language Summaries
    • Calls for Papers
  • Info for
    • Authors
    • Reviewers
    • Job Seekers
    • Media
  • About
    • Annals of Family Medicine
    • Editorial Staff & Boards
    • Sponsoring Organizations
    • Copyrights & Permissions
    • Announcements
  • Engage
    • Engage
    • e-Letters (Comments)
    • Subscribe
    • Podcast
    • E-mail Alerts
    • Journal Club
    • RSS
    • Annals Forum (Archive)
  • Contact
    • Contact Us
  • Careers

User menu

  • My alerts

Search

  • Advanced search
Annals of Family Medicine
  • My alerts
Annals of Family Medicine

Advanced Search

  • Home
  • Current Issue
  • Content
    • Current Issue
    • Early Access
    • Multimedia
    • Podcast
    • Collections
    • Past Issues
    • Articles by Subject
    • Articles by Type
    • Supplements
    • Plain Language Summaries
    • Calls for Papers
  • Info for
    • Authors
    • Reviewers
    • Job Seekers
    • Media
  • About
    • Annals of Family Medicine
    • Editorial Staff & Boards
    • Sponsoring Organizations
    • Copyrights & Permissions
    • Announcements
  • Engage
    • Engage
    • e-Letters (Comments)
    • Subscribe
    • Podcast
    • E-mail Alerts
    • Journal Club
    • RSS
    • Annals Forum (Archive)
  • Contact
    • Contact Us
  • Careers
  • Follow annalsfm on Twitter
  • Visit annalsfm on Facebook
Review ArticleSystematic Review

Pay-for-Performance in the United Kingdom: Impact of the Quality and Outcomes Framework—A Systematic Review

Stephen J. Gillam, A. Niroshan Siriwardena and Nicholas Steel
The Annals of Family Medicine September 2012, 10 (5) 461-468; DOI: https://doi.org/10.1370/afm.1377
Stephen J. Gillam
1Department of Public Health and Primary Care, Institute of Public Health, University of Cambridge, Cambridge, England
MD, FFPH, FRCP, FRCGP
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: sjg67@medschl.cam.ac.uk
A. Niroshan Siriwardena
2Faculty of Health, Life & Social Sciences, University of Lincoln, England
MMedSci, PhD, FRCGP
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Nicholas Steel
3Norwich Medical School, Faculty of Medicine and Health Sciences, University of East Anglia, Norwich, England
PhD, FFPH, MRCGP
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Figures & Data
  • eLetters
  • Info & Metrics
  • PDF
Loading

Published eLetters

If you would like to comment on this article, click on Submit a Response to This article, below. We welcome your input.

Submit a Response to This Article
Compose eLetter

More information about text formats

Plain text

  • No HTML tags allowed.
  • Web page addresses and e-mail addresses turn into links automatically.
  • Lines and paragraphs break automatically.
Author Information
First or given name, e.g. 'Peter'.
Your last, or family, name, e.g. 'MacMoody'.
Your email address, e.g. higgs-boson@gmail.com
Your role and/or occupation, e.g. 'Orthopedic Surgeon'.
Your organization or institution (if applicable), e.g. 'Royal Free Hospital'.
Statement of Competing Interests
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Image CAPTCHA
Enter the characters shown in the image.

Vertical Tabs

Jump to comment:

  • Pros And Cons Of Check-lists
    En P. Fung
    Published on: 01 May 2017
  • Commentary on "Pay-for-Performance in the United Kingdom
    Douglas A. Conrad
    Published on: 18 November 2012
  • Published on: (1 May 2017)
    Page navigation anchor for Pros And Cons Of Check-lists
    Pros And Cons Of Check-lists
    • En P. Fung, Medical Officer

    On the subject of protocol-driven care ("box-ticking"), questionnaires, tick-boxes, or pop-ups should be used as aide-memoire rather than rigid instruments for assessing quality of care given by doctors to patients or its use being mandatory during clinical assessments.

    Clinicians who are pressed for time or single-mindedly only interested in checking all the boxes may superficially or vaguely approach the ite...

    Show More

    On the subject of protocol-driven care ("box-ticking"), questionnaires, tick-boxes, or pop-ups should be used as aide-memoire rather than rigid instruments for assessing quality of care given by doctors to patients or its use being mandatory during clinical assessments.

    Clinicians who are pressed for time or single-mindedly only interested in checking all the boxes may superficially or vaguely approach the items in the protocol without really exploring them, while dishonest clinicians may check all the boxes without addressing the items. Either way, it is probably impossible to identify when or where such malpractice has occurred, and the patient is as good as if the protocol had not existed in the first place... yet objective evidence suggests that such clinicians have delivered their service up to standards.

    That being said, anything that is aide-memoire has the real risk of being ignored such that the consultation may miss cardinal aspects of care, amounting to medical negligence.

    Competing interests: None declared

    Show Less
    Competing Interests: None declared.
  • Published on: (18 November 2012)
    Page navigation anchor for Commentary on "Pay-for-Performance in the United Kingdom
    Commentary on "Pay-for-Performance in the United Kingdom
    • Douglas A. Conrad, Professor and Director

    This systematic review by Gillam, Siriwardena, and Steel adds significantly to our collective understanding of the effects of pay-for- performance (P4P) in primary care. To my knowledge,the Quality Outcomes framework (QOF)in the UK represents the largest and most robust nationwide application of P4P in the world, and thus provides uniquely valuable insights regarding the potential positive and negative effects to be expec...

    Show More

    This systematic review by Gillam, Siriwardena, and Steel adds significantly to our collective understanding of the effects of pay-for- performance (P4P) in primary care. To my knowledge,the Quality Outcomes framework (QOF)in the UK represents the largest and most robust nationwide application of P4P in the world, and thus provides uniquely valuable insights regarding the potential positive and negative effects to be expected from a large-scale implementation of P4P.

    I will comment on specific key findings from the authors' review. First and foremost, the observation that quality of care for incentivized conditions improved in the first year of the framework more rapidly than the pre-intervention trend and then returned to pre-intervention rates of improvement is evidence in support of positive initial, but (rapidly) diminishing, marginal returns to incentive intervention. This itself is an important result, insofar as it suggests that aspects of care quality most amenable to early gains (the "low-hanging fruit") were tackled first and that later gains in other, more difficult quality domains are (and likely will be) harder to attain.

    Second and equally illuminating, given the general concerns regarding unintended consequences of P4P, non-incentivized quality indicators did not improve at rates higher than pre-incentive trends in the first two years, and actually declined relative to pre-incentive trends by 2006- 2007. Absent a control group setting, the contrast of trends in incentivized to non-incentivized indicators implies a true positive effect of P4P, while also hinting that the gains to the former quality metrics might have been achieved at the expense of the non-rewarded aspects of quality. The decline in rates of improvement for the non-incented indicators also suggests that the substantial rewards realized in response to the explicit incentives were not sufficient to invest in holding the gains. Evidently, there are no free lunches in quality improvement, as in the rest of life.

    It appears that even a sustained, large incentive program like the QOF will confront the natural tendency of humans to respond to extrinsic incentives by sub-optimizing, i.e., "looking where the light is", rather than surveying the entire landscape. This reality highlights the importance of finding the sweet spot in the size and nature of incentives - not too little to stimulate response, but not so much as to crowd out the intrinsic motivation that is critical to medical practice and so deeply embedded in the socialization of clinicians.

    The authors' systematic review also shows that, while data recording and team work improved in response to QOF, other important qualitative dimensions such as continuity of care and patient-centeredness were negatively affected. The teamwork enhancements reinforce the view of quality improvement as a team sport, and suggest the wisdom of QOF designers in choosing to incentivize the practice team, rather than either the individual or large organization. However, this careful summary of the evidence demonstrates the remaining challenge of balancing incentives with other supporting organizational mechanisms to develop a comprehensive and sustained quality improvement program.

    Competing interests:   None declared

    Show Less
    Competing Interests: None declared.
PreviousNext
Back to top

In this issue

The Annals of Family Medicine: 10 (5)
The Annals of Family Medicine: 10 (5)
Vol. 10, Issue 5
September/October 2012
  • Table of Contents
  • Index by author
  • In Brief
Print
Download PDF
Article Alerts
Sign In to Email Alerts with your Email Address
Email Article

Thank you for your interest in spreading the word on Annals of Family Medicine.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Pay-for-Performance in the United Kingdom: Impact of the Quality and Outcomes Framework—A Systematic Review
(Your Name) has sent you a message from Annals of Family Medicine
(Your Name) thought you would like to see the Annals of Family Medicine web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
6 + 0 =
Solve this simple math problem and enter the result. E.g. for 1+3, enter 4.
Citation Tools
Pay-for-Performance in the United Kingdom: Impact of the Quality and Outcomes Framework—A Systematic Review
Stephen J. Gillam, A. Niroshan Siriwardena, Nicholas Steel
The Annals of Family Medicine Sep 2012, 10 (5) 461-468; DOI: 10.1370/afm.1377

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Get Permissions
Share
Pay-for-Performance in the United Kingdom: Impact of the Quality and Outcomes Framework—A Systematic Review
Stephen J. Gillam, A. Niroshan Siriwardena, Nicholas Steel
The Annals of Family Medicine Sep 2012, 10 (5) 461-468; DOI: 10.1370/afm.1377
Twitter logo Facebook logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Jump to section

  • Article
    • Abstract
    • INTRODUCTION
    • METHODS
    • RESULTS
    • DISCUSSION
    • Footnotes
    • References
  • Figures & Data
  • eLetters
  • Info & Metrics
  • PDF

Related Articles

  • PubMed
  • Google Scholar

Cited By...

  • All Quality Metrics are Wrong; Some Quality Metrics Could Become Useful
  • The relationship between Quality and Outcomes Framework scores and socioeconomic deprivation: a longitudinal study
  • Characteristics associated with influenza vaccination uptake in pregnancy: a retrospective cohort study
  • Patient perspectives and hospital pay-for-performance: A qualitative study from Lebanon
  • Treatment and prescribing trends of antihypertensive drugs in 2.7 million UK primary care patients over 31 years: a population-based cohort study
  • Promoting physical activity with self-management support for those with multimorbidity: a randomised controlled trial
  • Equity and the funding of Primary Care Networks
  • Concordance in the recording of stroke across UK primary and secondary care datasets: a population-based cohort study
  • What drives general practitioners in the UK to improve the quality of care? A systematic literature review
  • Cautionary study on the effects of pay for performance on quality of care: a pilot randomised controlled trial using standardised patients
  • Spending and quality after three years of Medicares bundled payments for medical conditions: quasi-experimental difference-in-differences study
  • Confessions of a CQC inspector
  • Longitudinal evaluation of a countywide alternative to the Quality and Outcomes Framework in UK General Practice aimed at improving Person Centred Coordinated Care
  • Incentive schemes to increase dementia diagnoses in primary care in England: a retrospective cohort study of unintended consequences
  • Influence of financial and reputational incentives on primary care performance: a longitudinal study
  • Core Principles to Improve Primary Care Quality Management
  • Healthcare outcomes and quality in the NHS: how do we compare and how might the NHS improve?
  • How Evolving United States Payment Models Influence Primary Care and Its Impact on the Quadruple Aim
  • Paying for what matters most: the future of outcomes-based payments in healthcare
  • Payment incentives for community-based psychiatric care in Ontario, Canada
  • Demandes concurrentielles et possibilites en soins primaires
  • Competing demands and opportunities in primary care
  • The Challenges of Measuring, Improving, and Reporting Quality in Primary Care
  • Opportunities for primary care to reduce hospital admissions: a cross-sectional study of geographical variation
  • Incentives and disincentives for treating of depression and anxiety in Ontario Family Health Teams: protocol for a grounded theory study
  • After 12 years, where next for QOF?
  • Incomplete Markets and Imperfect Institutions: Some Challenges Posed by Trust for Contemporary Health Care and Health Policy
  • Perspectives on financial incentives to health service providers for increasing breast feeding and smoking quit rates during pregnancy: a mixed methods study
  • How to assess quality in primary care
  • Making sense of the shadows: priorities for creating a learning healthcare system based on routinely collected data
  • Impact of UK Primary Care Policy Reforms on Short-Stay Unplanned Hospital Admissions for Children With Primary Care-Sensitive Conditions
  • Large Performance Incentives Had The Greatest Impact On Providers Whose Quality Metrics Were Lowest At Baseline
  • Does paying for performance in primary care save lives?
  • GPs should be allowed to provide good quality patient centred care to encourage a person centred NHS
  • Effect of a national primary care pay for performance scheme on emergency hospital admissions for ambulatory care sensitive conditions: controlled longitudinal study
  • Quality in primary care
  • Economic inequalities in burden of illness, diagnosis and treatment of five long-term conditions in England: panel study
  • The effects of financial incentives for case finding for depression in patients with diabetes and coronary heart disease: interrupted time series analysis
  • Increased Risk of Subsequent Myocardial Infarction in Patients With Type 2 Diabetes: A Retrospective Cohort Study Using the U.K. General Practice Research Database
  • Setting performance targets in pay for performance programmes: what can we learn from QOF?
  • What happens when pay for performance stops?
  • Increasing the QOF upper payment threshold in general practices in England: impact of implementing government proposals
  • User Experience of a Centralized Hyperacute Stroke Service: A Prospective Evaluation
  • Future proofing the Quality and Outcomes Framework
  • The Quality and Outcomes Framework--where next?
  • In This Issue: Local+Familiar=Healthier
  • Google Scholar

More in this TOC Section

  • Chest Pain in Primary Care: A Systematic Review of Risk Stratification Tools to Rule Out Acute Coronary Syndrome
  • Nirmatrelvir/Ritonavir Regimen for Mild/Moderately Severe COVID-19: A Rapid Review With Meta-Analysis and Trial Sequential Analysis
  • Clinically Important Benefits and Harms of Monoclonal Antibodies Targeting Amyloid for the Treatment of Alzheimer Disease: A Systematic Review and Meta-Analysis
Show more Systematic Review

Similar Articles

Subjects

  • Person groups:
    • Vulnerable populations
  • Other research types:
    • Health policy
    • Health services
  • Core values of primary care:
    • Continuity
    • Personalized care
    • Relationship
  • Other topics:
    • Quality improvement
    • Clinical practice guidelines
    • Disparities in health and health care
    • Social / cultural context

Content

  • Current Issue
  • Past Issues
  • Early Access
  • Plain-Language Summaries
  • Multimedia
  • Podcast
  • Articles by Type
  • Articles by Subject
  • Supplements
  • Calls for Papers

Info for

  • Authors
  • Reviewers
  • Job Seekers
  • Media

Engage

  • E-mail Alerts
  • e-Letters (Comments)
  • RSS
  • Journal Club
  • Submit a Manuscript
  • Subscribe
  • Family Medicine Careers

About

  • About Us
  • Editorial Board & Staff
  • Sponsoring Organizations
  • Copyrights & Permissions
  • Contact Us
  • eLetter/Comments Policy

© 2025 Annals of Family Medicine