HOW THE ABFM WILL ADDRESS HEALTH EQUITY ======================================= * Warren P. Newton * Elizabeth Baxley * Lars Peterson * John Brady * Robert Phillips, Jr * Michael Magill * Thomas O’Neill America is transfixed by 2 epidemics. First, the COVID pandemic, with over 155,000 deaths in the United States and new outbreaks here and across the world, is crippling the financial engines of our economy and stoking conflict among groups. Second is the more silent epidemic of pervasive health disparities, demonstrated yet again by the pandemic. In the United States, and indeed the world, the murder of George Floyd, historical acknowledgement of the pervasive legacy of racial injustice, and its recognition as a cause of disparate rates of infection and death among minorities during the pandemic has created a period of intense focus and conflict. In 2003, the Institute of Medicine’s *Unequal Treatment* report found evidence that these disparities were not just the result of social policy, but also of intrinsic bias in the health system and among physicians.1 Mindful of the many people and organizations who will contribute to the solutions, the question for ABFM is: what is the role of a certifying board in addressing health disparities and their underlying causes? A starting point is our mission and vision: ABFM’s vision statement includes a goal of *“Optimal health and health care for* all *people and communities that family physicians serve.”* Our 2019 strategic plan2 commits us to *“Include health into its program of lifelong learning and quality improvement. We will support organizations and people developing innovative curricula in professionalism, the social contract, advocacy, health equity, and social drivers of health at all levels of education.”* ABFM is committed to finding and implementing changes in its certification program which may help eliminate health disparities. This may include current tools, like performance improvement, self-assessment, and reflection and formative feedback from our examination, but we also remain open to new mechanisms that serve our Diplomates and the public. A first step is to support family physicians making improvements in their practices. We have heard from some Diplomates who are already moving to action (see ABFM social media posts with hashtag #positiveprofessionalism), but many others are searching for ways to change their practices to improve equity. Based on our recent success in a self-directed COVID performance improvement (PI) activity, we have extended that option to Diplomates wishing to improve health equity. Deployed on June 29, 2020, this activity provides a variety of options for Diplomates—from reviewing differences in clinical quality among groups who historically have experienced disparities, to assessing previously unrecognized barriers to equal access in their own practices and staff, to community-level assessments and interventions addressing social determinants of health. Responding to Diplomates who indicated that they want to do something but don’t know where to start, we have included more resources to help physicians make these positive health equity changes. Beyond the PI activity, another available tool is ABFM’s Population Health Assessment Engine (PHATE), which allows users to map their practices and patients to known social determinants of health.3 Having access to this data helps in numerous ways. For example, one practice used PHATE to find that despite serving a very affluent area, their patients from more deprived neighborhoods had lower scores on quality metrics.4 Another practice used PHATE to identify the neighborhoods where their patients consistently had food insecurity, allowing them to develop and support appropriate community interventions.5 A second step is to provide an opportunity for physicians to assess their own knowledge of health disparities and their underlying causes. We are fortunate to be able to utilize educational materials developed by family physicians as part of the Family Medicine for America’s Health (FMAHealth) Initiative, which had a major focus on addressing health disparities. The American Academy of Family Physicians (AAFP) assumed leadership for this initiative after the completion of FMAHealth and these materials are now housed within their Center for Health Equity.6 ABFM has initiated efforts to partner with the AAFP so Diplomates can utilize these materials, in a self-directed manner, to gain both knowledge self-assessment credit and CME credit. The material will be available for all Diplomates. Knowledge is power, and can heal individuals, groups, and communities. We are also committed to learning if there are any disparities among different groups of family physicians in their results on ABFM certification examinations. For the past 7 years, and alone among the ABMS Boards, ABFM has collected data on Diplomate race and ethnicity in order to assess whether any bias exists in our examination questions. Formally termed Differential Item Functioning (DIF),7–9 this process compares, on an item-by-item basis, whether examination questions perform differently among physicians from different self-designated racial and ethnic groups, as compared to examinees of similar ability. Any questions which appear to perform differently (using a 2 standard deviation plus clinical significance threshold) are reviewed further by a diverse panel of family physicians. Over the years, we have identified a number of questions which may be biased against one race or ethnic group and have removed them from our item bank. Going forward, we will extend our DIF process to the questions in the new Family Medicine Certification Longitudinal Assessment (FMCLA) and ultimately to the Sports Medicine examination, which we administer. Of course, we will encourage the sponsors of our other Certificates of Added Qualifications to apply this technique to their examinations. We will also look for disparities in examination outcomes across race, ethnicity, and other groups of family physicians. Approximately a decade ago, we observed a substantial difference in examination performance among international medical graduates (IMGs). Working closely with the Family Medicine Review Committee of the Accreditation Council of Graduate Medical Education (ACGME), ABFM intervened in multiple ways to try to improve the performance of IMGs. The Family Medicine RC, recognizing the Board Examination as the best single measure of the cognitive expertise of family physicians, increased the residency standard to 90% passing, and added a requirement that residents take a Board exam. The ABFM moved its exam to April, giving more control to the Program Directors, and created a Bayesian score predictor that allows conversion of in-training examination scores to a probability of passing the Family Medicine Certification examination. Family Medicine Residency Directors responded brilliantly, and the differences between IMGs and American graduates have narrowed dramatically in recent years.10 We will now turn this lens on the educational environment to explore disparities in examination outcomes across other groups. What will we do if we do find significant disparities? In addition to looking for bias in the specific questions which make up our examination, as described above, we will include this issue as we consider the major revision of the ACGME residency requirements11 and the corresponding Board Eligibility requirements. More broadly, we also recognize that board certification is at the end of the educational pipeline, and that we will need to work upstream with those who work with learners at earlier stages. ABFM has an important role convening all those interested in working on this problem. We are also committed to having the ABFM Board and volunteers reflect the diversity of our Diplomates, and to having our Lexington staff reflect the diversity of our community. Table 1 gives the race and ethnicity of our Diplomates as estimated by our 2019 certification/recertification data, and Table 2 gives the gender distribution of Family Medicine residents and Diplomates. Family Medicine is becoming more diverse and more female. We will initially focus on not only gender and minorities under represented in medicine but also geography and kind of employment. Over the longer term, we will consider other populations with health disparities that are more difficult to track such as those who have come from poverty and LGBTQ+. In Board Certification, as in clinical practice, diversity of perspective is critical if we are to achieve our vision of optimal health and health care for all patients and communities that family physicians serve. View this table: [Table 1](http://www.annfammed.org/content/18/5/468/T1) Table 1 Race and Ethnicity of 2019 ABFM Exam Candidates View this table: [Table 2](http://www.annfammed.org/content/18/5/468/T2) Table 2 Gender Breakdown of Family Medicine Residents and ABFM Diplomates * © 2020 Annals of Family Medicine, Inc. ## References 1. Institute of Medicine. Unequal Treatment: Confronting Racial and Ethnic Disparities in Health Care. Washington, DC: National Academies Press; 2003. 2. American Board of Family Medicine. Strategic plan 2019-2025. [https://www.theabfm.org/about/strategic-plan](https://www.theabfm.org/about/strategic-plan). Published 2019. Accessed Apr 20, 2020. 3. Bambekova PG, Liaw W, Phillips RL Jr., Bazemore A. Integrating community and clinical data to assess patient risks with a population health assessment engine (PHATE). J Am Board Fam Med. 2020; 33(3): 463–467. [Abstract/FREE Full Text](http://www.annfammed.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NToiamFiZnAiO3M6NToicmVzaWQiO3M6ODoiMzMvMy80NjMiO3M6NDoiYXRvbSI7czoyMzoiL2FubmFsc2ZtLzE4LzUvNDY4LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 4. Liaw W, Krist AH, Tong ST, et al. Living in “cold spot” communities is sssociated with poor health and health quality. J Am Board Fam Med. 2018; 31(3): 342–350. [Abstract/FREE Full Text](http://www.annfammed.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NToiamFiZnAiO3M6NToicmVzaWQiO3M6ODoiMzEvMy8zNDIiO3M6NDoiYXRvbSI7czoyMzoiL2FubmFsc2ZtLzE4LzUvNDY4LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 5. Lichkus J, Liaw WR, Phillips RL. Utilizing PHATE: a population health-mapping tool to identify areas of food insecurity. Ann Fam Med. 2019; 17(4): 372. [FREE Full Text](http://www.annfammed.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiRlVMTCI7czoxMToiam91cm5hbENvZGUiO3M6ODoiYW5uYWxzZm0iO3M6NToicmVzaWQiO3M6ODoiMTcvNC8zNzIiO3M6NDoiYXRvbSI7czoyMzoiL2FubmFsc2ZtLzE4LzUvNDY4LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 6. Center for Diversity and Health Equity. [https://www.aafp.org/patient-care/social-determinants-of-health/everyone-project/cdhe.html](https://www.aafp.org/patient-care/social-determinants-of-health/everyone-project/cdhe.html). Accessed Aug 5, 2020. 7. O’Neill TR, Peabody MR, Puffer JC. The ABFM begins to use differential item functioning. J Am Board Fam Med. 2013; 26(6): 807–809. [FREE Full Text](http://www.annfammed.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiRlVMTCI7czoxMToiam91cm5hbENvZGUiO3M6NToiamFiZnAiO3M6NToicmVzaWQiO3M6ODoiMjYvNi84MDciO3M6NDoiYXRvbSI7czoyMzoiL2FubmFsc2ZtLzE4LzUvNDY4LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 8. Peabody MR, Wind SA. Exploring the stability of differential item functioning across administrations and critical values using the Rasch separate calibration *t*-test method. Measurement. 2019; 17(2): 78–92. 9. Scheuneman JD, Subhiyah RG. Evidence for the validity of a Rasch model technique for identifying differential item functioning. J Outcome Meas. 1998; 2(1): 33–42. [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=9661730&link_type=MED&atom=%2Fannalsfm%2F18%2F5%2F468.atom) 10. Puffer JC, Peabody MR, O’Neill TR. Performance of graduating residents on the American Board of Family Medicine certification examination 2009-2016. J Am Board Fam Med. 2017; 30(5): 570–571. [Abstract/FREE Full Text](http://www.annfammed.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NToiamFiZnAiO3M6NToicmVzaWQiO3M6ODoiMzAvNS81NzAiO3M6NDoiYXRvbSI7czoyMzoiL2FubmFsc2ZtLzE4LzUvNDY4LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 11. Newton WP, Bazemore A, Magill M, Mitchell K, Peterson L, Phillips RL. The future of family medicine residency training is our future: a call for dialogue across our community. J Am Board Fam Med. 2020; 33(4): 636–640. [FREE Full Text](http://www.annfammed.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiRlVMTCI7czoxMToiam91cm5hbENvZGUiO3M6NToiamFiZnAiO3M6NToicmVzaWQiO3M6ODoiMzMvNC82MzYiO3M6NDoiYXRvbSI7czoyMzoiL2FubmFsc2ZtLzE4LzUvNDY4LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==)