Overview
The Josiah Macy Jr. Foundation is supporting three demonstration projects to develop, implement, and evaluate innovative strategies for enhancing fairness in clinical assessment in medical and nursing education programs. Funded projects will serve as exemplars for how schools of medicine and nursing can implement strategies that center the purpose of assessment, which is to ensure that everyone who graduates is fully prepared to provide the highest standard of care to their patients. This RFA will build upon the consensus recommendations that emanated from the Josiah Macy Jr. Foundation’s 2022 conference entitled Ensuring Fairness in Medical Education Assessment.
Award Size
Up to $200,000
Duration
2-Year Projects
Status
LOI submission period has closed.
Recipients

University of Cincinnati College of Medicine
Leveraging EHR Data to Measure and Ensure Equitable Clinical Exposure for Fair Competency Assessment
Residency programs cannot see the training they provide as they lack reliable tools to measure what trainees actually encounter. Without data regarding clinical conditions learners are exposed to, assessments cannot distinguish a competency gap from a missed opportunity. This project uses electronic health record data to quantify clinical exposure across internal medicine residents, links exposure to competency outcomes, and engages stakeholders on how this data should inform fair assessment. The result will be a generalizable methodology that promotes contextual equity in learner assessment.
PI: Christine Y. Zhou, DO, Clinical Instructor, Pulmonary, Critical Care, and Sleep Medicine

Hartford Hospital
AI-Augmented Red Teaming to Improve Fairness in Clinical Assessment
Clinical assessments are vulnerable to bias and inconsistent judgment. Training alone has not consistently improved fairness because assessors often rely on first impressions and unconscious assumptions. This project explores an approach called “red teaming” which involves adversarially challenging decisions to question assumptions and identify blindspots. The team will test an AI-supported red teaming approach that prompts faculty to question initial judgments, consider alternative interpretations, and account for context before finalizing assessments. The team will co-design, pilot, and implement an AI-supported red teaming toolkit with the goal of improving decision-making and creating fairer, more trustworthy assessment processes.
PI: Javeed Sukhera, MD, PhD, FAPA, FRCPC, Associate Chief Academic Officer, Hartford HealthCare

Central Michigan University
CHIPS-AIS to Improve Fairness & Reduce Bias in Clinical Faculty Assessment of Students
The Calibration for High-Quality, Inclusive Performance Scoring using Artificial Intelligence and Simulation (CHIPS-AIS) is a two-year mixed-methods study that addresses a critical need in nursing education by improving fairness, reducing bias, and strengthening reliability in clinical faculty assessment of students. Clinical faculty assessment is a high-stakes determinant of student progression in nursing and medical education, yet remains vulnerable to inconsistency and bias. Variability in scoring may be influenced by student presentation characteristics, even when clinical performance is equivalent. While prior work has examined bias related to race and ethnicity, there is limited evidence addressing weight bias, neurodivergent communication, and English language learner (ELL) presentation in clinical evaluation. Using standardized simulation, AI-guided conversation calibration and faculty expert-led debriefing, the project equips clinical faculty to deliver more consistent, evidence-based evaluation.
PI: Larissa Miller, PhD, RN, MSN, CNE, NPD-BC, CS, Assistant Professor of Nursing
Timeline
| January 7, 2026 | Application portal opens |
| March 30, 2026 | Last day of acceptance for letters of intent |
| May 18, 2026 | 6-8 projects invited to submit full Board Grant applications |
| July 17, 2026 | Full Board Grant applications due |
| Summer 2026 | Final review |
| October 21, 2026 | 3 projects brought to the Macy Foundation Board |
Project period: November 1, 2026-October 31, 2028
Important Information
Harmful bias and discrimination in learner assessment was the focus of the Josiah Macy Jr. Foundation’s 2022 conference, entitled Ensuring Fairness in Medical Education Assessment. The purpose of both the conference and its resulting consensus recommendations was to address documented bias and discrimination in assessment that impede learners’ opportunities to fulfill their potential as health professionals and, ultimately, improve quality of care for all patients. In addition, the importance of developing new systems of assessment aligns with the increasing emergence of competency-based educational frameworks in medicine and nursing education, which require new assessment programs and practices. Building on the Macy conference, there has been additional important scholarship on what this next era of assessment might look like, which has provided useful ideas for how to advance equitable and valuable assessment for learners.
The goal of this RFA is to provide support to projects who advance assessment approaches which empower learners to understand their own unique learning needs, position them as lifelong learners, and keep them focused on achieving the ultimate goal of their health professions education: namely, to provide the highest quality of care for their patients.
The Josiah Macy Jr. Foundation proposes to support three innovative projects in medicine or nursing education programs. Each project would receive $200,000 over two years to design, implement, and evaluate innovative learner assessment programs aligned with the 2022 Macy Conference recommendations and additional scholarship in this field. This includes the use of data, learning analytics, and technology to develop and advance systems-based assessment approaches that ensure fairness for physicians and nurses in training.
This RFA is open to schools of medicine and nursing (both undergraduate and graduate). Projects should focus on interventions in the clinical learning environment, and should align with recommendations emanating from the 2022 Macy conference and/or align with additional scholarship in the field of the future of assessment. Collaborations across institutions and departments are strongly encouraged to support spread and replicability, as is co-creation with learners.
Q. Who is eligible to apply?
A. We welcome applications from faculty at medical and nursing schools (both at the undergraduate and graduate levels). Practitioners based at teaching hospitals who are in a role to assess learners in the clinical environment may also apply. While a learner may not serve as the sole principal investigator on a project, we encourage co-creation with learners as co-PIs or co-investigators.
Q. Is this a limited opportunity, or may an institution submit multiple LOIs?
A. This is not a limited opportunity. We will accept multiple LOIs from a single institution.
Q. What are the consensus recommendations from the 2022 Macy conference?
A. The five consensus recommendations from the 2022 Macy conference are available in the August 2023 special supplement of Academic Medicine.
Leaders of the Macy Foundation and the 2022 conference discuss these recommendations in greater detail in an August 2023 webinar hosted by the Macy Foundation, and during a September 2023 podcast hosted by the AAMC. Links to all 2022 conference-related content is available on the Macy Foundation website.
Q. What are you looking for in successful proposals?
A. We will consider many factors as we review proposals. These factors include:
- Alignment with the recommendations emanating from the 2022 Macy conference and/or clear alignment with recent scholarship in the field of assessment
- Focus on assessment in the clinical learning environment
- Alignment of budget with programmatic goals
- Evidence of co-creation with learners
- Collaboration across institutions and departments considered favorably
Q. Is the $200K award inclusive of indirect costs?
A. Yes – proposed budgets may not exceed $200K over the two-year award period, including all indirect costs, capped at 10%.
