234 Understanding the utility of an evaluation instrument and a feedback mechanism in community-based participatory research (CBPR) partnerships

Abstract

OBJECTIVES/GOALS: To examine i) how longstanding (≥6 years) community-based participatory research (CBPR) partnerships nationwide implemented a validated questionnaire to measure success and its contributing factors and ii) how the CBPR partnerships utilized and applied a feedback mechanism, or reports of findings from the questionnaire and a facilitation guide METHODS/STUDY POPULATION: This mixed methods study builds upon a larger NIH-funded project entitled ’Measurement Approaches to Partnership Success (MAPS). MAPS developed and validated the 109-item MAPS questionnaire to measure success in longstanding (≥6 years) CBPR partnerships. In 2020, 55 CBPR partnerships nationwide completed the MAPS Questionnaire and, a year later, received the MAPS Feedback Mechanism, consisting of questionnaire findings and a facilitation guide on how to present the findings. In this follow-up study, we administered multi-method surveys to each partnership contact person in 2022 to examine their experience with and utility of the MAPS Questionnaire and the MAPS Feedback mechanism. We performed descriptive analysis of quantitative responses using SAS and thematic analysis of qualitative responses. RESULTS/ANTICIPATED RESULTS: Survey responses have been presently collected from 14 partnerships. Preliminary findings suggest that the most frequently reported benefits of completing the MAPS Questionnaire included stimulating partnership reflections and ease of completion. Many partnerships shared results of the MAPS Questionnaire by e-mail or during partnership meetings. Nearly half of the partnerships rated components of the MAPS feedback mechanism as useful. Over one-third of the partnerships reported that the COVID pandemic limited their capacity to engage with the MAPS Feedback Mechanism. Key qualitative suggestions included making the MAPS Questionnaire shorter, providing it in a different format, and offering additional facilitation to support the implementation of the MAPS Feedback Mechanism. DISCUSSION/SIGNIFICANCE: This study examines how CBPR partnerships utilize an evaluation instrument and apply results on success. Current findings suggest potential utility of the MAPS Questionnaire and Feedback Mechanism for ongoing evaluation. Reducing the questionnaire length and providing facilitation resources may enhance implementation across diverse settings.