Introduction
In the United States, HIV and COVID-19 disproportionately affect minoritized populations (Earnshaw et al., Reference Earnshaw, Bogart, Dovidio and Williams2013; Khanijahani et al., Reference Khanijahani, Iezadi, Gholipour, Azami-Aghdash and Naghibi2021). Yet, many primary care practitioners (PCPs) do not have the capacity to meet the dynamic needs of these patient populations. To address this, we sought funding to develop training to expand PCPs’ capacity to make culturally responsive recommendations for HIV and COVID-19 vaccination screenings. To increase trainings’ efficacy and value, we involved a variety of experts. As we looked to convene a deliberately curated National Advisory Board (NAB), we found some guidance on structures and processes, but no case studies of their use in primary care research to guide us. In this Short Report, we share our experiences applying two frameworks for scientific advisory committees to our national training efforts (Hoffman et al., Reference Hoffman, Ottersen, Tejpar, Baral and Fafard2018; Courtney et al., Reference Courtney, Hartley, Rosswurm, LeBlanc and Lund2021).
Background
When we began, the COVID-19 pandemic had laid bare structural inequities making racial, ethnic, sexual, and gender-minoritized communities more vulnerable to severe illness and death (Ward, Reference Ward2023a). Yet, media narratives laid the blame on these communities, dubbing them ‘vaccine-hesitant’, despite overwhelming evidence that, for instance, Asian, Hispanic, and Native Americans had higher vaccination rates than White populations (Chowkwanyun and Reed, Reference Chowkwanyun and Reed2020; Satcher Health Leadership Institute, 2021). Meanwhile, the ongoing HIV pandemic continued to disproportionately affect these same communities, illuminating the role poverty and disparate access to healthcare and quality housing play in poor health outcomes (Grey, Reference Grey2021). These structural inequities are exacerbated by generational trauma, medical mistrust, racism, homophobia, transphobia, and ongoing discrimination contributing to misinformation, fear, and stigma around the prevention, spread, and treatment of both viruses (Kendi, Reference Kendi2020). Meanwhile, we witnessed a sole focus on COVID-19 prevention contributing to less attention to HIV prevention.
Thus, we created the ‘Two in One: HIV + COVID-19 Screening and Testing Model’ to improve PCPs’ capacity to routinize HIV, pre-exposure prophylaxis and post-exposure prophylaxis (PrEP/PEP), and COVID-19 vaccine screenings for all their patients while relying on culturally responsive communication with their minoritized patients (Ward, Reference Ward2023b). PCPs must be adequately prepared to address the ongoing threats to racial and health equity ( Healthy People 2030, no date), yet many are not (Hoover et al., Reference Hoover, Huang, Tanner, Zhu, Gathua, Pitasi, DiNenno, Nair and Delaney2020). For instance, despite the 2006 CDC recommendation for opt-out HIV testing for those between the ages of 13 and 64 (Centers for Disease Control and Prevention, 2022), many PCPs continue to test sporadically and only based on perceived risk, even while testing in community health centers and emergency departments remains on the rise (Hoover et al., Reference Hoover, Huang, Tanner, Zhu, Gathua, Pitasi, DiNenno, Nair and Delaney2020).
To approach our monumental task – researching the experiences of minoritized patients with COVID-19 and HIV primary care, developing nine national webinar training based on this research, and creating a permanent online course offering Continuing Medical Education credit – we decided to create a NAB. We looked to the literature on advisory boards but found few scholars publishing on this critical part of the research process: most were drawn from local communities rather than a national one, and none of it was in primary care research. The literature we did find, however, argued for the important role of advisory boards. The types ranged from community advisory boards, Scientific Advisory Boards, and Scientific Advisory Committees to Expert Advisory Boards (we refer throughout to ‘NABs’). For instance, Courtney and colleagues call advisory boards a ‘critical instrument of governance’ (Courtney et al., Reference Courtney, Hartley, Rosswurm, LeBlanc and Lund2021: p.254). They provide the expertise of experience, both positive and negative, and can be used to leverage the cooperation of the community involved. They are also ideal problem-solving tools because there are no predetermined formal procedures constraining them, its members can focus directly and solely on the issues they were created to address (Reiter, Reference Reiter2003).
Yet, advisory boards are not guaranteed to be successful. They must be deliberately structured and its members need support. Rapattoni (Reference Rapattoni2008) noted the importance of frequent meetings to maintain retention, of creating a safe environment in meetings where members can speak freely without criticism, and of holding members accountable to the project’s aims to ensure the board’s integrity that it is also important for NAB members to be engaged in some of the work of the project to increase a sense of buy-in. Further, in order to best support the project, board members need training regarding their specific functions on the board (Ripley, Cummings, and Lockett, Reference Ripley, Cummings and Lockett2012).
Hoffman and colleagues offer a framework to generate successful boards (and, in turn, successful projects) that involves 6 stages: (1) Initial establishment, (2) Member selection, (3) Advice Generation, (4) Advice Delivery, (5) Advice Implementation, and (6) Monitoring and Evaluation, providing guidelines and clear determinants of effectiveness for each of these stages (Hoffman et al., Reference Hoffman, Ottersen, Tejpar, Baral and Fafard2018). Additionally, Courtney and colleagues provide critical suggestions for engaging NAB members (Courtney et al., Reference Courtney, Hartley, Rosswurm, LeBlanc and Lund2021). The purpose of this Short Report is to demonstrate how our application of Hoffman et al.’s and Courtney et al.’s approaches strengthened our work and the implications this has for others doing research in primary care.
Approach
We followed Hoffman and colleagues’ framework through each of the six stages as we developed, worked with, and evaluated our NAB. First, to establish the committee, the core research team consisting of the primary investigator (PI) and all co-investigators (Co-I’s) met to talk about project needs and challenges. This group determined that we needed expertise in the following areas: HIV and COVID-19 patient populations, primary care, HBCU pipeline programs, minoritized populations, racial/health equity, and student/trainee populations. Moreover, we wanted lived expertise from these communities of interest. Based on our required areas of expertise, we sent invitations for participation in the NAB to health professionals across the United States.
Second, after reaching out to 29 potential members, we selected our NAB. The final board was established with 11 participating members, composed of one gender non-conforming person, five women, and five men with expertise across our desired areas. Per Hoffman et al. ’s suggestion, we took a democratic approach to committee selection (the core team decided on membership together) and carefully managed conflict of interest (eg, some board members turned down the honorarium since they were part of the federal government).
Third, we began the process of generating advice. The NAB met five times across the grant period (see Table 1), each session strategically scheduled at a key juncture in the project when the core team needed advice. As Hoffman et al. suggest, we offered clear guidance for making decisions. We sent introductory emails out with expectations for the board (eg, attending all meetings, and brief meeting preparation in some cases). Further, we had structured agendas for each meeting and shared minutes of meetings with all members. Cognizant of our NAB members’ limited time, we presented project updates in easily accessible and brief presentations, only focusing on the evidence they would need to make the decisions we were asking for at that point in the grant. Rather than a formal vote, we asked each NAB member to weigh in separately, as consensus methods can stifle some voices.
Fourth, advice about our trainings was delivered through the NAB meetings themselves, which were recorded and transcribed. This gave team members access not only to members’ opinions and decisions but to the dialogic process that they used to reach them. Further, the PI communicated regularly with NAB board members over email and, when requested, individual meetings. These emails and meetings not only offered further clarification of member positions but were also opportunities for them to share resources (eg, literature, similar programs, contacts in the field), for the PI to build relationships, and to develop writing partnerships. All data (recordings, transcriptions, and emails) were kept private and were only accessible by the PIs, Co-I’s, and the research assistants.
Fifth, advice implementation was dialogic and emergent. Since team members were often weighing different opinions and resources, the team used its weekly meetings to debrief and discuss NAB advice and team impressions of its utility, feasibility, and importance. Implementation proceeded in an emergent fashion: after applying each piece of advice in the research or trainings, the team discussed its success and next steps for building on the results, often bringing back other NAB advice to take a different approach.
Sixth, we monitored the work of the NAB across the 18-month project, seeking both NAB and core team members’ experiences of the work and how it could be improved. We report on the methods and results of this evaluation below.
Finally, following Courtney and colleagues, we attempted throughout the process to engage NAB members in the work of the project. We partnered with them on writing policy, research, and commentary pieces and co-presented with them at conferences.
Evaluation methods
To evaluate the effectiveness of the approach above (after receiving an IRB ‘exempt’ status), we gathered metrics on engagement throughout the program period such as the number of NAB members who attended meetings, contributed to publications, and co-authored presentations. We also anonymously surveyed NAB members about their experiences at the project midpoint, and gathered focus group feedback at the end. The electronic survey included nine Likert-scale items that cut across four areas including advice generation, monitoring and evaluation, initial establishment, and advice delivery. The focus group took place as breakouts during a virtual meeting and included four open-ended questions such as, ‘What was the most meaningful way you felt you contributed to our success?’ We analyzed the survey using descriptive statistics and analyzed the focus groups relying on themes.
Results
Engagement with some board members was high: For instance, the core team co-presented research with two members, published articles with four members, and involved ten members directly in creation of our training materials (either recording one of our training or recruitment videos or developing content for the online course). Yet several NAB members did not respond to our invitations, only communicating during scheduled meetings and even missing some of those.
On the mid-project survey (response rate: 91%, 10 respondents/11, after accounting for one person who seems to have responded twice), most participants (91%–100%) agreed or strongly agreed that their expertise was valued and they had time and space to share their advice. One participant disagreed but did not leave open-ended comments explaining their experience.
In focus groups (of 3–4 members in three small groups), 11 NAB members were proud of the media and academic reach of the project and found participation in publications and conferences particularly personally meaningful. Members suggested even greater future engagement, including a retreat, more individual consultations, and engaging every member in at least one publication.
Discussion
Following existing frameworks for advisory boards, we not only generated actionable and useful advice for our NAB but also engaged with board members to create some ongoing research and advocacy partnerships. We found this reciprocity of engagement important so that, like the work itself, our NAB interactions reflected our values of social justice and community engagement.
We offer several promising practices. First, while board members and the board leader participated in meetings, we struggled to follow Courtney et al.’s advice for deeper engagement due to their varying capacity and professional commitments (Courtney et al., Reference Courtney, Hartley, Rosswurm, LeBlanc and Lund2021). Yet, even their participation in meetings was critical, so as we continue this research, we plan to offer deeper engagement to each member, but not require it, and to identify a board member to support the PI.
Second, we were not able to identify the single board member who was dissatisfied. In future projects, we will have one-on-one meetings with NAB members at the midpoint to diagnose potential issues while we can still ameliorate them.
Finally, while we recognize that many doing research in primary care do not have the funding to compensate NAB members as we did, we felt this was a critical part of their work. We believe fair compensation is an equity issue and urge research funders to consider supporting NABs.
For others considering using NABs to guide primary care research, we recommend both Courtney et al.’s emphasis on engagement3 and Hoffman et al.’s framework (Hoffman et al., Reference Hoffman, Ottersen, Tejpar, Baral and Fafard2018; Courtney et al., Reference Courtney, Hartley, Rosswurm, LeBlanc and Lund2021). As the latter note, ‘good evidence alone is an insufficient basis for good policymaking…science cannot operate in a silo and must take into consideration the larger normative concerns facing policymakers’ (Hoffman et al., Reference Hoffman, Ottersen, Tejpar, Baral and Fafard2018: p.1). Engaging a NAB in this important effort helped us to step outside of this silo and create community and expert-informed, relevant, timely, and useful trainings to combat structural inequities in COVID-19 and HIV prevention.
Acknowledgements
We want to thank all of the NAB members as well as all of Two in One core team members and Co-Is for their contributions to this important work.
Funding statement
This work was supported by Gilead Sciences, Inc. under Grant #83-12357
Competing interests
None.
Ethical standards
The authors assert that all procedures contributing to this work comply with the ethical standards of the relevant national and institutional guidelines on human experimentation (The Belmont Report and Title 45 Code of Federal Regulations, Part 46) and with the Helsinki Declaration of 1975, as revised in 2008. No laboratory animals were involved in this work.