In order to conduct translational science, scientists must combine domain-specific expertise with knowledge on how to identify and cross translational hurdles, and insights on positioning discoveries for the next translational stage. Expert educators from the Clinical and Translational Science Awards (CTSA) Consortium identified 97 knowledge, skills, and abilities (KSAs) important to include in training programs for translational scientists. To assist educators and trainees to use these KSAs, a conceptual model called “Personalized Pathways” was developed that prioritizes KSAs based on trainee background, research area, or phenotype, and expertise on the research team.

To understand how CTSA educators prioritize specific KSAs when developing personalized training plans for different translational phenotypes and to identify areas of similarity and difference across phenotypes.

A web-based, cross-sectional survey of CTSA educators was done. For a selected phenotype, respondents recommended one of four levels of mastery for each of the 97 KSAs. Results were tabulated by frequency, weighted by importance, and divided into tertiles representing high, middle, and lower priority KSAs. Agreement across phenotypes was compared using Krippendorff’s alpha.

Ten KSAs were high training priority for Preclinical, Clinical, and Community-Engaged phenotypes. These address research methods, responsible conduct of research, team building, and communicating research results. Nine KSAs were in the next tertile for priority reflecting KSAs in biostatistics, bioinformatics, regulatory precepts, and translating implications of research findings.

A smaller set of KSAs can be prioritized for training Preclinical-, Clinical-, and Community-Engaged researchers. Future work should explore this approach for other phenotypes.

Research Electronic Data Capture (REDCap) is a secure, web-based electronic data capture application for building and managing surveys and databases. It can also be used for study management, data transfer, and data export into a variety of statistical programs. REDcap was developed and supported by the National Center for Advancing Translational Sciences Program and is used in over 3700 institutions worldwide. It can also be used to track and measure stakeholder engagement, an integral element of research funded by the Patient-Centered Outcomes Research Institute (PCORI). Continuously and accurately tracking and reporting on stakeholder engagement activities throughout the life of a PCORI-funded trial can be challenging, particularly in complex trials with multiple types of engagement.

In this paper, we show our approach for collecting and capturing stakeholder engagement activities using a shareable REDCap tool in one of the PCORI’s first large pragmatic clinical trials (the Comprehensive Post-Acute Stroke Services) to inform other investigators planning cluster-randomized pragmatic trials. Benefits and challenges are highlighted for researchers seeking to consistently monitor and measure stakeholder engagement.

We describe how REDCap can provide a time-saving approach to capturing how stakeholders engage in a PCORI-funded study and reporting how stakeholders influenced the study in progress reports back to PCORI.

Scientific quality and feasibility are part of ethics review by Institutional Review Boards (IRBs). Scientific Review Committees (SRCs) were proposed to facilitate this assessment by the Clinical and Translational Science Award (CTSA) SRC Consensus Group. This study assessed SRC feasibility and impact at CTSA-affiliated academic health centers (AHCs).

SRC implementation at 10 AHCs was assessed pre/post-intervention using quantitative and qualitative methods. Pre-intervention, four AHCs had no SRC, and six had at least one SRC needing modifications to better align with Consensus Group recommendations.

Facilitators of successful SRC implementation included broad-based communication, an external motivator, senior-level support, and committed SRC reviewers. Barriers included limited resources and staffing, variable local mandates, limited SRC authority, lack of anticipated benefit, and operational challenges. Research protocol quality did not differ significantly between study periods, but respondents suggested positive effects. During intervention, median total review duration did not lengthen for the 40% of protocols approved within 3 weeks. For the 60% under review after 3 weeks, review was lengthened primarily due to longer IRB review for SRC-reviewed protocols. Site interviews recommended designing locally effective SRC processes, building buy-in by communication or by mandate, allowing time for planning and sharing best practices, and connecting SRC and IRB procedures.

The CTSA SRC Consensus Group recommendations appear feasible. Although not conclusive in this relatively short initial implementation, sites perceived positive impact by SRCs on study quality. Optimal benefit will require local or federal mandate for implementation, adapting processes to local contexts, and employing SRC stipulations.

Audits play a critical role in maintaining the integrity of observational cohort data. While previous work has validated the audit process, sending trained auditors to sites (“travel-audits”) can be costly. We investigate the efficacy of training sites to conduct “self-audits.”

In 2017, eight research groups in the Caribbean, Central, and South America network for HIV Epidemiology each audited a subset of their patient records randomly selected by the data coordinating center at Vanderbilt. Designated investigators at each site compared abstracted research data to the original clinical source documents and captured audit findings electronically. Additionally, two Vanderbilt investigators performed on-site travel-audits at three randomly selected sites (one adult and two pediatric) in late summer 2017.

Self- and travel-auditors, respectively, reported that 93% and 92% of 8919 data entries, captured across 28 unique clinical variables on 65 patients, were entered correctly. Across all entries, 8409 (94%) received the same assessment from self- and travel-auditors (7988 correct and 421 incorrect). Of 421 entries mutually assessed as “incorrect,” 304 (82%) were corrected by both self- and travel-auditors and 250 of these (72%) received the same corrections. Reason for changing antiretroviral therapy (ART) regimen, ART end date, viral load value, CD4%, and HIV diagnosis date had the most mismatched corrections.

With similar overall error rates, findings suggest that data audits conducted by trained local investigators could provide an alternative to on-site audits by external auditors to ensure continued data quality. However, discrepancies observed between corrections illustrate challenges in determining correct values even with audits.

Shared patient–clinician decision-making is central to choosing between medical treatments. Decision support tools can have an important role to play in these decisions. We developed a decision support tool for deciding between nonsurgical treatment and surgical total knee replacement for patients with severe knee osteoarthritis. The tool aims to provide likely outcomes of alternative treatments based on predictive models using patient-specific characteristics. To make those models relevant to patients with knee osteoarthritis and their clinicians, we involved patients, family members, patient advocates, clinicians, and researchers as stakeholders in creating the models.

Stakeholders were recruited through local arthritis research, advocacy, and clinical organizations. After being provided with brief methodological education sessions, stakeholder views were solicited through quarterly patient or clinician stakeholder panel meetings and incorporated into all aspects of the project.

Participating in each aspect of the research from determining the outcomes of interest to providing input on the design of the user interface displaying outcome predications, 86% (12/14) of stakeholders remained engaged throughout the project. Stakeholder engagement ensured that the prediction models that form the basis of the Knee Osteoarthritis Mathematical Equipoise Tool and its user interface were relevant for patient–clinician shared decision-making.

Methodological research has the opportunity to benefit from stakeholder engagement by ensuring that the perspectives of those most impacted by the results are involved in study design and conduct. While additional planning and investments in maintaining stakeholder knowledge and trust may be needed, they are offset by the valuable insights gained.