Evaluating clinical and translational research (CTR) mentored training programs is challenging because no two programs are alike. Careful selection of appropriate metrics is required to make valid comparisons between individuals and between programs. The KL2 program provides mentored-training for early-stage CTR investigators. Clinical and Translational Awards across the country have unique KL2 programs. The evaluation of KL2 programs has begun to incorporate bibliometrics to measure KL2 scholar and program impact.

This study investigated demographic differences in bibliometric performance and post-K award funding of KL2 scholars and compared the bibliometric performance and post-K award federal funding of KL2 scholars and other mentored-K awardees at the same institution. Data for this study included SciVal and iCite bibliometrics and National Institutions of Health RePORTER grant information for mentored-K awardees (K08, K23, and KL2) at Case Western Reserve University between 2005 and 2013.

Results showed no demographics differences within the KL2 program scholars. Bibliometric differences between KL2 and other mentored-K awardee indicated an initial KL2 advantage for the number of publications at 5 years’ post-matriculation (i.e., the start of the K award). Regression analyses indicated the number of initial publications was a significant predictor of federal grant funding at the same time point. Analysis beyond the 5-year post-matriculation point did not result in a sustained, significant KL2 advantage.

Factors that contributed to the grant funding advantage need to be determined. Additionally, differences between translational and clinical bibliometrics must be interpreted with caution, and appropriate metrics for translational science must be established.

High impact biomedical research is increasingly conducted by large, transdisciplinary, multisite teams in an increasingly collaborative environment. Thriving in this environment requires robust teamwork skills, which are not acquired automatically in the course of traditional scientific education. Team science skills training does exist, but most is directed at clinical care teams, not research teams, and little is focused on the specific training needs of early-career investigators, whose early team leadership experiences may shape their career trajectories positively or negatively. Our research indicated a need for team science training designed specifically for early-career investigators.

To address this need, we designed and delivered a 2-day workshop focused on teaching team science skills to early-career investigators. We operationalized team science competencies, sought the advice of team science experts, and performed a needs assessment composed of a survey and a qualitative study. Through these multiple approaches, we identified and grouped training priorities into three broad training areas and developed four robust, hands-on workshop sessions.

Attendees comprised 30 pre- and post-doc fellows (TL1) and early-career faculty (KL2 and K12). We assessed impact with a pre- and post-workshop survey adapted from the Team Skills Scale. Results from the pre- and post-test Wilcoxon signed-rank analysis (n = 25) showed statistically significant improvement in team science skills and confidence. Open-ended responses indicated that the workshop focus was appropriate and well targeted to the trainees’ needs.

Although team science education is still very much in its infancy, these results suggest that training targeted to early-career investigators improves team skills and may foster improved collaboration.

The Rockefeller Clinical Scholars (KL2) program began in 1976 and transitioned into a 3-year Master’s degree program in 2006 when Rockefeller joined the National Institute of Health Clinical and Translational Science Award program. The program consists of ∼15 trainees supported by the Clinical and Translational Science Award KL2 award and University funds. It is designed to provide an optimal environment for junior translational investigators to develop team science and leadership skills by designing and performing a human subjects protocol under the supervision of a distinguished senior investigator mentor and a team of content expert educators. This is complemented by a tutorial focused on important translational skills.

Since 2006, 40 Clinical Scholars have graduated from the programs and gone on to careers in academia (72%), government service (5%), industry (15%), and private medical practice (3%); 2 (5%) remain in training programs; 39/40 remain in translational research careers with 23 National Institute of Health awards totaling $23 million, foundation and philanthropic support of $20.3 million, and foreign government and foundation support of $6 million. They have made wide ranging scientific discoveries and have endeavored to translate those discoveries into improved human health.

The Rockefeller Clinical Scholars (KL2) program provides one model for translational science training.

The National Clinical and Translational Science Award (CTSA) Consortium 2.0 has developed common metrics as a collaborative project for all participating sites. Metrics address several important aspects and functions of the consortium, including workforce development. The first workforce development metrics to be proposed for all CTSA hubs include the proportion of CTSA-supported trainees and scholars with sustainable careers in translational research and the diversity and inclusiveness of programs.

The University of Utah Center for Clinical and Translational Science (CCTS), a CTSA hub, has been actively engaged in mentoring translational scientists for the last decade. We have developed programs, processes, and institutional policies that support translational scientists, which have resulted in 100% of our KL2 scholars remaining engaged in translational science and in increasing the inclusion of individuals under-represented in medicine in our research enterprise. In this paper, we share details of our program and what we believe are evidence-based best practices for developing sustainable translational research careers for all aspiring junior faculty members.

The University of Utah Center for Clinical and Translational Science has been integral in catalyzing interactions across the campus to reverse the negative trends seen nationally in sustaining clinician scientists. Our programs and processes can serve as a model for other institutions seeking to develop translational scientists.