Hostname: page-component-cd9895bd7-8ctnn Total loading time: 0 Render date: 2024-12-25T19:45:06.420Z Has data issue: false hasContentIssue false
  • English
  • Français

Effective early warning systems for new and emerging health technologies: Developing an evaluation framework and an assessment of current systems

Published online by Cambridge University Press:  19 June 2007

Kieran Murphy ,
Claire Packer ,
Andrew Stevens  and
Sue Simpson
Kieran Murphy
Affiliation:
The University of Birmingham
Claire Packer
Affiliation:
The University of Birmingham
Andrew Stevens
Affiliation:
The University of Birmingham
Sue Simpson
Affiliation:
The University of Birmingham
Get access Rights & Permissions [Opens in a new window]

Abstract

Objectives: The aim of this study was to define an effective early warning system, to identify and rank the characteristics of an effective early warning system for emerging health technologies, and to evaluate current early warning systems against these characteristics.

Methods: An iterative Delphi-type process with the thirteen members of the International Information Network on New and Changing Health Technologies (EuroScan). We synthesized key characteristics that network members had graded. Members were then asked whether these characteristics were present or fulfilled in their system.

Results: The definition of an effective early warning system developed was the following: a system that identifies innovations in the field of health technology likely to have a significant impact; and disseminates information relevant to the needs of the customer which is timely, so as to enable appropriate decision making (such as resource allocation), facilitate appropriate adoption, and identify further research requirements. Five primary and eleven secondary components of effective early warning systems were identified. The five primary characteristics concerned relevance, independence, resourcing, a clear pathway for the outputs to reach decision makers, and defined customers. Although the primary characteristics were present or fulfilled to some extent in the majority of evaluated early warning systems, there was considerable variability in the presence of the secondary characteristics in the evaluated systems.

Conclusions: Our study provides a definition for an effective early warning system and a shared understanding of the important characteristics and components of such systems. This work should provide guidance to those setting up new early warning systems as well as for those managing and reviewing current systems.

Keywords

Health technology assessmentOrganizational efficiencyEarly warning systemsHorizon scanning
Type
GENERAL ESSAYS
Information
International Journal of Technology Assessment in Health Care , Volume 23 , Issue 3 , July 2007 , pp. 324 - 330
Copyright
© 2007 Cambridge University Press

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Hailey D. 2003. Elements of effectiveness for health technology assessment programs. HTA Initiative #9. Edmonton, Alberta: Alberta Heritage Foundation for Medical Research;
Robert G, Stevens A, Gabbay J. 1999 Early warning systems' for identifying new healthcare technologies. Health Technol Assess. 3: 1– 108.Google Scholar
Simpson S, Carlsson P, Douw K, Packer C. 2002. A comparative analysis of early warning systems demonstrates differences in methods and structure: A survey of EuroScan member agencies. Proceedings of the 18th Annual Meeting of the International Society of Technology Assessment in Health Care. Germany: Urban & Fischer;
Simpson S, Hyde C, Cook A, Packer C, Stevens A. 2003 Assessing the accuracy of forecasting: Applying standard diagnostic assessment tools to a health technology early warning system. Int J Technol Assess Health Care. 20: 381– 384.Google Scholar
Wanke M, Juzwishin D, Thornley R, Chan L. 2006. An exploratory review of evaluation of health technology assessment agencies. HTA Initiative #16. Edmonton, Alberta: Alberta Heritage Foundation for Medical Research;