Objectives: The aim of this report was to assess the clinical effectiveness of two Gene expression profiling (GEP) and two expanded immunohistochemistry (IHC) tests compared with current prognostic tools in guiding the use of adjuvant chemotherapy in patients with early breast cancer.

Methods: A systematic review of the evidence on clinical effectiveness of OncotypeDX, IHC4, MammaPrint, and Mammostrat, compared with current clinical practice using clinicopathological parameters, in women with early breast cancer was conducted. Ten databases were searched to include citations to May 2016.

Results: Searches identified 7,064 citations, of which forty-one citations satisfied the criteria for the review. A narrative synthesis was performed. Evidence for OncotypeDX demonstrated the impact of the test on decision making and there was some support for OncotypeDX predicting chemotherapy benefit. There were relatively lower levels of evidence for the other three tests included in the analysis. MammaPrint, Mammostrat, and IHC4 tests were limited to a small number of studies. Limitations in relation to study design were identified for all tests.

Conclusions: The evidence base for OncotypeDX is considered to be the most robust. Methodological weaknesses relating to heterogeneity of patient cohorts and issues arising from the retrospective nature of the evidence were identified. Further evidence is required for all of the tests using prospective randomized controlled trial data.

Objectives: The reduction in cognitive decline depends on timely diagnosis. The aim of this systematic review was to analyze the current available information and communication technologies-based instruments for cognitive decline early screening and detection in terms of usability, validity, and reliability.

Methods: Electronic searches identified 1,785 articles of which thirty-four met the inclusion criteria and were grouped according to their main purpose into test batteries, measures of isolated tasks, behavioral measures, and diagnostic tools.

Results: Thirty one instruments were analyzed. Fifty-two percent were personal computer based, 26 percent tablet, 13 percent laptop, and 1 was mobile phone based. The most common input method was touchscreen (48 percent). The instruments were validated with a total of 4,307 participants: 2,146 were healthy older adults (M = 73.59; SD = 5.12), 1,104 had dementia (M = 74.65; SD = 3.98) and 1,057 mild cognitive impairment (M = 74.84; SD = 4.46). Only 6 percent were administered at home, 19 percent reported outcomes about usability, and 22 percent about understandability. The methodological quality of the studies was good, the weakest methodological area being usability. Most of the instruments obtained acceptable values of specificity and sensitivity.

Conclusions: It is necessary to create home delivered instruments and to include usability studies in their design. Involvement of people with cognitive decline in all phases of the development process is of great importance to obtain valuable and user-friendly products. It would be advisable for researchers to make an effort to provide cutoff points for their instruments.

Objectives: The aim of this study was to assess viewpoints of end-users concerning the purchasing process of high-risk medical devices and to discuss the relevance of health technology assessments (HTAs) at the hospital level and other potential areas for improvement of purchasing processes.

Methods: We used a cross-sectional study and assessed the attitudes and thoughts of orthopedic specialists. The study took place between June and October 2015 in Mexico.

Results: We collected data from 187 orthopedic surgeons. Involvement of orthopedic specialists in purchasing was reported by 86 percent. However, clinical practice was perceived as negatively influenced by purchasing outcomes by 92 percent. The problems were described as: material failure; effectiveness of medical devices; obsolete medical device technology; incomplete provision of implant / instrument sets; delayed provision of implants and instruments.

Conclusions: To prevent sub-standard outcomes of purchasing decisions, this study and the current literature suggest that technologies should be assessed during the purchasing process, end-users should be adequately involved, and decisions should be based on multiple criteria including clinical impact in the short-term (e.g., primary stability of implant) and long-term (e.g., survival of implant). The focus on Mexico is particularly novel and provides insights into a health system where HTA is mainly present at the macro level and can be used for the listing of medical device technologies in the standard list. This study concludes that Mexican stakeholders of the purchasing process underestimate the contribution of HTAs at the level of purchasing decisions. HTA in Mexico has improved over the past years but still requires more advancement.

Objectives: A comprehensive health technology assessment (HTA) enables a patient-centered assessment of the effectiveness, economic, ethical, socio-cultural, and legal issues of health technologies that takes context and implementation into account. A question is whether these various pieces of evidence need to be integrated, and if so, how that might be achieved. The objective of our study is to discuss the meaning of integration in the context of HTA and suggest how it may be achieved in a more structured way.

Methods: An analysis of the concept of integration in the context of HTA and a review of approaches that were adopted in the INTEGRATE-HTA project that may support integration.

Results: Current approaches to integration in HTA are mainly methods of commensuration, which are not optimally geared to support public deliberation. In contrast, articulating evaluative frameworks could be an important means of integration which allows for exploring how facts and values can be brought to bear on each other.

Conclusions: Integration is not something that only needs to be addressed at the end, but rather throughout an HTA, right from the start. Integration can be conceived as a matter of accounting for the relevance of empirical evidence in view of a commitment to a set of potentially conflicting values. Various elements of the INTEGRATE-HTA project, such as scoping and the development of logic models, can help to achieve integration in HTA.

Objectives: Several studies have reported multiple barriers to and facilitators for the uptake of health technology assessment (HTA) information by policy makers. This study elicited, using best-worst scaling (BWS), the most important barriers and facilitators and their relative weight in the use of HTA by policy makers.

Methods: Two BWS object case surveys (one for barriers, one for facilitators) were conducted among sixteen policy makers and thirty-three HTA experts in the Netherlands. A list of twenty-two barriers and nineteen facilitators was included. In each choice task, participants were asked to choose the most important and the least important barrier/facilitator from a set of five. We used Hierarchical Bayes modeling to generate the mean relative importance score (RIS) for each factor and a subgroup analysis was conducted to assess differences between policy makers and HTA experts.

Results: The five most important barriers (RIS > 6.00) were “no explicit framework for decision-making process,” “insufficient support by stakeholders,” “lack of support,” “limited generalizability,” and “absence of appropriate incentives.” The six most important facilitators were: “availability of explicit framework for decision making,” “sufficient support by stakeholders,” “appropriate incentives,” “sufficient quality,” “sufficient awareness,” and “sufficient support within the organization.” Overall, perceptions did not differ markedly between policy makers and HTA experts.

Conclusions: Our study suggests that barriers and facilitators related to “policy characteristics” and “organization and resources” were particularly important. It is important to stimulate a pulse at the national level to create an explicit framework for including HTA in the decision-making context.

Background: There is growing trend for some surgical procedures previously performed in hospitals to be done in alternative settings, including office-based facilities. There has been some safety concerns reported in the media, which document serious adverse events following procedures performed in an office-based setting. To understand the current regulatory oversight of surgery in this setting ASERNIP-S conducted a review of the legislative and accreditation process governing these facilities in Australia.

Methods: Using rapid review methodology, internet searches targeted government Web sites for relevant publicly-available documents. Use of consolidated versions of legislative instruments ensured currency of information. Standards were sourced directly from the issuing authorities or those that oversee the accreditation process.

Results: Within Australia, healthcare facilities for surgery and their licensing are defined by each state and territory, which results in significant jurisdictional variation. These variations relate to the need for anesthesia beyond conscious sedation and listing of procedures in legislative instruments. In 2013, Australia adopted National Safety and Quality Health Service standards (NSQHS standards) for the accreditation of hospitals and day surgery centers; however, there is no NSQHS standard for office-based facilities. The main legislative driver for compliance is access to reimbursement schemes for service delivery.

Conclusions: The legislative and accreditation framework creates a situation whereby healthcare facilities that provide services outside the various legal definitions of surgery and those not covered by a reimbursement scheme, can operate without licensing and accreditation oversight. This situation exposes patients to potential increased risk of harm when receiving treatment in such unregulated facilities.

Objectives: Disinvestment of existing healthcare technologies that deliver low or no health benefit for their cost can be used as a tool to improve access to effective technologies, while ensuring the long-term sustainability of healthcare systems. The objective of this research was to identify disinvestment initiatives in Latin American countries (LAC).

Methods: First, a systematic literature review (SLR) was conducted. In February 2015, MEDLINE, MEDLINE In-Process, EMBASE, The Cochrane Library, and LILACS were searched for relevant journal articles, including terms related to “disinvestment,” “reallocation,” “obsolete technologies,” and “Latin America.” Additionally, a manual search of documents from Latin American health technology assessment agencies was performed. Second, an online questionnaire was sent to experts in LAC to assess whether unpublished real-life disinvestment initiatives exist. Questionnaire results were collected in September 2015.

Results: From the SLR, 350 records were selected for screening following de-duplication and eleven articles fulfilled inclusion criteria. Only two of these reported information on initiatives potentially identifiable as disinvestment-investment activities in Brazil and Peru. Nine respondents completed the questionnaire, and four reported that disinvestment initiatives had been conducted in their respective organizations in Argentina, Brazil, and Mexico. This lack of agreement between the SLR and the questionnaire responses shows that disinvestment initiatives are ongoing, despite being under reported.

Conclusions: Many challenges need to be overcome for a disinvestment initiative to be successful, and sharing particular experiences with the international community would increase the chances of positive outcomes. The present study highlights the need for publication of such experiences in LAC.

Objectives: The objective of this study was to analyze and present the current state of the implementation of health technology assessment (HTA) in Slovenia, identify its advantages and challenges, as well as potential improvements and developments.

Methods: The HTA structure and processes were analyzed and comprehensively described according to relevant literature, official documents, and experiences of the author.

Results: The important steps in the development and implementation of an HTA system are presented through eight key elements: capacity building; HTA funding; HTA legislation and organizational structure; the scope of HTA implementation; decision criteria; quality, timelines, and transparency of HTA implementation; use of local data; and international collaboration. Based on the current situation, possible further developments are presented.

Conclusions: Currently, there is no systematic HTA in Slovenia; however, some basic use of HTA principles can be found in the decision making. The biggest deficiency in the HTA field is the lack of knowledge and systematic implementation. Legislation and guidelines for study appraisals are needed at decision-making levels. HTA principles across health technologies need to be unified along with a central HTA coordination office being set up to lead and establish priorities for HTA work.

Background: Understanding cost-drivers and estimating societal costs are important challenges for economic evaluation of health technologies in low- and middle-income countries (LMICs). This study assessed community experiences of health resource usage and perceived cost-drivers from a societal perspective to inform the design of an economic model for the Community Level Interventions for Pre-eclampsia (CLIP) trials.

Methods: Qualitative research was undertaken alongside the CLIP trial in two districts of Sindh province, Pakistan. Nine focus groups were conducted with a wide range of stakeholders, including pregnant women, mothers-in-law, husbands, fathers-in-law, healthcare providers at community and health facility-levels, and health decision/policy makers at district-level. The societal perspective included out-of-pocket (OOP), health system, and program implementation costs related to CLIP. Thematic analysis was performed using NVivo software.

Results: Most pregnant women and male decision makers reported a large burden of OOP costs for in- and out-patient care, informal care from traditional healers, self-medication, childbirth, newborn care, transport to health facility, and missed wages by caretakers. Many healthcare providers identified health system costs associated with human resources for hypertension risk assessment, transport, and communication about patient referrals. Health decision/policy makers recognized program implementation costs (such as the mobile health infrastructure, staff training, and monitoring/supervision) as major investments for the health system.

Conclusions: Our investigation of care-seeking practices revealed financial implications for families of pregnant women, and program implementation costs for the health system. The societal perspective provided comprehensive knowledge of cost drivers to guide an economic appraisal of the CLIP trial in Sindh, Pakistan.

Objectives: The aim of this study was to investigate the analysis, discussion, and challenges of the price and reimbursement process of medicinal products in Bulgaria in the period 2000–15 and health technology assessment (HTA) role in these processes.

Methods: The dynamics of the reform, with respect to the healthcare and pharmaceutical sectors, are tracked by documentary review of regulations, articles, and reports in the European Union (EU), as well as analytical and historical analysis.

Results: Pricing and reimbursement processes have passed through a variety of committees between 2003 and 2012. Separate units for pricing and reimbursement of medicinal products were established in Bulgaria for the first time, in 2013, when an independent body, the National Council at Prices and Reimbursement of Medicinal Products, was set up to approve medicinal products with new international nonproprietary names (INN) for reimbursement in Bulgaria. Over the course of 2 years (2013–14), thirty-three new INNs were approved for reimbursement. In December 2015, a new HTA body was introduced, and assigned to the National Centre for Public Health and Analyses.

Conclusions: Although Bulgaria has current legislation on pricing and reimbursement which is in accordance with the EU rules, there is no mechanism for reporting and monitoring these processes or the financial resources annually, so as to provide an overall objective assessment and analysis by year. Therefore, this financial assessment should become a national policy objective for the future.

Objectives: The aim of this study was to present the experience of a Canadian hospital-based health technology assessment (HTA) unit that performed the traditional functions of the HTA process along with many other activities to facilitate the choice of smart pumps.

Methods: A rapid literature review was initiated, but little evidence was found. Moreover, the evidence provided was too far from our hospital context. To help our decision makers, we offered them a list of various services based on the skills of our HTA unit staff.

Results: To involve our HTA unit in the choice of the new smart pumps led to a strong collaboration between hospital services. After a rapid review on smart pumps, we proceeded to establish the clinical needs, followed by an evaluation of technical features. To ascertain clinical needs, we participated in the establishment of a conformity list for the tender, a failure and mode-effect analysis, an audit on the use of actual smart pumps, and simulation exercises with nurses and doctors to evaluate the ease of use and ergonomics. With regard to technical tests, these were mainly conducted to identify potential dysfunction and to assess the efficiency of the pump. This experience with smart pumps was useful for evidence-based procurement and led to the formulation of a nine-step process to guide future work.

Conclusions: HTA units and agencies are faced with rapid development of new technologies that may not be supported by sufficient amount of pertinent published evidence. Under these circumstances, approaches other than evidence-based selection might provide useful information. Because these activities may be different from those related to classic HTA, this widens the scope of what can be done in HTA to support decision making.

Objectives: The aim of this study was to describe an initial exploration by CADTH, Canada's pan-Canadian health technology assessment (HTA) agency, in using the INTEGRATE-HTA guidance in the production of an HTA that examined the use of both in-center and in-home dialysis modalities for the treatment of end-stage kidney disease in adults in Canada.

Methods and Results: We outline CADTH's standard HTA production process and context and then describe the experience of the assessment team in using the INTEGRATE-HTA guidance, specifically to help structure and guide the use of a logic model, the identification of implementation issues, and the identification and examination of ethical issues. For each of the aspects, we describe and reflect on how the assessment team used the guidance, challenges that were encountered in its use, and whether and how we might address these challenges when using the INTEGRATE-HTA guidance in the future.

Conclusions: INTEGRATE-HTA provided detailed and helpful guidance for truly integrating wide-ranging aspects of HTA. Our agency was challenged by a steep learning curve for assessment team members, tight project timelines, and a misalignment of current HTA processes with those required to implement the guidance. Nevertheless, using the guidance initiated a dialogue about what might be needed to assess complex interventions and the potential process changes that could facilitate conducting more integrated assessments.

Several studies have been carried out regarding different interventions in an effort to improve levels of physical activity in people with an intellectual disability (ID). Studies have been carried out regarding physical activity interventions (1), educational interventions (2), and multimodal interventions (3). New technologies are currently being used to carry out changes in daily habits and to promote health in different pathologies but not in people with an ID (4;5). Due to the poor maintenance of physical activity that we have found in people with ID, the objective of the present study is to determine the maintenance of levels of physical activity, quality of life, self-efficacy, and social support in this population through an intervention with an application in their smartphones.

Introduction: Optimizing radiotherapy with or without chemotherapy through advanced imaging and accelerated radiation schemes shows promising results in locally advanced non–small-cell lung cancer (NSCLC). This study compared the cost-effectiveness of positron emission tomography-computed tomography based isotoxic accelerated sequential chemo-radiation (SRT2) and concurrent chemo-radiation with daily low-dose cisplatin (CRT2) with standard sequential (SRT1) and concurrent chemo-radiation (CRT1).

Methods: We used an externally validated mathematical model to simulate the four treatment strategies. The model was built using data from 200 NSCLC patients treated with curative sequential chemo-radiation. For concurrent strategies, data from a meta-analysis and a single study were included in the model. Costs, utilities, and resource use estimates were obtained from literature. Primary outcomes were the incremental cost-effectiveness and cost-utility ratio (ICUR) of each strategy. Scenario analyses were carried out to investigate the impact of uncertainty.

Results: Total undiscounted costs and quality-adjusted life-years (QALYs) for SRT1, CRT1, SRT2, and CRT2 were EUR 17,288, EUR 18,756, EUR 19,072, EUR 17,360 and QALYs 1.10, 1.15, 1.40, and 1.40, respectively. Compared with SRT1, the ICURs were EUR 38,024/QALY for CRT1, EUR 6,249/QALY for SRT2, and EUR 346/QALY for CRT2. CRT2 was highly cost-effective compared with SRT1. Moreover, CRT2 was more effective and less costly than CRT1 and SRT2. Therefore, these strategies were dominated by CRT2.

Conclusion: Optimized sequential and concurrent chemo-radiation strategies are more effective and cost-effective than the current conventional sequential and concurrent strategies. Concurrent chemo-radiation with a daily low dose cisplatin regimen is the most cost-effective treatment option for locally advanced inoperable NSCLC patients.

A central idea underlying the INTEGRATE-HTA project is that many of the interventions that are being used in health care are quite complex. By this, we mean that the relation between the delivery of the intervention on the one hand, and the onset of (desired and undesired) changes may be less straightforward than hoped for. There may be all sorts of reasons for this, varying from a lack of resources, lack of skills, perverse incentives, organizational problems, etc. Not identifying such factors and their potential impact may seriously compromise the policy relevance of a health technology assessment (HTA) (1). However, current approaches and methods in HTA do not seem to be adequately geared to deal with this complexity.

Background: The University College of Southeast Norway has an on-going project to develop a smart house welfare system to allow older adults and people with disabilities to remain in their homes for as long as they wish in safe, dignified, living conditions.

Objectives: This article reviews reported ethical challenges to implementing smart houses for older adults.

Methods: A systematic literature review identified twenty-four articles in English, French, Spanish, and Norwegian, which were analyzed and synthesized using Hofmann's question list to investigate the reported ethical challenges.

Results: Smart houses offer a promising way to improve access to home care for older adults and people with disabilities. However, important ethical challenges arise when implementing smart houses, including cost-effectiveness, privacy, autonomy, informed consent, dignity, safety, and trust.

Conclusions: The identified ethical challenges are important to consider when developing smart house systems. Due to the limitations of smart house technology, designers and users should be mindful that smart houses can achieve a safer and more dignified life-style but cannot solve all the challenges related to ageing, disabilities, and disease. At some point, smart houses can no longer help persons as they develop needs that smart houses cannot meet.

Objectives: The aim of this study was to describe and analyze the introduction of health technology (HTA) in Romania.

Methods: Based on a review of the literature and legislative documents and personal experiences and observations, the authors describe, evaluate, and explain the background and evolution of the HTA system.

Results: Initiatives to introduce HTA in Romania date from the early 1990s, but real steps were taken only in 2012 when the European Union Directive 2011/24/ on the application of patients’ rights in cross-border health care had to be passed into Romanian law.

The main developments consist of: the establishment of a national competent authority, the development of a methodology for the rapid assessment of drugs, setting HTA as the main tool for compiling the list of medicines to be covered by the NHIF, and capacity building initiatives. One early result of HTA implementation was an updated list of reimbursed drugs, allowing Romanian patients access to new, innovative medicines.

Conclusions: In Romania, HTA become an issue for all stakeholders: decision makers are interested in cost-containment, patients in obtaining the best care, and producers in receiving acceptable reimbursement remains on the health policy agenda. Further steps are envisaged, especially for international collaboration, which is considered an important factor for HTA development in Romania.