Telemedicine uses information and communication technologies to provide services in the field where the distance is a critical factor. The aim of the present study is to describe the experience of a synchronous telemedicine between two hospitals in Spain and Angola.

This is a retrospective observational study of all synchronous telemedicine sessions conducted between the Hospital Nossa Senhora da Paz in Angola and the Vall d'Hebron University Hospital in Spain from January 2011 to December 2014.

Seventy-two cases were discussed in the telemedicine sessions. The average age of patients was 18.02 (SD 13.75) years and mostly women (54.38 percent). Reasons to discuss the cases were 46.47 percent doubts in the diagnosis and therapeutic management, 15.47 percent were purely formative cases, and only 8.45 percent treatment doubt. At the time of presentation, 29 percent of the patients were already diagnosed, 95 percent of whom with infectious disease diagnostic, and from the undiagnosed patients 36 percent presented a febrile syndrome.

This study shows the viability of synchronous telemedicine between European and African countries without an excessively sophisticated technology.

Cardiac surgery has seen substantial scientific progress over recent decades. Health economic evaluations have become important tools for decision makers to prioritize scarce health resources. The present study aimed to identify and critically appraise the reporting quality of health economic evaluations conducted in the field of cardiac surgery.

A literature search was performed to identify health economic evaluations in cardiac surgery. The consolidated Health Economic Evaluation Reporting Standards (CHEERS) statement was used to assess the quality of reporting of studies.

A total 4,705 articles published between 1981 and 2016 were identified; sixty-nine studies fulfilled the inclusion criteria. There was a trend toward a greater number of publications and reporting quality over time. Six (8.7 percent) studies were conducted between 1981 and 1990, nine (13 percent) between 1991 and 2000, twenty-four (34.8 percent) between 2001 and 2010, and thirty (43.5 percent) after 2011. The mean CHEERS score of all articles was 16.7/24; for those published between 1980 and 1990 the mean (SD) score was 10.2 (±1.4), for those published between 1991 and 2000 it was 11.2 (±2.4), between 2001 and 2010 it was 15.3 (±4.8), and after 2011 it was 19.9 (±2.9). The quality of reporting was still insufficient for several studies after 2000, especially concerning items “characterizing heterogeneity,” “assumptions,” and “choice of model.”

The present study suggests that, even if the quantity and the quality of health economics evaluation in cardiac surgery has increased, there remains a need for improvement in several reporting criteria to ensure greater transparency.

Preference-based measures of health-related quality of life play a key role in the calculation of Quality-Adjusted Life Years (QALYs) for Health Technology Assessment (HTA). The Child Health Utility 9D (CHU9D) is a new preference-based instrument designed specifically for application in children and adolescents (aged 7 to 17 years). This study aimed to compare Chinese and Australian adolescent population preferences for CHU9D health states using profile case best worst scaling (BWS) methods.

Fifty CHU9D health states (blocked into five survey versions) were generated for valuation using a fractional factorial design. Study participants were recruited through an online panel company in Australia, and through primary and secondary schools in China. A latent class modelling framework was adopted for econometric analysis.

A total of 1,982 respondents (51 percent female) in Australia and 902 respondents (43 percent female) in China provided useable survey responses. Latent class analysis indicated the existence of preference heterogeneity for both population groups. In the Australian sample, respondents in Class I placed the most importance on the mental health dimensions of the CHU9D (for example, Worried and Annoyed) and the least importance on daily activities (for example, Activities, Daily routine, Sleep), whilst respondents in Class II placed equal weights on all attributes. In the Chinese sample, respondents in Class I placed the most importance on the Activities dimension of the CHU9D and the least importance on the Annoyed dimension, whist Class II placed the most importance on the Schoolwork dimension and the least importance on Pain.

This study has provided important cross-country insights into the use of profile case BWS methods to elicit health state preferences with young people for application in HTA in children and adolescents. The differential latent classes identified between Australia and China highlights the necessity to derive country-specific adolescent scoring algorithms for the CHU9D instrument for application in HTA.

Public consultation is one of the phases provided by the law that rules the health technology incorporation process in Brazilian Public Health System (SUS). In the Brazilian model, anyone can participate as long as he/she identifies her/himself. During the decision-making process these suggestions are analyzed by the National Committee for Health Technology Incorporation (CONITEC) and, sometimes, they are responsible for changing a preliminary recommendation for a technology. This study aims to identify the health technologies for which CONITEC revised the initial negative recommendations due to the contributions received during the public consultation.

A descriptive study using as input data the information on coverage decisions available on the CONITEC website.

Since CONITEC's creation until October 2017, CONITEC enacted 241 public consultations. Fifteen cases of change to the preliminary negative recommendation were found and among these eight (53 percent) had the economic studies or proposed technology price reconsidered by the companies. In the other seven decisions, the Board also regarded as important the reasons for changing the initial recommendation: new evidence on efficacy and safety as well as the analysis of different outcomes previously unconsidered in the preliminary assessment.

During the public consultations, besides technical-scientific information, personal experiences and opinion reports on each health technology analyzed, CONITEC received new price offers and economic studies from the applicants. This new material has allowed, in some cases, these technologies to become competitive and to be included as alternatives to those already available, provided there is no clinical impairment. This study reinforces the importance of the public consultation and social participation in the process of health technologies incorporation in Brazil, considering its capacity to add new information to the decision-making process.

As part of a national aging and technology network, AGE-WELL, one work group aims to promote the understanding of potential policy and regulatory hurdles among innovators and decision-makers. This study describes the development of resources to help innovators to navigate policy and regulatory systems to have their technologies adopted.

A policy primer was created that highlights considerations for innovators during the innovation process (from development to implementation). The content of the policy primer was developed by identifying resources through the Canadian Agency for Drugs and Technology in Health Grey Matters search tool, and in consultation with legal and regulatory consultants. By surveying AGE-WELL technology-developing projects (n=15) we characterized the technologies being developed within the network. Survey questions included: intended end-user/purchaser of the technology and past/anticipated facilitators/barriers in their innovation process. The policy primer and survey data were combined to create tailored innovation maps with considerations for each technology being developed within the network. These materials were used to develop a beta website where users can receive information relevant to various innovation stages, as it pertains to their technology. We gained feedback about our materials via surveys and interviews with AGE-WELL technology developers.

The tailored innovation maps and website were seen as helpful resources for understanding policy and regulatory processes required for technology adoption. Technology developers expressed interest in gaining further access to these resources. Innovators desired additional resources about demonstrating value and measuring technology effectiveness.

Resources were developed to help guide technology innovators through policy and regulatory processes; preliminary feedback suggests these were valued by innovators. Next steps include refining the website and releasing these resources to innovators beyond the AGE-WELL Network.

Advanced Therapy Medicinal Products (ATMPs) are innovative biologics (gene, cells and tissue-based products) with the potential to treat diseases with significant unmet clinical need. ATMPs pose distinct regulatory, health technology assessment (HTA) and patient access challenges, hence early identification and prioritization of ATMPs is now recognized as a key concern in England. The National Institute for Health Research Innovation Observatory (NIHRIO) uses a robust methodology to identify and monitor health technologies, including ATMPs that meet the remit of key HTA stakeholders in England. This analysis provides a global overview of the current ATMPs pipeline to administer useful insights for policymakers, funders and innovators.

NIHRIO's database tracks pharmaceuticals from phase I/II onwards, but this analysis focuses on late-stage development. The database (N > 12,000 records) was filtered to identify potential ATMPs using a predefined criteria based on the European Medicine's Agency's classification. Each record is categorized by stage: ‘Active’, (with an estimated three years to European licence); ‘Monitoring’ (in development with no licence date); and ‘Finished’, (output produced/discontinued and no longer tracked). Subsequently, records in ‘Active’ and ‘Monitoring’ were examined further.

Analysis identified 636 ATMPs: five percent ‘Active’, 40 percent ‘Monitoring’ and 55 percent ‘Finished’. ATMPs in the Active/Monitoring stages included: gene therapies (52%), somatic cells (43%) and tissue-engineered products (5%). Of these, 40 percent were oncological with the majority targeting hematological cancers (lymphomas). Prevalent non-oncology areas included musculoskeletal (10%) and ophthalmology (8%). Over one-third of trials were phase IIs, with almost half of all trials were based in the US.

The overarching findings here indicate increasing development of the ATMP pipeline towards indications with significant unmet clinical need. In oncology, the high prevalence of hematological ATMPs is largely due to recent chimeric antigen receptor T cells (CAR-T) innovation. In non-oncology areas, ATMP development is increasing due to advances in regenerative medicine. With a significant number of ATMPs projected to be licenced within three years, and many more in active late-stage trials, HTA bodies and health systems are challenged to prepare for the entry of these innovative therapies.

Australians are adjusting to mobile health (mHealth) applications (apps) being used in clinical care. The nature of apps presents unique challenges (e.g. rapid lifecycle) to mHealth regulation. The risks they pose are mainly through the information they provide and how it is used in clinical decision-making. This study explores the international regulation of mHealth apps. It assesses whether the approach used in Australia to regulate apps is consistent with international standards and suitable to address the unique challenges presented by the technology.

A policy analysis was conducted of all nine member jurisdictions of the International Medical Device Regulator's Forum (IMDRF), to determine if their regulatory agencies addressed the IMDRF recommendations relevant to the clinical evaluation of mHealth apps. Case-studies (submission to regulatory agencies) were also selected on varying types of regulated apps (standalone, active implantable, etc.) and assessed relative to the principles in the IMDRF's software as a medical device (SaMD): Clinical evaluation (2017) guidance document.

All included jurisdictions evaluated the effectiveness of mHealth apps, assessing the majority of the key sub-categories recommended by SaMD: Clinical evaluation. The submissions and jurisdictional regulatory bodies did not address the IMDRF safety principles in terms of the apps’ information security (cybersecurity). Furthermore, by failing to use the method recommended by the IMDRF (risk-classification), none of the submissions or jurisdictions recognized the potential dangers of misinformation on patient safety.

None of the approaches used by global regulatory bodies adequately address the unique challenges posed by apps. Australia's approach is consistent with app regulatory procedures used internationally. We recommend that mHealth apps are evaluated for cybersecurity and are also classified using the IMDRF risk-categories so as to fully protect the public.

Music therapy (MT) is a complementary creative arts treatment aimed at maintaining, restoring, and furthering physical, emotional, and mental health. This systematic review aimed to assess the effectiveness of MT for the treatment of autism spectrum disorder, dementia, depression, insomnia, and schizophrenia. In addition, the MT methods used for these indications were analyzed.

For this update of five Cochrane reviews, four databases (Medline, Embase, The Cochrane Library, and PsycINFO) were systematically searched for studies published from 2013 to 2020. Two review authors independently performed the study selection and data extraction. The methodological quality of the included trials was assessed using the Risk of Bias in Non-randomised Studies - of Interventions (ROBINS-I) tool and the Cochrane Risk of Bias tool for randomized controlled trials.

Ten RCTs (1,248 patients) met the inclusion criteria. For schizophrenia, no study could be included. MT improved the following: behavior, social communication, and the parent-child relationship in patients with autism; mood for patients with depression; and sleep quality for patients with insomnia. In patients with dementia, MT enhanced mood, behavior (severe disease stage), and cognitive function, whereas cognition was unchanged. Memory was improved only in the mild disease stage. None of the studies observed any significant long-term effects of MT in these patient groups. Both active (playing music) and receptive (listening to music) methods were used for dementia, whereas active methods were applied for autism spectrum disorder and depression. For insomnia, only receptive methods were used.

The findings of this update of reviews provides evidence that MT may help patients diagnosed with an autism spectrum disorder, dementia, depression, insomnia, or schizophrenia. It is crucial to focus on patient-related evidence-based health care. MT improves physical, psychological, and social aspects, but more research investigating the long-term effects of MT in these patient groups is needed as it is crucial to know how long the effects of MT last.

Clinical decision support systems (CDSS) are being developed to support evidence-based antibiotic prescribing and reduce the risk of inappropriate or over-prescribing; however, adoption of CDSS into the health system is rarely sustained. We aimed to understand the implementation challenges at a macro (policymakers), meso (organizational) and micro-level (individual practices) to identify the drivers of CDSS non-adoption.

We have adopted a mixed-method study design which comprised of: (i) systematic review and meta-analysis to assess the impact of CDSS on appropriate antibiotic prescribing, (ii) Online survey of clinicians in Australia from hospitals and primary care to identify drivers of CDSS adoption and (iii) in-depth interviews with policymakers to evaluate policy-level challenges and opportunities to CDSS implementation.

CDSS implementation can improve compliance with antibiotic prescribing guidelines, with a relative decrease in mortality, volume of antibiotic use and length of hospital stay. However, CDSS provision alone is not enough to achieve these benefits. Important predictors of clinicians’ perception regarding CDSS adoption include the seniority of clinical end-users (years), use of CDSS, and the care setting. Clinicians in primary care and those with significant clinical experience are less likely to use CDSS due to a lack of trust in the system, fear of comprising professional autonomy, and patients’ expectations. Lack of important policy considerations for CDSS integration into a multi-stakeholder healthcare system has limited the organizational capacity to foster change and align processes to support the innovation.

These results using multiple lines of evidence highlight the importance of a holistic approach when undertaking health technology management. There needs to be system-wide guidance that integrates individual, organizational and system-level factors when implementing CDSS so that effective antibiotic stewardship can be facilitated.

The frameworks used by Health Technology Assessment (HTA) agencies for value assessment of medicines aim to optimize healthcare resource allocation. However, they may not be effective at capturing the value of antimicrobial drugs.

To analyze stakeholder perceptions regarding how antimicrobials are assessed for value for reimbursement purposes and how the Australian HTA framework accommodates the unique attributes of antimicrobials in cost-effectiveness evaluation.

Eighteen individuals representing the pharmaceutical industry or policy-makers were interviewed. Interviews were transcribed verbatim, coded, and thematically analyzed.

Key emergent themes were that reimbursement decision-making should consider the antibiotic spectrum when assessing value, risk of shortages, the impact of procurement processes on low-priced comparators, and the need for methodological transparency when antimicrobials are incorporated into the economic evaluation of other treatments.

Participants agreed that the current HTA framework for antimicrobial value assessment is inadequate to properly inform funding decisions, as the contemporary definition of cost-effectiveness fails to explicitly incorporate the risk of future resistance. Policy-makers were uncertain about how to incorporate future resistance into economic evaluations without a systematic method to capture costs avoided due to good stewardship. Lacking financial reward for the benefits of narrower-spectrum antimicrobials, companies will likely focus on developing broad-spectrum agents with wider potential use. The perceived risks of shortages have influenced the funding of generic antimicrobials in Australia, with policy-makers suggesting a willingness to pay more for assured supply. Although antibiotics often underpin the effectiveness of other medicines, it is unclear how this is incorporated into economic models.

The Canadian Agency for Drugs and Technologies in Health (CADTH) pan-Canadian Oncology Drug Review (pCODR) plays an important role in public reimbursement decision-making for oncology drugs in Canada. This research studies the relation of positive pCODR decisions to new cancer treatment and their subsequent inclusion in Canada's public drug plans.

We studied all oncology drugs that received an approval from Health Canada and were reviewed by the pCODR from inception till 26th Sep, 2017. The data was obtained from CADTH and Health Canada. Data such as indication, submission type and date, recommendation date, final recommendation, and subsequent provincial funding status was extracted and analyzed. Impact was evaluated by analyzing the percentage of drug submissions with assessment outcome (positive recommendation rate and conditional recommendation rate) and time taken for the final decision (recommendation gap). The percentage of drugs included in public formulary after positive recommendation by pCODR (coverage rate) and the gap in days from positive recommendation to subsequent coverage in provinces (coverage gap) was also assessed.

Among 119 drugs reviewed by pCODR, the positive recommendation rate was eight percent. Nine applications comprising seven drugs for six indications received positive recommendations, and genitourinary treatments received maximum positive recommendations. The conditional recommendation rate was 52 percent; 62 applications of 45 drugs for 46 indications received conditional recommendation. Lymphoma and myeloma treatments received maximum conditional recommendations. The average recommendation gap for positive and conditional recommendations was 180 and 172 days, respectively. The coverage rate for drugs with positive recommendation was 100 percent for all provinces except 89 percent for Newfoundland and Labrador, and 67 percent for Prince Edward Island. Among the provinces, British Columbia had a maximum of 433 days and Saskatchewan has the minimum of 165 days coverage gap.

Despite Health Canada's approval, only a fraction of oncology drugs receive positive pCODR recommendation; furthermore, provincial drug plans take time to include these in the reimbursement formularies. While health technology assessment is crucial for appropriate allocation of limited resources, efforts should also be made to reduce access barriers, particularly to positively recommended oncology drugs inclusion in provincial formularies.

Healthcare-associated infections (HAIs) are an important, potentially preventable reason to maintain a clean healthcare environment. However, guidelines from Europe and North America do not concur—European guidelines recommend using neutral detergent (followed by chlorine-based disinfection (CBD) if required), whilst North American guidelines recommend using detergent or hospital-grade disinfectant-detergents for routine cleaning or decontamination of noncritical healthcare environmental surfaces. The objective of this study was to compare the effectiveness on rates of HAIs of: (i) disinfectant-detergents versus detergents; and (ii) the active ingredient of many disinfectant-detergents—quaternary ammonium compounds (QAC)—versus CBD.

A rapid review of systematic reviews was conducted using the following search terms: keywords and controlled vocabulary terms for the concepts of “healthcare environmental surfaces” AND (“QAC-based disinfectants” OR “disinfectant-detergents” OR “decontamination”) AND (“environmental contamination” OR “colonization” OR “HAIs”). The search filters included systematic reviews, guidelines, and technology reports. The following databases were searched: The Cochrane Library; PubMed; and health technology assessment and guideline websites for gray literature. Systematic reviews of studies comparing the effects of disinfectant-detergents with detergent, or comparing QAC with CBD, on rates of HAIs in the healthcare environment were included. Reviews on the cleaning or disinfection of body surfaces or disinfection of invasive medical devices were excluded. Quality assessment was not conducted. Data extraction was performed using a pro forma.

The literature search resulted in 356 titles. From ninety-four potentially relevant abstracts, fifty-seven full-texts were evaluated: fifty-one were excluded (eight non-English) and six were included. All review authors cautioned that the evidence was low level, methodologically poor, subject to confounding, and didn't address adverse outcomes. The reviews identified eight relevant primary studies, three of which compared disinfectant-detergents with detergent and found no difference in rates of HAI. Five studies compared QAC with CBD. All five demonstrated that CBD was superior to QAC and reduced Clostridium difficile infection rates in outbreak contexts. Furthermore, QAC may induce sporulation and microbial resistance.

Low-level evidence suggested that: there is no advantage in using disinfectant-detergents for routine cleaning of noncritical surfaces; CBD is superior to QAC-based disinfection in reducing clostridial infections; and QAC agents may induce sporulation or microbial resistance.

As model-based economic evaluations (MBEEs) are widely used to make decisions in the context of policy, it is imperative that they represent clinical practice. Here, we assess the relevance of MBEEs on dabigatran for the prevention of stroke in patients with atrial fibrillation (AF).

We performed a systematic review on the basis of a developed questionnaire, tailored to oral anticoagulation in patients with AF. Included studies had a full body text in English, compared dabigatran with a vitamin K antagonist, were not dedicated to one or more subgroup(s), and yielded an incremental cost-effectiveness ratio. The relevance of all MBEEs was assessed on the basis of ten context-independent factors, which encompassed clinical outcomes and treatment duration. The MBEEs performed for the United States were assessed on the basis of seventeen context-dependent factors, which were related to the country's target population and clinical environment.

The search yielded twenty-nine MBEEs, of which six were performed for the United States. On average, 54 percent of the context-independent factors were included per study, and 37 percent of the seventeen context-dependent factors in the U.S. studies. The share of relevant factors per study did not increase over time.

MBEEs on dabigatran leave out several relevant factors, limiting their usefulness to decision makers. We strongly urge health economic researchers to improve the relevance of their MBEEs by including context-independent relevance factors, and modeling context-dependent factors befitting the decision context concerned.

To provide insights into the attributes of health-related quality of life (HRQoL) research within the context of economic evaluations for a potential national health technology assessment process in South Africa, and make evidence generation recommendations.

A systematic review was conducted in January 2019 using Medline, the Web of Science (WoS) Core Collection and the South African SciELO collection via the WoS Platform, and in the Cochrane Library. No time restrictions were applied. Duplicate records were removed before first- and second-pass screening by two reviewers working independently.

The review identified 123 publications representing 104 studies since the first-published article appeared in 1996. Only eight studies were randomized controlled trials, most were cross-sectional (n = 54). The EQ-5D, SF-36, and WHOQOL-BREF were the most used HRQoL instruments (n = 35, n = 23, and n = 10, respectively). Instruments were frequently administered in multiple languages, reflecting the cultural groups in which the study was conducted, with the English version of instruments used most often. Studies were predominantly conducted within the public health sector (n = 67), in the Western Cape province (n = 46), in adults (n = 92) and people with HIV (n = 24).

South African specific HRQoL studies have been conducted in a range of settings and populations using mostly generic HRQoL instruments in multiple languages. These studies may provide generalizable, real-world data due to their observational nature. However, more comparative and longitudinal studies should be conducted as this is preferred for economic evaluations and patient, disease, and treatment characteristics should be reported in full.

For the last decades, health technology assessment has been strongly promoted in order to provide evidence-based rather than eminence-based healthcare. However, when it comes to implementing interventions that are based on processes and behavior rather than products, importing evidence-based interventions is likely to fail because it ignores the strong influence of contextual factors. In a recently started research project, an alternative approach is tested.

The project aims at improving identification and support of children who have parents with a mental illness in an Austrian region (Tyrol). A theory- and stakeholder-driven approach has been designed in order to co-develop, implement and evaluate practice approaches for improving the situation for children. The former addresses the questions whether, how and why suggested practices may work and the later brings together evidence and practice to develop interventions that are feasible and take the regional context and service settings into account.

Based on evidence from various sources (literature, international and local stakeholder interviews), theories that describe the key mechanisms of action to influence outcomes for children have been developed. A regional and interdisciplinary group of practitioners and people with lived experience has been established to facilitate the development of the theory of change and practice approaches for the region and local service settings. The final practice model is then monitored in the respective organizations with implementation support from the research team.

Theory-driven and co-designed-based approaches are a feasible alternative to ‘off-the-shelf’ evidence-based practices for supporting decision makers in implementing complex interventions. However, they require a broad variety of skills within the research team as well as willingness to accept uncertainties of the final outcomes produced, which can also be of risk to funders. The ongoing project will demonstrate whether the developed practices will be implemented successfully and result in benefits for the affected children.

To summarize the key methodological challenges identified by health technology assessment (HTA) agencies assessing gene therapy (GT) and consideration of broad elements of value.

Economic evaluations (EEs) of voretigene neparvovec (VN) in RPE65-mediated inherited retinal disease (IRD) published in English were selected. HTA evaluations from Australia, Canada, Ireland, Scotland, England, and the United States were reviewed. An existing methodological framework was used to identify the challenges and considerations.

Eight unique EEs were identified of which six were evaluated by HTA agencies. Incremental cost-effectiveness ratios ranged from $68,951 to $643,813 per quality-adjusted life-years (QALY) gained (healthcare perspective) and dominant to $480,130 per QALY gained (societal perspective). The key challenges were the lack of validated surrogate outcome, utility values and indirect costs from IRD patients, and limited evidence of the long-term treatment effect. Two HTA agencies reviewed a range of novel broader elements of value and whether they were associated with VN while other agencies discussed some elements of broader value. Caregiver disutility was included in some, but not all, evaluations.

The methodological challenges were consistent with innovative interventions for rare diseases and managed using standard methods. Broader value was important to decision-makers but inconsistently applied across agencies. Possible reasons are limitations in the evidence available of the broader benefits that VN offers and how to incorporate these within an EE. A need exists for greater guidance and consistency across jurisdictions regarding the consideration of broader value that considers latest best practice.

Health Technology Assessment (HTA) aims at providing decision makers with relevant data, matching different perspectives, with an evidence-based approach. The most common framework used is the European Network for Health Technology Assessment (EUnetHTA) Core Model (1): HTA may be further supported by a Multi-Criteria Decision Analysis (MCDA) (2,3), leading to a final quantitative synthesis, facilitating the appraisal phase.

This project presents a multi-dimensional comparison of the technologies available for the treatment of diabetic macular edema (Ranibizumab, Aflibercept, Dexamethasone implant and off-label Bevacizumab), comparing three Italian Regions: Lombardy, Liguria and Veneto.

The nine EUnetHTA dimensions were first prioritized by seventeen multidisciplinary evaluators. Thereafter a further nine professionals attributed a 3-level rating score (from “1” not performant, to “3” most performant) to each dimension and sub-dimension, after carefully assessing the three HTA reports. In conclusion, the investigation of statistically significant differences between the attributed scores of the evaluators was conducted, using a multi-variate analysis.

No statistically significant differences were reported in the prioritization of each dimension, except for the equity (more important in Liguria and in Lombardy) and the economic financial dimensions (more relevant in Veneto and in Lombardy).

Notwithstanding the evaluators’ different professional titles, job roles, center size, and various Regional contexts, they attributed similar scores to the HTA dimensions during the appraisal phase (even though conducted in different years, in 2015 and 2016). This finding demonstrates the robustness of both the evaluations and the final MCDA results: i) no statistically inter-regional significant differences emerged regarding Ranibizumab and Aflibercept (p-value >.05); ii) no statistically significant inter-regional differences emerged regarding Dexamethasone, except for the assessments in the clinical dimensions (p-value = .026), since in Lombardy Region the evaluation was carried out earlier in the technology's life-cycle.

Dexamethasone was consistently attributed a higher total score, considering the final normalised weight derived from the MCDA approach (p-value =.001).