This study outlines the ways in which different health technology assessment (HTA) organizations deal with uncertainty in relative effectiveness assessments (REAs), using the GRADE framework as a common reference. Guidelines regarding REA and uncertainty assessment methods and three most recent HTA reports (as of April 2020) of seven HTA organizations in Germany, England and Wales, France, the Netherlands, Europe (EUnetHTA), the USA, and Canada were included. First, it was analyzed how each organization addressed uncertainty on the following levels of evidence: (i) individual studies, (ii) body of evidence for one outcome, (iii) body of evidence across all outcomes, and (iv) added net benefit. Second, the extent to which HTA organizations considered the eight domains of certainty of evidence defined by GRADE was assessed. For individual studies, checklists were the most common approach to express uncertainty (4/7 organizations). Uncertainty in the body of evidence for all outcomes and in added benefit was combined in a single conclusion by five organizations. All organizations reported on at least 4/5 downgrading domains of GRADE, while the three upgrading domains were reported less. The operationalization of the assessment of multiple domains was unclear due to vague or absent guidelines. HTA organizations consider most domains of the GRADE framework, but approaches to assess uncertainty within REAs on different levels of evidence differ substantially between organizations. More alignment and guidance on the best methods to deal with uncertainty within HTA could lead to more clarity for stakeholders and to more aligned reimbursement recommendations.

Objectives: Coverage decisions are decisions by third party payers about whether and how much to pay for technologies or services, and under what conditions. Given their complexity, a systematic and transparent approach is needed. The DECIDE (Developing and Evaluating Communication Strategies to Support Informed Decisions and Practice Based on Evidence) Project, a GRADE (Grading of Recommendations Assessment, Development and Evaluation) Working Group initiative funded by the European Union, has developed GRADE Evidence to Decision (EtD) framework for different types of decisions, including coverage ones.

Methods: We used an iterative approach, including brainstorming to generate ideas, consultation with stakeholders, user testing, and pilot testing of the framework.

Results: The general structure of the EtD includes formulation of the question, an assessment using twelve criteria, and conclusions. Criteria that are relevant for coverage decisions are similar to those for clinical recommendations from a population perspective. Important differences between the two include the decision-making processes, accountability, and the nature of the judgments that need to be made for some criteria. Although cost-effectiveness is a key consideration when making coverage decisions, it may not be the determining factor. Strength of recommendation is not directly linked to the type of coverage decisions, but when there are important uncertainties, it may be possible to cover an intervention for a subgroup, in the context of research, with price negotiation, or with restrictions.

Conclusions: The EtD provides a systematic and transparent approach for making coverage decisions. It helps ensure consideration of key criteria that determine whether a technology or service should be covered and that judgments are informed by the best available evidence.

To eliminate the effect of subjective factors during manually determining the pearlite spheroidization grade of steel by analysis of optical metallography images, a novel method combining image mining and artificial neural networks (ANN) is proposed. The four co-occurrence matrices of angular second moment, contrast, correlation, and entropy are adopted to objectively characterize the images. ANN is employed to establish a mathematical model between the four co-occurrence matrices and the corresponding spheroidization grade. Three materials used in coal-fired power plants (ASTM A315-B steel, ASTM A335-P12 steel, and ASTM A355-P11 steel) were selected as the samples to test the validity of our proposed method. The results indicate that the accuracies of the calculated spheroidization grades reach 99.05, 95.46, and 93.63%, respectively. Hence, our newly proposed method is adequate for automatically detecting the pearlite spheroidization grade of steel using optical metallography.

Piglets reared in swine production in the USA undergo painful procedures that include castration, tail docking, teeth clipping, and identification with ear notching or tagging. These procedures are usually performed without pain mitigation. The objective of this project was to develop recommendations for pain mitigation in 1- to 28-day-old piglets undergoing these procedures. The National Pork Board funded project to develop recommendations for pain mitigation in piglets. Recommendation development followed a defined multi-step process that included an evidence summary and estimates of the efficacies of interventions. The results of a systematic review of the interventions were reported in a companion paper. This manuscript describes the recommendation development process and the final recommendations. Recommendations were developed for three interventions (CO2/O2 general anesthesia, non-steroidal anti-inflammatory drugs (NSAIDs), and lidocaine) for use during castration. The ability to make strong recommendations was limited by low-quality evidence and strong certainty about variation in stakeholder values and preferences. The panel strongly recommended against the use of a CO2/O2 general anesthesia mixture, weakly recommended for the use of NSAIDs and weakly recommended against the use of lidocaine for pain mitigation during castration of 1- to 28-day-old piglets.