Hostname: page-component-cd9895bd7-8ctnn Total loading time: 0 Render date: 2024-12-25T16:24:57.910Z Has data issue: false hasContentIssue false

Dynamic HTA for digital health solutions: opportunities and challenges for patient-centered evaluation

Published online by Cambridge University Press:  17 November 2023

Jan B. Brönneke
Affiliation:
Health Innovation Hub of the German Federal Ministry of Health, Berlin, Germany
Annika Herr
Affiliation:
Leibniz University Hannover, Hannover, Germany
Simon Reif
Affiliation:
ZEW – Leibniz Centre for European Economic Research, Mannheim, Germany University of Erlangen-Nürnberg, Nuremberg, Germany
Ariel D. Stern*
Affiliation:
Harvard Business School, Health Innovation Hub of the German Federal Ministry of Health, Hasso Plattner Institute, Digital Health Cluster, Harvard-MIT Center for Regulatory Science, Boston, Massachusetts, USA
*
Corresponding author: Ariel D. Stern; Email: astern@hbs.edu
Rights & Permissions [Opens in a new window]

Abstract

Objectives

Germany’s 2019 Digital Healthcare Act (Digitale-Versorgung-Gesetz, or DVG) created a number of opportunities for the digital transformation of the healthcare delivery system. Key among these was the creation of a reimbursement pathway for patient-centered digital health applications (digitale Gesundheitsanwendungen, or DiGA). Worldwide, this is the first structured pathway for “prescribable” health applications at scale. As of October 10, 2023, 49 DiGA were listed in the official directory maintained by Germany’s Federal Institute for Drugs and Medical Devices (BfArM); these are prescribable by physicians and psychotherapists and reimbursed by the German statutory health insurance system for all its 73 million beneficiaries. Looking ahead, a major challenge facing DiGA manufacturers will be the generation of the evidence required for ongoing price negotiations and reimbursement. Current health technology assessment (HTA) methods will need to be adapted for DiGA.

Methods

We describe the core issues that distinguish HTA in this setting: (i) explicit allowance for more flexible research designs, (ii) the nature of initial evidence generation, which can be delivered (in its final form) up to one year after becoming reimbursable, and (iii) the dynamic nature of both product development and product evaluation. We present the digital health applications in the German DiGA scheme as a case study and highlight the role of RWE in the successful evaluation of DiGA on an ongoing basis.

Results

When a DiGA is likely to be updated and assessed regularly, full-scale RCTs are infeasible; we therefore make the case for using real-world data and real-world evidence (RWE) for dynamic HTAs.

Conclusions

Continous evaluation using RWD is a regulatory innovation that can help improve the quality of DiGAs on the market.

Type
Policy
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
© The Author(s), 2023. Published by Cambridge University Press

Introduction and background

Software as a medical device

In recent years, there has been a worldwide push to articulate and clarify practices for the regulation and reimbursement of software as a medical device (SaMD). The International Medical Device Regulators Forum (IMDRF) defines SaMD as “software intended to be used for one or more medical purposes that perform these purposes without being part of a hardware medical device.” (1) The IMDRF has also begun to clarify best practices for the clinical evaluation of such products, including establishing (i) a “valid clinical association between the output of SaMD and the targeted clinical condition (to include pathological process or state)” and (ii) “that the SaMD provides the expected technical and clinical data.” (2) These two components are necessary but not sufficient conditions for the conduct of a health technology assessment (HTA). SaMD, as defined by the IMDRF, is the focus of this article; as a corollary, software embedded in a hardware medical device (which is included in some definitions, see below) will not be considered. Furthermore, SaMD not only includes native applications (“apps”) for smartphones but also all other forms of software running locally on computers or in the cloud, as well as web-based applications accessible via browsers.

Regulatory context

The United States and Germany were two of the first countries to define details of their respective regulatory approaches to SaMD products and are the focus of this article; however, recent years have seen an expansion in the regulation of digital health applications worldwide (Reference Essen, Stern and Haase3). For example, England has also developed a special evidence framework for digital health technologies (4). The framework, initially based on evidence standards for “traditional” (hardware) medical devices, requires different evidence standards for different levels of potential risks and was another early mover in the regulation of SaMD products (Reference Unsworth, Dillon and Collinson5). In the United States, the Food and Drug Administration (FDA) has issued formal regulatory guidance related to the clinical evaluation of SaMD products (2). This guidance is based largely on the recommendations of the IMDRF and provides an outline for how such products will be evaluated by regulators. SaMD remains a key area of focus for the FDA’s digital health regulatory activities, including its Digital Health Software Precertification Program (Pre-Cert), which ran its pilot phase from 2019–2022, and the FDA’s Digital Health Center of Excellence, which was launched in 2020 (6).

Within the European Union (EU), SaMD products are regulated by the EU’s Medical Device Regulation (MDR) of 2017, which is the single, directly enforceable act of the EU, regulating the certification of all medical devices (7) for European markets; the MDR came into full effect in 2021. It covers not only hardware devices but explicitly also applies to software intended to be used for specific medical purposes (see Art. 2(1) MDR). This includes stand-alone software – SaMD – as well as software driving or influencing a medical device, regardless of its location (on a computer, a mobile phone, in the cloud, etc.) and regardless of whether it is intended to be used by health care professionals or laypersons (8). MDR follows the idea of the so-called “new approach” of the former Medical Device Directive (MDD) by principally relying on the decentralized European system of CE-certification of products that have been proven to be in conformity with harmonized standards (e.g., relevant ISO norms) and common specifications via a notified body. MDR’s requirements as well as the conformity assessment depend on the risks associated with a device. In the EU, devices are categorized into four risk classes, ranging from class I (for low-risk devices) to classes IIa and IIb (for lower and higher risk devices) to class III (for high-risk devices) (7). Requirements of the MDR cover technical and organizational issues as well as a diligent risk–benefit assessment based on a clinical evaluation of the expected medical benefit. While conformity assessments of class I devices are performed by the manufacturer, devices of classes IIa and higher require a conformity assessment and certification by an EU-designated notified body (9). With software products mostly categorized as class IIa or higher (7) in accordance with the risk assessment of the IMDRF (8), the certification requirements – including those for the clinical evaluation of a new product – are substantial. However, conformity with the MDR does not in and of itself ensure general reimbursement of new medical devices in Europe. EU member states have their own HTA processes, which govern the reimbursement of medical products and reflect their own requirements (10), making a clear and context-appropriate approach to HTA all the more important. Importantly, the HTA processes that lead to reimbursement within public healthcare systems usually have as a prerequisite that products meet MDR requirements – are only open to CE-marked medical devices – making this a necessary but not sufficient condition for reimbursement.

In the context of SaMD reimbursement, Germany, in particular, has emerged as a policy leader and innovator in recent years, with the formal establishment of policies and procedures related to digital health tools. Germany’s 2019 Digital Healthcare Act (Digitale-Versorgung-Gesetz, or DVG) created a number of opportunities for the digital transformation of the healthcare delivery system (11). Key among these was the creation of an entirely new, combined regulatory approval and reimbursement pathway for patient-centerd digital healthcare applications (in German, “digitale Gesundheitsanwendungen,” or DiGA for short) called the DiGA Fast-Track. Worldwide, this represents the first structured system for the reimbursement of “prescribable” health applications at scale.

Beyond the recent German experience, neither established frameworks for reimbursement nor HTAs of SaMD products (such as digital health applications) exist at a national level. As SaMD differs from traditional therapeutics such as pharmaceuticals and traditional (hardware-only) medical devices in several key aspects (specifically due to features such as faster research and development and continuous data processing), there is a need to move beyond the currently established, static HTA practices which assess healthcare technologies based on the existing evidence at a single point in time. This article discusses possible pathways to thoughtfully and dynamically evaluate digital health applications that are reimbursed by traditional payers (health plans). In particular, we suggest a dynamic HTA framework – one in which new data and evidnece can be incorporated into HTAs as they emerge – in a fit-for-purpose and rigorous way. We also highlight ways in which the current regulations provide tools to support its development.

Digital health applications in Germany

Overview

As of October 10, 2023, 49 DiGA were listed in the official Directory (“DiGA Register” or registry of approved digital health applications) maintained by Germany’s Federal Institute for Drugs and Medical Devices (BfArM). These regulated digital health applications are prescribable by physicians and psychotherapists and reimbursed by the German statutory health insurance system for all of its 73 million patients. The Digital Healthcare Application Ordinance (Digitale-Gesundheitsanwendungen-Verordnung, or DiGAV) establishes the evaluation procedures for new DiGA with respect to important criteria such as quality, data privacy, and data security, as well as requirements for establishing the so-called “positive-care effects,” a concept introduced to summarize the breadth of demonstrable benefits that such digital products can provide. The establishment of positive-care effects is crucial for listing in the BfArM Directory and therefore for both patient and reimbursement (12).

To meet the definition of a DiGA, a product must qualify as a CE-marked medical device in one of the lowest risk classes (I or IIa), primarily rely on digital technology, be intended to be directly used by patients, and be indicated for a medical purpose in accordance with the purposes stated by MDR (with the exceptions of tools for prevention, contraception, and fertility, which are circumscribed by the current legislation). Only SaMD fulfilling all criteria are eligible to apply to the DiGA directory. The novel procedure therefore bridges the gap between regulation through MDR conformity and regulation and reimbursement in the German statutory health insurance system. Importantly, the CE certification process does not include a mechanism for establishing the price of a DiGA or any other medical device. In the case of approved DiGA, prices are set by the manufacturers for the first twelve months after BfArM listing within the boundaries of a framework contract between the national associations of the manufacturers and the health insurance funds. After the first twelve months of reimbursement, a price is set by negotiation between the relevant manufacturer and the federal association of health insurance funds, or by arbitrage if an agreement cannot be reached (Reference Brönneke, Debatin and Hagen13).

Prices and related considerations

As is the case for pharmaceutical products in Germany, where negotiated prices are based on a formal benefit assessment (Reference Stern, Pietrulla, Herr, Kesselheim and Sarpatwari14), the negotiated prices for digital healthcare applications are expected to deviate from initial prices and reflect their value (Reference Lauenroth, Kesselheim, Sarpatwari and Stern15). Manufacturers’ launch prices (i.e., prior to formal price negotiations) for the first 19 DiGA (i.e., those approved before July 2021) varied from €116.97 to €743.75 (mean of €415.70) per quarter. As of October 10, 2023, six DiGA had left the registry, having not provided the proposed evidence that had been a condition of their initial listing. Other DiGA manufacturers finished the first round of price negotiations after the first 12 months of reimbursement. On average, prices had increased to €453.37 for the 31 DiGA that were available one year later (June 2022). As of October 10, 2023, the average price was €406 per quarter (renewal costs are slightly lower, on average) for 48 available DiGA that are reimbursed based on a 90-day (recurring) billing cycle. One DiGA for multiple sclerosis (provisional listing since January 2023) could be bought for a singular payment of €2,077. Furthermore, the DiGA arbitration board that steps in if price negotiations fail, is currently defining the rules and price anchors for negotiations. Here, in particular, a comprehensive and appropriate HTA that is tailored to the unique facets and features of DiGA is needed for evidence-based decision-making.

While HTA procedures and best practices are well established for pharmaceutical products and traditional medical devices (albeit with recognized differences between the categories (Reference Drummond, Griffin and Tarricone16)), for digital health applications such practices and procedures are nascent and lack key standard features such as comparators and details on product safety and effectiveness (Reference Moshi, Tooher and Merlin17). All these facts support the case for revisiting HTA in the context of DiGA to support evidence-based (and more value-based) reimbursement decisions for this growing class of healthcare products.

A unique assessment challenge for SaMD products

While drugs are marketed in their approved form, software products have the potential to evolve – and in many cases, improve and/or expand in their scope for treatment or disease management – over time. Further, the process leading to reimbursement differs in meaningful ways. Key among them is the fact that the Fast-Track process, through which DiGA are approved by the BfArM (18), allows for applications for both permanent and preliminary listing – even before there is sufficient evidence in place to demonstrate positive-care effects. Moreover, the types of studies and evidence that are admissible in evaluating the benefit(s) of digital health applications are far broader than those that are currently used for drugs, as detailed below.

As such, articulating product-appropriate approaches to HTA in this setting is both timely and much needed. Hundreds of new digital health applications are expected to enter the German market over the coming years. As such, an appropriate and fit-for-purpose HTA will be needed both for individual products and for the entire system to deploy and use digital health applications in a value-based and evidence-driven manner.

Table 1 summarizes the 49 DiGA that became reimbursable in the German market plus the six that left the registry (as of October 10, 2023), clinical indications, launch prices, and information about the platforms through which patients can access them.

Table 1. Products listed in the DiGA registry as of October 10, 2023, n = 55

Notes: DiGA listed in the descending order of price.

A more detailed description of each product and a summary of the clinical evidence of its positive care effects can be found in the DiGA Directory: https://diga.bfarm.de/de/verzeichnis. Sources: https://diga.bfarm.de/de; https://diga.bfarm.de/de/verzeichnis; https://www.diga-verzeichnis.de/digas. Last update: June 13, 2022.

a Indicates a provisional listing in the DiGA registry.

b Indicates that the app was later delisted.

While statutory health insurers must reimburse all DiGA in the BfArM’s Directory, only nine of the 33 DiGA listed through June 2022 were listed permanently at the time of launch. The other 24 were first listed provisionally and, according to the terms of such a listing, must provide additional evidence – via registered studies, as stated in the application – during their first year of reimbursement in order to move from provisional to permanent listing status (for more details on Germany’s Fast-Track, see the BfArM’s Fast-Track Guide (18)). As of October 2023 (when the data for this study were last updated), 26 of 49 DiGA were permanently listed, while four more had been delisted in the interim.

Secondly, and crucially for proponents of dynamic HTA, the pricing mechanism for DiGA induces an ongoing assessment of their value by obliging the contracting parties – DiGA manufacturers and Germany’s umbrella organization of statutory health insurers – to provide for “performance-based price components.” These components could be simple measurements, such as frequency of use, and/or may involve the development of DiGA-specific health indicators, such as sensor-derived measures or patient-reported outcomes.

The use-case for “dynamic HTA” for SaMD

Three core characteristics render the conduct of HTAs in the context of Germany’s Fast-Track pathway for DiGA unique:

  1. (1) the ability for manufacturers to choose from a range of research designs and outcome measures;

  2. (2) the nature of initial evidence generation, which can be delivered up to one year after a DiGA becomes reimbursable (facilitated by the “DiGA-Fast-Track” pathway described above);

  3. (3) incentives for continuous assessment of a DiGA’s benefit by obliging the parties that engage in price contracting to provide for performance-based price components of pricing/reimbursement. Such a continuous evaluation can be facilitated by using real-world data (RWD) and real-world evidence (RWE) (see Figure 1).

We explain these dynamic features for SaMD HTA and discuss the potential need to further develop a continuous assessment to allow for the ongoing improvement of DiGA via updates. Further, we discuss how RWD can be used to improve such evaluations.

Breadth of positive-care effects

The breadth of “positive-care effects” that are legally acceptable for DiGA reimbursement is broader than what is normally considered in evaluations of traditional therapeutics and medical interventions, which are limited to clinical benefits, such as improvements in morbidity and/or mortality. To make digital products available that provide a wider range of benefits, the option to provide evidence of improvement in “structural and procedural effect” for patients has been introduced in Germany. Such improvements, if established, constitute sufficient criteria for the reimbursement of DiGA and include aspects such as health literacy, access to care, adherence, care coordination, and other patient-centered benefits that are not traditionally included in HTAs for other therapeutics (Reference Brönneke, Debatin and Hagen13).

Table 2 defines both clinical benefits and structural and procedural effects (Column I). Of 55 DiGA in our sample (including the six that became listed and then subsequently left the registry), 53 claimed medical benefits: 42 presented improvements in health status, four presented improvements in quality of life, and seven presented both. Nine of these apps provided further claims of improvement of structure and processes; however, only two became reimbursable on the basis of such a claim (2 and 6, respectively) alone (Column 2). The limited use of such patient-centered, clinical claims suggests that there is still ample potential to incorporate improvements in structure and processes, both in the design of DiGA as well as in their evaluations.

Table 2. Definitions and sample DiGA

Note: * indicates a provisional listing in the DiGA registry. ** indicates that the app was later delisted. DiGA = Digitale Gesundheitsanwendung. For full definitions of each of the positive-care effects, see Section 4.1 of the DiGA Guide (Reference Lauenroth, Kesselheim, Sarpatwari and Stern15). Source: DiGA Registry https://diga.bfarm.de/de/verzeichnis.

Allowing for reimbursement of products that only provide structural and procedural benefits creates a market for manufacturers and products that provide the types of patient benefits that have not traditionally been considered in pharmaceutical or medical product evaluations and can help to ensure revenues for manufacturers while iterative software development and evidence generation proceed. The starting point of such a product development process may be SaMDs that cannot yet demonstrate medical benefits but can demonstrate other patient-relevant benefits based on early data. In particular, SaMD products with the potential to provide medical benefits, in the long run, can be made available to patients in the short run if structural improvements to care can be demonstrated during the initial evaluation period. For example, an application that increases health literacy could indirectly improve the quality of life (Reference Zheng, Jin and Shi19) or add new features that directly provide medical benefits and then generate supporting evidence for these additional claims after becoming reimbursable.

Nature of initial evidence generation

The nature of initial evidence generation is expected to differ for DiGA. While other medical products, such as pharmaceuticals, are typically approved based on completed clinical trials, clinical evidence for DiGA in the German regulatory setting can be delivered up to one year after becoming reimbursable. Further, the existing policies give DiGA manufacturers a large degree of flexibility in choosing research designs, explicitly accepting retrospective studies, such as cohort studies, as sufficient evidence if meaningful data are used and if the study population is comparable with the actual intended users.

This flexibility in the timing of delivery of clinical evidence allows DiGA manufacturers to scale up their evaluation efforts (in some cases, only) once the product is made widely available – facilitating market entry for small firms. In fact, most of the currently available DiGA have opted for small-scale trials for gaining reimbursement initially (Reference Lantzsch, Eckhardt, Campione, Busse and Henschke20). Also, noteworthy is the comparator group selected in DiGA studies: By default, the fast-track process requires a manufacturer to compare the use of the DiGA against the “realities of care,” which also includes comparison to the absence of care, for example, in contexts during which patients usually wait for an extended period of time to begin a treatment or for orphan diseases for which no treatment is available.

Early access to reimbursement for qualifying SaMDs under the DiGA scheme is, however, not uncontroversial. In particular, the sickness funds (German statutory health insurers) that are required to reimburse for approved DiGA have voiced concerns around the introduction of the scheme (21). Two DiGAs that were initially added to the registry have already been removed from reimbursement after they failed to provide sufficient evidence for the benefit they claim to deliver (22). Whether early examples of DiGA that leave the market after the probation period is a sign that the system works – or an indicator of overspending on nonevidence-based apps (albeit only over a brief period of time) – remains an open question for the coming years.

Continuous evaluation

While most medical devices and medicinal products are reimbursed at a fixed price typically negotiated between the manufacturer and health insurers, the legal framework regulating the DiGA system explicitly obligates the contracting partners to provide for performance-based price components of pricing/reimbursement. This means that even after successful demonstrations of benefits in the DiGA process, more evaluations are needed. Such evaluations require the selection of appropriate endpoints for ongoing measurement as well as a financial valuation of the savings (or costs) associated with an improvement (or deterioration) of these. This, in turn, lends itself to and incentivizes the development of scientific methods for evaluating both clinical outcomes and health economic measures using RWE, paving the way for (increasingly) value-based healthcare models (23).

A crucial feature of HTA in the context of SaMD products is that after the initial product launch and evaluation, there is both a need and an opportunity for ongoing product evaluation and modification. This dynamic evaluation is necessary, as products are expected to be updated (and improved) over time. Others have outlined the challenges and opportunities in software-driven devices, with dynamic product development highlighted among them (Reference Gordon and Stern24). A SaMD product must be updated on an ongoing basis ranging from maintaining compatibility with operating systems or browser software to improving performance, fixing bugs, and releasing additional patient-benefiting modules.

The need for continuous evaluations of SaMDs and other medical interventions has been identified before (Reference Tarricone, Petracca, Ciani and Cucciniello25; Reference Catwell and Sheikh26). Further, two recent policy reports on the new DiGA scheme recommend ongoing and “agile” evaluations to meet the requirements of continuously developed and refined DiGA (Reference Lantzsch, Eckhardt, Campione, Busse and Henschke20; 23).

Using RWE to facilitate dynamic HTA

The special features in Germany’s DiGA regulations (the breadth of positive-care effects, the unique and flexible nature of initial evidence generation, and the need for continuous evaluation) highlighted above will require new evaluation methods. One crucial factor for a successful widespread application of dynamic HTA will be the use of RWD and RWE.

FDA provides clear and helpful definitions of RWD and RWE, which we rely upon here:

“Real-world data are the data relating to patient health status and/or the delivery of health care routinely collected from a variety of sources.” (27) These may include data from electronic health records (EHRs), claims and billing activities from the healthcare delivery system, product and/or disease registries, patient-generated data (including from in-home use and digital devices such as wearable sensors), as well as data from other sources that are relevant to the health status, such as data or metadata from mobile devices (27).

Relatedly, but distinctly, “real-world evidence is the clinical evidence regarding the usage and potential benefits or risks of a medical product derived from analysis of RWD.” Generally speaking, “RWE can be generated by different study designs or analyses, including but not limited to, randomized trials, including large simple trials, pragmatic trials, and observational studies (prospective and/or retrospective)” (27)– that is, RWE explicitly covers many of the study design options that are outlined in the regulations that govern acceptable forms of clinical evidence for DiGA in the German market.

Indeed, RWD and RWE can support all three dynamic HTA features described above. First, SaMDs can be designed to record data to evaluate positive-care effects for users over time. For example, metadata from apps themselves can track the duration and frequency of use and therefore measure adherence to a prescribed treatment regimen that involves a SaMD product. Improvements in health status can also be documented via sensors and connected devices, such as smart glucometers for patients with type I diabetes. Other positive care effects can be identified from existing data sources. For example, health insurance claims data can be used to document reductions in illness duration and increases in patient survival. Finally, features such as in-app questionnaires lend themselves easily to the digital environment, providing a standardized framework for collecting data within the context of product use. In-app questionnaires can be used to document several relevant categories of positive-care effects ranging from established scales for measuring patient quality of life to nearly all measures of “structure and process” (see Table 2), such as facilitation of access to care, health literacy, patient sovereignty/autonomy in health management, and reducing therapy-related expenses and burdens for patients and their relatives. Of course, the scope for gathering RWD goes well beyond health insurance claims and in-app questionnaires, and in the future, the increasing digitization of health systems combined with the establishment and growth of patient registries will create new opportunities for the generation of RWD. Looking forward, RWD from a number of sources will be an important input to assessing the benefits and costs/savings associated with new healthcare technologies.

RWD and RWE employed as suggested above also have the potential to support initial evidence generation in the DiGA process. As noted, in order to gain reimbursement in Germany via the DiGA Fast-Track, some forms of initial evidence must be provided to the BfArM. RWE, for example, from claims data, can deliver this initial evidence at costs far below those associated with traditional RCTs. Most importantly, to make ongoing evaluations feasible and the corresponding HTAs truly dynamic, both RWD and RWE will be necessary because full RCTs are simply not feasible for every product update – nor would their requirement be desirable, as it would slow the pace of innovation and/or roll-out of improvements and additional beneficial features to patients. Indeed, many non-digital medical devices undergo incremental innovation, whereby new product versions can be released without a full clinical evaluation involving RCTs.

RWE has been widely used in many countries. Pongiglione et al. (Reference Pongiglione and Torbica28) provide a review of sources of RWD and to what extent they are known and used in medical, epidemiological, and economic research in 13 European countries. One example shows that cancer survival rates are higher for participants of an RCT versus an RWE cohort (Reference Wang, Adamson, Tan, Baxi, Briggs and Ramsay29). The National Institute for Health and Care Excellence regularly accepts RWE in the evaluation of cancer drugs (Reference Bullement, Podkonjak and Robinson30) as does FDA, which has published formal regulatory guidance on the use of RWD and RWE for studies of biologic drugs (31) and medical devices (32) as well as specific recommendations on the use of HER data in clinical investigations (33). Even though expert interviews from Germany reveal a generally positive attitude toward RWD and RWE (Reference Sievers, Joos and Hiligsmann34), none of the DiGA approved to date have used this form of data and evidence generation, suggesting a clear opportunity for the introduction of new tools and data sources going forward. There are already important steps toward that goal with new tools currently developed for example in the framework of data fusion (Reference Hünermund and Bareinboim35) while a new research data center for healthcare data currently established in Germany can serve as a hub for RWE studies.Footnote 1

Of course, the use of RWE has many limits. Causal inference is more difficult than in RCTs and managing challenges such as patient selection, data representativeness, and data privacy/security will be key issues for the practical success of implementing RWE in the German context. Further, researchers have highlighted key areas that should be prioritized for the use of RWE in digital medical product evaluation and in the promotion of international harmonization of best evidentiary practices. These include the establishment of best practices around topics including missing data, study endpoints, comparator group(s), multimodal interventions, study question(s), equity, generalizability, confounders, and fit-for-purpose approaches (Reference Stern, Bronneke and Debatin36). However, the promise of more and richer data, better tools, and more patient-centered data collection and product launches also provide an overwhelming promise for learning to implement RWE approaches thoughtfully. Institutionalizing continuous evaluation with RWE for SaMDs, however, could be the first step toward a broader movement of assessing benefits in healthcare systems both on the disease and system levels (Reference Kirwin, Meacock, Round and Sutton37).

More broadly, pioneers of RWE for dynamic HTA in the SaMD setting may also garner insights from studying other approaches that take advantage of dynamic, ongoing data generation – and in particular, the use of RWD for health economic decision-making internationally. For example, “coverage with evidence development” (CED) has many parallels with the DiGA Fast-Track. Experts on CED have noted that when used “selectively” and for “innovative” interventions, this approach can “provide patient access…while data to minimize uncertainty are collected” (Reference Trueman, Grainger and Downs38). Other work on CED has described the types of settings in which such an approach is likely to be most appropriate, arguing for its use when “there are reasonable grounds for believing that a technology will offer significant benefits” and remaining uncertainty “around the clinical or cost effectiveness…can be overcome through evidence that can be generated in an appropriate time frame and is the main source of equivocality in a coverage decision” (Reference Hutton, Trueman and Henshall39), a set of circumstances that also directly applies to the second core characteristic of HTAs in the context of Germany’s Fast-Track pathway for DiGA.

Conclusion

Digital health applications and the accompanying demand for dynamic HTA present both a significant challenge and great opportunity for contemporary healthcare delivery. In Germany, new policies now allow for the use of both a broader set of research designs and more flexible approaches for their demonstration. However, early experience with evidence generation has shown that manufacturers are still hesitant to focus on nontraditional endpoints and nontraditional evidence-generation strategies. In particular, recent changes to German policy have facilitated reimbursement of SaMD products that do not necessarily fit with either current HTA approaches nor are they well-matched to the unique characteristics and additional needs of digital health applications (in particular, ongoing development and, as a corollary, a need for ongoing evaluation).

As such, a new, dynamic HTA will be important both to facilitate continuous improvement and ongoing reimbursement of innovative healthcare solutions as well as the basis for their fair, evidence-based, and efficient reimbursement after launch. Additionally, the approaches presented here may have implications for the development of HTA for non-digital products such as orphan drugs, where approval decisions may be made based on limited evidence and subsequently supported by RWD and RWE from routine medical practice (e.g., claims data) or registries.

The next generation of HTAs for SaMD in general – and for DiGAs in Germany in particular – will need to take advantage of new sources of RWD and methodological innovations, including improvements and best practices in the use of RWD, while managing the challenges unique to using RWE. If successful, such approaches will facilitate patient access to demonstrably beneficial SaMD products and ensure that their prices are value-based and, by doing so, improve the healthcare delivery system for all parties.

Appendix

Figure 1. Ongoing evaluation of digital health applications in Germany.

References

Software as a Medical Device (SaMD). Key definitions [Internet]. IMDRF SaMD Working Group; 2013 Dec p. 9. Available from: http://www.imdrf.org/docs/imdrf/final/technical/imdrf-tech-131209-samd-key-definitions-140901.pdf.Google Scholar
Software as a Medical Device (SAMD). Clinical evaluation - Guidance for industry and food and drug administration staff [Internet]. IMDRF SaMD Working Group; 2017 Dec. Available from: https://www.fda.gov/media/100714/download’.Google Scholar
Essen, A, Stern, AD, Haase, CB, et al. Health app policy: International comparison of nine countries’ approaches. NPJ Digit Med. 2022;5(1):31.CrossRefGoogle ScholarPubMed
Evidence standards framework for Digital Health Technologies [Internet]. National Institute for Health and Care Excellence. NICE; 2018 [cited 2022 July 31]. Available from: https://www.nice.org.uk/corporate/ecd7/resources/evidence-standards-framework-for-digital-health-technologies-pdf-1124017457605.Google Scholar
Unsworth, H, Dillon, B, Collinson, L, et al. The NICE evidence standards framework for digital health and care technologies - Developing and maintaining an innovative evidence framework with global impact. Digit Health. 2021;7:20552076211018617.Google ScholarPubMed
FDA Launches the Digital Health Center of Excellence [Internet]. U.S. Food and Drug Administration. FDA; 2020 [cited 2021 Aug 7]. Available from: https://www.fda.gov/news-events/press-announcements/fda-launches-digital-health-center-excellence.Google Scholar
Regulation (EU). 2017/745 of the European Parliament and of the Council of 5 April 2017 on medical devices, amending Directive 2001/83/EC, Regulation (EC) No 178/2002 and Regulation (EC) No 1223/2009 and repealing Council Directives 90/385/EEC and 93/42/EEC (Text with EEA relevance.) [Internet]. Apr 5, 2017. Available from: https://eur-lex.europa.eu/legal-content/EN/ALL/?uri=CELEX%3A32017R0745.Google Scholar
MDCG. 2021–24 Guidance on classification of medical devices [Internet]. European Commission; 2021 Oct. Available from: https://ec.europa.eu/health/system/files/2021-10/mdcg_2021-24_en_0.pdf.Google Scholar
Notified bodies [Internet]. Internal Market, Industry, Entrepreneurship and SMEs - European Commission. 2016 [cited 2021 Aug 7]. Available from: https://ec.europa.eu/growth/single-market/goods/building-blocks/notified-bodies_en.Google Scholar
Health Technology Assessment: Informal deal between Council and European Parliament [Internet]. European Council. [cited 2021 Aug 7]. Available from: https://www.consilium.europa.eu/en/press/press-releases/2021/06/22/health-technology-assessment-informal-deal-between-council-and-european-parliament/.Google Scholar
Driving the digital transformation of Germany’s healthcare system for the good of patients [Internet]. Bundesgesundheitsministerium. [cited 2021 Jul 29]. Available from: https://www.bundesgesundheitsministerium.de/digital-healthcare-act.html.Google Scholar
Digitale-Gesundheitsanwendungen-Verordnung (DiGAV) [Internet]. Bundesgesundheitsministerium. [cited 2021 Aug 8]. Available from: https://www.bundesgesundheitsministerium.de/service/gesetze-und-verordnungen/guv-19-lp/digav.html.Google Scholar
Brönneke, JB, Debatin, JF, Hagen, J, et al. DiGA VADEMECUM: How to Launch Digital Health Apps in the German Healthcare System. Berlin, Germany: MWV Medizinisch Wissenschaftiche Verlag; 2021.Google Scholar
Stern, AD, Pietrulla, F, Herr, A, Kesselheim, AS, Sarpatwari, A. The impact of price regulation on the availability of new drugs in Germany. Health Aff. 2019;38(7):11821187.CrossRefGoogle ScholarPubMed
Lauenroth, VD, Kesselheim, AS, Sarpatwari, A, Stern, AD. Lessons from the impact of price regulation on the pricing of anticancer drugs in Germany. Health Aff. 2020;39(7):11851193.CrossRefGoogle ScholarPubMed
Drummond, M, Griffin, A, Tarricone, R. Economic evaluation for devices and drugs—Same or different? Value Health. 2009;12(4):402404.CrossRefGoogle ScholarPubMed
Moshi, MR, Tooher, R, Merlin, T. Suitability of current evaluation frameworks for use in the health technology assessment of mobile medical applications: A systematic review. Int J Technol Assess Health Care. 2018;34(5):464475.CrossRefGoogle ScholarPubMed
The Fast-Track Process for Digital Health Applications (DiGA) according to Section 139e SGB V [Internet]. Federal Institute for Drugs and Medical Devices; 2020 Aug. Available from: https://www.bfarm.de/SharedDocs/Downloads/EN/MedicalDevices/DiGA_Guide.pdf?__blob=publicationFile&v=2.Google Scholar
Zheng, M, Jin, H, Shi, N, et al. The relationship between health literacy and quality of life: A systematic review and meta-analysis. Health Qual Life Outcomes. 2018;16:201.CrossRefGoogle ScholarPubMed
Lantzsch, H, Eckhardt, H, Campione, A, Busse, R, Henschke, C. Digital health applications and the fast-track pathway to public health coverage in Germany: Challenges and opportunities based on first results. BMC Health Serv Res. 2022;22(1):1182.CrossRefGoogle ScholarPubMed
Zweite DiGA kann nicht mehr verordnet werden [Internet]. Aertzblatt. 2022 May 17 [cited 31 July 2022]. Available from: https://www.aerzteblatt.de/nachrichten/134294/Zweite-DiGA-kann-nicht-mehr-verordnet-werden.Google Scholar
I.DiGA. Wege zu einer besseren Implementierung von digitalen Gesundheitsanwendungen in die Gesundheitsversorgung der GKV [Internet]. 2021 Jan. Available from: https://www.mig.tu-berlin.de/fileadmin/a38331600/I.DiGA_Ergebnispapier_6.pdf.Google Scholar
Gordon, WJ, Stern, AD. Challenges and opportunities in software-driven medical devices. Nat Biomed Eng. 2019;3(7):493497.CrossRefGoogle ScholarPubMed
Tarricone, R, Petracca, F, Ciani, O, Cucciniello, M. Distinguishing features in the assessment of mHealth apps. Expert Rev Pharmacoecon Outcomes Res. 2021;21(4):521526.CrossRefGoogle ScholarPubMed
Catwell, L, Sheikh, A. Evaluating eHealth interventions: The need for continuous systemic evaluation. PLoS Med. 2009;6(8):e1000126.CrossRefGoogle ScholarPubMed
Real-World Evidence [Internet]. U.S. Food and Drug Administration. FDA; 2021 [cited 2021 Jul 31]. Available from: https://www.fda.gov/science-research/science-and-research-special-topics/real-world-evidence.Google Scholar
Pongiglione, B, Torbica, A. VP49 real-world evidence for economic evaluation of medical devices. Int J Technol Assess Health Care. 2019;35:8788.CrossRefGoogle Scholar
Wang, X, Adamson, BJ, Tan, K, Baxi, S, Briggs, A, Ramsay, SD. OP520 evaluating long-term survival from clinical trials: Does real-world evidence change the paradigm? Int J Technol Assess Health Care. 2020;36(S1):12.CrossRefGoogle Scholar
Bullement, A, Podkonjak, T, Robinson, MJ, et al. Real-world evidence use in assessments of cancer drugs by NICE. Int J Technol Assess Health Care. 2020;36(4):388394.CrossRefGoogle Scholar
Research C for DE and Submitting Documents using Real-World Data and Real-World Evidence to FDA for Drugs and Biologics Guidance for Industry [Internet]. U.S. Food and Drug Administration. FDA; 2019 [cited 2021 Aug 8]. Available from: https://www.fda.gov/regulatory-information/search-fda-guidance-documents/submitting-documents-using-real-world-data-and-real-world-evidence-fda-drugs-and-biologics-guidance.Google Scholar
Use of Real-World Evidence to Support Regulatory Decision-Making for Medical Devices [Internet]. U.S. Food and Drug Administration. FDA; 2017 [cited 2021 Aug 8]. Available from: https://www.fda.gov/regulatory-information/search-fda-guidance-documents/use-real-world-evidence-support-regulatory-decision-making-medical-devices.Google Scholar
Use of Electronic Health Record Data in Clinical Investigations Guidance for Industry [Internet]. U.S. Food and Drug Administration. FDA; 2018 [cited 2021 Aug 8]. Available from: https://www.fda.gov/regulatory-information/search-fda-guidance-documents/use-electronic-health-record-data-clinical-investigations-guidance-industry.Google Scholar
Sievers, H, Joos, A, Hiligsmann, M. Real-world evidence: Perspectives on challenges, value, and alignment of regulatory and national health technology assessment data collection requirements. Int J Technol Assess Health Care. 2021;37:e40.CrossRefGoogle ScholarPubMed
Hünermund, P, Bareinboim, E. Causal inference and data fusion in econometrics [Internet]. 2019 Dec [cited 2022 July 31]. Available from: https://arxiv.org/abs/1912.09104.CrossRefGoogle Scholar
Stern, AD, Bronneke, J, Debatin, JF, et al. Advancing digital health applications: Priorities for innovation in real-world evidence generation. Lancet Digit Health. 2022;4(3):e200e206.CrossRefGoogle ScholarPubMed
Kirwin, E, Meacock, R, Round, J, Sutton, M. The diagonal approach: A theoretic framework for the economic evaluation of vertical and horizontal interventions in healthcare. Soc Sci Med. 2022;301:114900.CrossRefGoogle ScholarPubMed
Trueman, P, Grainger, DL, Downs, KE. Coverage with evidence development: Applications and issues. Int J Technol Assess Health Care. 2010;26(1):7985.CrossRefGoogle ScholarPubMed
Hutton, J, Trueman, P, Henshall, C. Coverage with evidence development: An examination of conceptual and policy issues. Int J Technol Assess Health Care. 2007;23(4):425432.CrossRefGoogle ScholarPubMed
Figure 0

Table 1. Products listed in the DiGA registry as of October 10, 2023, n = 55

Figure 1

Table 2. Definitions and sample DiGA

Figure 2

Figure 1. Ongoing evaluation of digital health applications in Germany.