Hostname: page-component-54dcc4c588-b5cpw Total loading time: 0 Render date: 2025-10-01T04:33:27.874Z Has data issue: false hasContentIssue false

Measuring the strength of primary care: development of a new system of Structural Indicators for the Strength of Primary Care – SiSPC

Published online by Cambridge University Press:  30 September 2025

Wienke G.W. Boerma
Affiliation:
Netherlands Institute for Health Services Research (Nivel), Utrecht, Netherlands
Peter Groenewegen*
Affiliation:
Netherlands Institute for Health Services Research (Nivel), Utrecht, Netherlands
Rob Timans
Affiliation:
Netherlands Institute for Health Services Research (Nivel), Utrecht, Netherlands
Sarah Burgmann
Affiliation:
Austrian National Public Health Institute, Vienna, Austria
Rosa Suñol
Affiliation:
Fundació Avedis Donabedian, Barcelona, Spain
Pili Illarramendi Charovsky
Affiliation:
Fundació Avedis Donabedian, Barcelona, Spain
Jose M. Valderas
Affiliation:
Centre for Research in Health System Performance (CRiHSP), Yong Loo Lin School of Medicine, National University Health System, Singapore
*
Corresponding author: Peter Groenewegen; Email: p.groenewegen@nivel.nl
Rights & Permissions [Opens in a new window]

Abstract

Aim:

The aim of this study was to develop an up-to-date system of Structural Indicators for the Strength of Primary Care (SiSPC) to enable comparisons of primary care systems across countries.

Background:

Indicators are needed for international research into the development of primary care and to support countries in monitoring improvements in access, responsiveness and efficiency of their primary care services. International comparisons with use of identical indicators for the strength of primary care offer policymakers opportunities to learn lessons from abroad.

Methods:

Our point of departure was the Primary Health Care Activity Monitor Europe (PHAMEU), that effectively measured the strength of primary care at the beginning of this century. We went through the following steps: (1) Reduction, refining and tuning of the PHAMEU indicator system (2) comparison with the European Primary Health Care, Impact, Performance and Capacity Tool (PHC-IMPACT) (3) addition of topics from other frameworks (4) identification of topical issues from the literature. The resulting draft indicator system was discussed at meetings and received feedback from experts from 25 countries.

Findings:

SiSPC consists of three care-related domains: Structure of Primary Care, Systemic Aspects of Facility Management and Systemic Aspects of Care Delivery. SiSPC also contains a domain on the Context of Primary Care. Care processes that vary between care providers, were not included as a domain at the system level.

Information

Type
Research
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
© The Author(s), 2025. Published by Cambridge University Press

The health needs of the population have strongly changed over the years (Mackenbach, Reference Mackenbach2019). Demographic changes have led to a growing number of older people, often living in the community. These changes, coupled with changes in life-style, have resulted in rising numbers of people with a chronic disease, especially those with several chronic diseases. (Adan et al., Reference Adan, Gillies, Tyrer and Khunti2020). Health care systems struggle to find an answer to the quantitative and qualitative changes in healthcare needs that result from these changes (Rijken et al., Reference Rijken, Hujala, Van Ginneken, Melchiorre, Groenewegen and Schellevis2018). Patients with (multiple) chronic conditions need accessible healthcare services with a focus on their person, and taking their context and medical history into account, rather than on their disease(s). Instead, today’s health care systems are usually fragmented with specialist care provided in mono-professional silos and with a dominant single-disease orientation. Furthermore, possible connections between health needs and social needs are easily overlooked (Akiya et al., Reference Akiya, Fisher, Wells, Li, Peck and Pagán2021).

Primary care indicates the part of the health care system that delivers ambulatory, general medicine first-contact care to the community-dwelling population. The term primary health care is more action-related and refers to a policy approach to achieve universal health coverage and equal access to basic and affordable health care services for everybody. We focus on primary care as service delivery. Many countries aim to strengthen primary care as a strategy to make their health care systems more person-centred. Person-centeredness is a key characteristic of primary care, in addition to a generalist and community-oriented approach. Strong primary care provides accessible and continuous care of a comprehensive nature; if patients are in need of this, care provided by specialists or mental and social services is coordinated (Starfield, Reference Starfield1994).

Previous international comparative research has shown that countries differ in the strength of their primary care systems. Such differences are related to aspects of quality and costs of care (Kringos et al., Reference Kringos, Boerma, Bourgueil, Cartier, Dedeu, Hasvold, Hutchinson, Lember, Oleszczyk, Rotar-Pavlic, Svab, Tedeschi, Wilm, Windak, Van der Zee and Groenewegen2013a). International comparative studies will continue to be needed to provide policymakers with guidance to tune their health care systems, including primary care, in line with policy goals. A comprehensive, integrated and well-founded system of indicators for the strength of primary care must be part of such comparisons.

The reason for the development of our system of Structural Indicators for the Strength of Primary Care (SiSPC) was linked to the PaRIS project. This is the International Survey on Outcomes and Experiences of People Living with Chronic Conditions, initiated by the Organisation for Economic Cooperation and Development (OECD). The PaRIS project was coordinated by a consortium, led by the Netherlands Institute for Health Services Research (Nivel) (OECD, 2025). We developed SiSPC parallel to this project to enable answering future research questions related to health system and country-level influences on patient-reported experiences and outcomes. In our approach of developing the SiSPC indicator system we started with the PHAMEU (Primary care activity monitor Europe) framework. With the PHAMEU indicators the strength of primary care systems has been measured in 31 countries (Kringos, Reference Kringos2012). These indicators have also later been used in the international QUALICOPC study (Schäfer et al., Reference Schäfer, Boerma, Van Den Berg, De Maeseneer, De Rosis, Detollenaere, Greß, Heinemann, Van Loenen, Murante, Rotar-Pavlic, Seghieri, Vainieri, Willems and Groenewegen2019) as well as other studies (Hansen et al., Reference Hansen, Groenewegen, Boerma and Kringos2015) and have been at the basis of policy initiatives in individual countries. Although the starting point for the development of SiSPC was the OECD PaRIS project, the focus will be broader. We also include the (European) countries where the PHAMEU indicator set was measured and that are not OECD members (Bulgaria, Cyprus, Malta, North Macedonia), non-OECD members that participated in PaRIS (Romania and Saudi Arabia), and the non-European countries that participated in the QUALICOPC project (Australia, New Zealand, Canada).

We had the following arguments for developing an updated framework and system of indicators. The PHAMEU indicators reflect the situation at the beginning of this century. Monitoring today requires more recent developments in primary care to be taken into account. Changes in primary care and in health needs in populations, societal priorities and other conditions, not only call for an update, but probably for an extension as well. A new and up-to-date dataset will allow for current comparisons of countries. The research presented here aimed to develop an up-to-date system of indicators to be used for the measurement of the strength of primary care.

Methods

The indicator system to be developed should satisfy a number of requirements:

  • - Focus on the national system level: indicators should exclusively focus on the way primary care is structured, organized and regulated at country or system level.

  • - Topical: new insights and developments on the role of primary care in the context of health care systems should be represented.

  • - Balanced orientation: the focus of the PaRIS project is on service provision to patients living with chronic diseases. However, SiSPC aims to have a balanced approach and should also reflect primary care’s broad attention to prevention and treatment, acute and chronic disease, palliative care, and to people of all ages.

  • - System diverse: indicators must be relevant and applicable to various health care systems (e.g. in higher-middle- and high-income countries in Europe and OECD member states outside Europe).

  • - Evidence-based: indicators should be supported by evidence in the international literature for the relationship with outcomes, be they survey-based patients’ experiences and outcomes, or other, aggregate outcomes at country level.

  • - Comparable and valid: information to be collected must be recent, valid and as comparable as possible.

  • - Feasible and parsimonious: indicator items should be measurable, preferably with easily accessible sources of information and they should have added value.

To develop SiSPC, we have gone through the following steps.

  1. 1. Reduction of the number of PHAMEU indicators. The core development team (WB and PG) reviewed the PHAMEU indicator items critically on their suitability for SiSPC. We also analyzed the contribution of individual items to the latent variables that formed the dimensions of PHAMEU and deleted those with low item-total correlations. What remained after this step served as the groundwork for the development of SISPC.

  2. 2. Merging the remaining items of PHAMEU and the WHO PHC-IMPACT Tool. The recent ‘European Primary Health Care, Impact, Performance and Capacity Tool’ (PHC-IMPACT) is a comprehensive system of indicators that fits very well with the structure of PHAMEU (WHO, 2019). Therefore, we decided to merge it with what remained of PHAMEU after step 1 to have a firm body of indicators before searching and reviewing other sources. PHC-IMPACT is a service tool for WHO Member States. Key informants and surveys are frequently mentioned as sources. Until now, we have seen no database with measurements of the indicators from PHC-IMPACT. PHAMEU provided measurement of all indicators and this is also the aspiration of SiSPC.

  3. 3. Adding relevant elements from other frameworks. Our search for frameworks aimed to compensate for possible limitations or omissions of PHAMEU and PHC-IMPACT. We scanned the literature to identify other relevant frameworks. The scan was done in the context of developing the overall conceptual framework of the PaRIS project; we refer to the Methods section in Valderas et al. (Valderas et al., Reference Valderas, Porter, Martin Delgado, Rijken, De Jong, Groene, Bloemeke-Cammin, Sunol, Williams, Ballester, De Biennassis, Kendir, Guanais, De Boer and Van Den Berg2024, De Boer et al., Reference De Boer, Van Den Berg, Ballester, Bloemeke, Boerma, De Bienassis, Groenewegen, Groene, Kendir, Klazinga, Porter, Sunol, Thomas, Valderas, Williams and Rijken2022). A separate search was made for Spanish-speaking countries in the Americas to capture the specific approach provided in those countries. We restricted the search to national and international primary care frameworks from 2010 and later (previous ones having been incorporated in PHAMEU).

  4. 4. Integrating topical issues. We view topical issues both as current challenges in primary care and key elements of a vision of what is needed for primary care to cope with these challenges. We identified topical issues through a review of reports, documents and policy briefs from professional and international organizations, available on the internet and published after 2010. The selected publications were independently examined by two researchers to identify insights, visions and innovations that should make primary care fit for the future. Agreed topics have been listed and examined again in the light of the requirements. For each of the resulting topics, it was decided whether they were covered by the results of the previous steps. If not, indicators were formulated by two researchers in a consensus procedure.

  5. 5. Processing internal and external feedback on the development process and its result. At several occasions in different stages of the process the core development team (WB and PG) received feedback. Members the consortium that implemented the PaRIS surveys provided feedback on provisional versions of SiSPC at team meetings in 2022, 2023 and 2024. In September 2022, the provisional framework was presented and discussed at a conference of the European Forum for Primary Care (EFPC) in Ghent (Belgium). As a final test, the draft version of SiSPC was distributed in December 2024 among primary care experts in 34 countries, including the National Project Managers (NPMs) of the PaRIS project. As these experts will be involved in the first data collection round of SiSPC, they were particularly invited to focus on the relevance and clarity of the indicator items and the workload and feasibility of data collection. These various occasions of review and feedback aimed to identify and repair redundancies, gaps, poor validity and measurability. A recent overview of the evidence for aspects of strong primary care was provided in an EFPC Position Paper (Akman et al., Reference Akman, Ayhan Başer, Usanma Koban, Marti, Decat, Lefeuvre and Miller2022). However, in particular for emerging topics the availability of evidence is likely to lag behind. In those cases, inclusion was based on consensus in the research team.

Results

The results will be presented in line with the steps mentioned in the previous section. This has been visualized in the flow chart of Figure 1.

Figure 1. Overview of steps in the development of SiSPC.

Step 1: Review and tuning of the PHAMEU framework and indicators

Following Donabedian, the PHAMEU framework distinguishes the broad domains structure, process and outcomes, which are broken down to dimensions, as depicted in Figure 2 (Donabedian, Reference Donabedian1988, Kringos et al., Reference Kringos, Boerma, Bourgueil, Cartier, Hasvold, Hutchinson, Lember, Oleszczyk, Pavlic, Svab, Tedeschi, Wilson, Windak, Dedeu and Wilm2010, EXPH, 2017).

Figure 2. The PHAMEU framework of primary care.

We reviewed the framework in line with our requirements, resulting in the following decisions. The three dimensions of Domain 1 Structure of primary care (Governance; Economic conditions of primary care; Primary care Workforce Development) have been maintained.

Concerning Domain 2 (Process of primary care) we made a distinction between indicators that should be measured at system level and others that can more suitably be measured through surveys among providers and patients. Our main criterion was whether process indicators vary between care providers within countries or not. Only if they do not (substantially) vary, we have adopted them as system characteristics. The application of this criterion led to the removal of 24 indicators. Those we maintained were labelled ‘Systemic aspects of care delivery’. We use the term ‘systemic’ to emphasize that these indicators are measured at (national) health system level and not at the level of primary care practices.

Domain 3 (Outcomes of primary care) was excluded altogether as it does not measure the strength of primary care but the consequences of strong primary care. This led to the removal of 30 indicators on outcomes.

We identified a gap in the framework related to Domain 1 (Structure of primary care). We added indicators, covering national regulation that facilitate service delivery and local management. Such regulation can provide important incentives to organize the delivery of care professionally, e.g. by stimulating local practice management. Since the conceptualization of PHAMEU, regulatory aspects of primary care delivery have changed. We therefore included this new domain, and labelled it ‘Systemic aspects of facility management’.

In addition to the critical review of the framework, the PHAMEU indicators have been analyzed statistically to assess their contribution to the overall dimensions by computing item-total correlations. In previous studies, separate indicator items have rarely been used to characterize primary care systems. Usually, they have been combined into the dimensions through latent variable analysis. We have excluded 23 indicators with low correlations to the total score for each dimension. An example of an indicator, removed based on this analysis, is one about whether primary care has a separate department or unit within the Ministry of Health. This indicator had a low correlation to the overall dimension of Governance. The review of the PHAMEU framework (as described above) and the statistical analysis on the indicators’ contribution to the latent variables altogether resulted in exclusion of 77 from the original 122 indicators of PHAMEU.

Step 2: Merging the remaining indicators of PHAMEU with WHO PHC-IMPACT

WHO PHC-IMPACT encompasses a comprehensive set of indicators, developed by the World Health Organization Regional Office for Europe and aiming to generate performance intelligence to strengthen and monitor the potentials of primary care for the benefit of Universal Health Coverage (Barbazza et al., Reference Barbazza, Kringos, Kruse, Klazinga and Tello2019). For the practical use by countries, the indicators are provided in a so-called Indicator Passport, structured in domains, features and indicator questions. The main components of the WHO PHC-IMPACT framework are: Capacity, Performance and Impact of primary care (from right to left in Figure 3). From broad to specific, each of these components have been structured in six domains, 26 subdomains and 63 features, which have eventually been operationalized into 139 indicators. As the purpose of SiSPC is to characterize primary care specifically at the national level, the component of ‘Capacity’ and of ‘Performance’ (as far as process indicators at system level are concerned) are most relevant here.

Figure 3. The framework underpinning PHC-IMPACT.

The evidence-base of PHC-IMPACT started from the PHAMEU systematic review which was updated by a literature review to identify frameworks and tools published between 2010 and the date of the search (2016–17) (Barbazza et al., Reference Barbazza, Kringos, Kruse, Klazinga and Tello2019).

It turned out that 21 indicators that we included from the PHAMEU list were (more or less) the same in PHC-IMPACT. Indicators that were in PHC-IMPACT, but not in the remaining PHAMEU indicator set, and satisfied our requirements, related to:

  • - A licensing system for family physicians (FPs) or primary care nurses

  • - Support for family carers

  • - Primary care benefit package

  • - Tasks of FPs formally defined

  • - Age balance in active FPs

  • - Time FP trainees spend in primary care

  • - Predominant practice settings of FPs

  • - Quality assurance mechanisms

  • - Patient experiences measured and published

  • - Quality of care processes implemented in primary care practices

  • - Role for representatives of citizens/patients

  • - Screening programmes operating via primary care

  • - Prescriptions by FP without specialist recommendation

These topics have been taken into consideration to be elaborated in indicators for SiSPC.

Step 3: Searching for other frameworks and extracting relevant elements

From our scan of the literature, we evaluated nine frameworks. They revealed new domains, new dimensions and related new indicators.

Within the domain of the Structure of primary care, we added the dimension of ‘Information structures’, to explicitly cover issues like access to and use of shared medical records and a learning primary care system.

Within the (new) domain of ‘Systemic aspects of facility management’, professionalization of practice management resulted as a potential field of interest. Furthermore, ‘Composition of the primary care team’ was mentioned as potentially relevant in Systemic aspects of service delivery.

Finally, we found a few indicator fields that, in this stage, did not fit well in the proposed domains (see Table 1). We parked them – provisionally – in the domain ‘Not fitting in above Domains’. In later stages of the project, as domains further got their shape, it turned out that these indicator fields could be absorbed by one of the other domains.

Table 1. Overview of domains and indicator fields from other primary care-relevant frameworks

The results of our third step, screening of other frameworks, are summarized in Table 1.

In screening the other frameworks, we found a category of indicators which was missing both in PHAMEU and PHC-IMPACT: indicators for the context in which primary care operates. We included ‘Context’ in our framework, be it with a special status, as these indicators do not inform about the strength of primary care in a specific country. Nevertheless, they are important in understanding why primary care is stronger in some countries than in others. Context aspects concern the broader health system; the political, social and cultural influences on the primary care system (Sidel and Sidel, Reference Sidel and Sidel1977, Kringos et al., Reference Kringos, Boerma, Van Der Zee and Groenewegen2013b), and the non-health care determinants of health (Whitehead, Reference Whitehead1990, Whitehead and Dahlgren, Reference Whitehead and Dahlgren2006), as shown in Table 2.

Table 2. Overview of indicator fields on context

Step 4: Integrating topical issues

The fourth step resulted from our aim to have an up-to-date system of indicators, reflecting current (and future) challenges and needs in primary care systems that are not already incorporated in previously considered frameworks. Topical issues in primary care have been identified through a review of authoritative reports of professional and international organizations that identify insights, visions and innovations that should make primary care fit for the future.

We have identified 14 challenges and issues that play (or will play) a role in primary care. These are listed below with our decision whether each of them were covered or not by the current system of indicators. If not, one or more new indicators were added.

Step 5: Processing feedback on the development process and provisional indicator system

The fifth and final step in the process of developing SiSPC consisted of consulting experts and processing their feedback. The consortium partners who implemented the PaRIS project, provided input online throughout the project and at physical meetings in September 2023 and 2024. In an early phase of the development of SiSPC, we organized a workshop at the yearly conference of EFPC, attended by some twenty participants from various countries (including e.g. Austria, Azerbaijan, Belgium, and France) and with backgrounds in general practice, policy making and research. Some of the challenges to strengthening primary care, mentioned in the workshop, were:

  • - Fragmentation of payment systems for primary care providers, leading to less efficient and less satisfactory organization of primary care;

  • - Unclear roles and responsibilities of stakeholders involved in the governance of primary care;

  • - Availability and implementation of self-monitoring devices for patients with chronic conditions;

  • - Use of primary care-generated information for surveillance;

  • - Organization of out-of-hours services regarding to the role of FPs and accessibility to patients.

Successes of primary care in participants’ countries were mentioned as well, in particular:

  • - Availability and use of guidelines;

  • - Availability of (shared) data from electronic medical files.

Concerning community participation in primary care, the following issues were suggested:

  • - Community participation is relevant both at the level of primary care practices and in health care institutions at the national level (e.g. insurance bodies);

  • - The importance of non-disease-specific, national patient platforms;

  • - The existence of legislation or national support for patient councils at primary care practice level.

In the December 2024, the draft of SiSPC was sent to experts in 34 countries. By the end of February 2025 and after only one reminder, experts from 25 countries had responded (see the acknowledgement at the end of this article). They all were positive about the initiative to develop a new system of indicators for the strength of primary care. More general remarks and suggestions that were made concern:

  • - Balanced focus

A general problem identified is whether there is enough focus on chronic disease or too much. The PaRIS project focussed on primary care for people living with chronic conditions. However, primary care also has an important role in prevention and care for acute episodes. SiSPC aims to provide a balance between attention to chronic care and other roles of primary care. Many of the aspects of strong primary care are especially relevant for people with a chronic disease (e.g., coordination and comprehensiveness of primary care). At the same time, we have included indicator items relating to prevention and acute care.

  • - Focus on FPs

The indicators that constitute SiSPC mainly refer to FPs. Ideally, all other professions active in primary care teams should also be considered. We have concluded that this is unfeasible for several reasons. First, FPs are still the backbone of primary care; secondly, equal attention to all other primary care disciplines would multiply the number of indicators, while there is little information on other professions. However, we have devoted attention to practice nurses, whose profession is increasingly important for strong primary care, especially in the care for people with a chronic disease.

  • - The time dimension

The SiSPC indicator system does not contain items on changes over time. The measurement of the SiSPC indicator system will represent the situation in the early 2020’s. A first indication of changes may come from a comparison with the PHAMEU indicator system. However, more importantly, we hope that SiSPC will be updated in line with future rounds of the PaRIS project. This will show future changes in the strength of primary care. Basically, SiSPC will provide repeated cross-sections.

  • - Relevance of answering categories

In some countries, the answering categories for indicator items do not cover the specific situation in that country. Reviewers suggested that there could be options for ‘Not applicable’, ‘Partial’ or ‘no available data’ for some indicators. Also, we should provide the option ‘Other’ with the possibility of free-text input more often. We have reviewed all indicator items to see whether additional answering options are needed. Related to this is how to deal with federal countries that have differences in their primary care system in federal states or autonomous provinces. Here, the focus remains on the communalities at country level.

  • - A core set of indicators

It was suggested to define a core set of indicators for the strength of primary care. We are not in favour of this. The indicator items refer to dimensions of strong primary care and after data collection will be combined through a statistical model. A core set of indicators may be easier for data collection but would miss out important areas. The statistical analysis will provide information on which indicator items are less relevant for an overarching dimension and that can be skipped in future data collections.

Specific additions resulting from the experts’ remarks are listed in Table 3. We left out smaller changes in wording of indicator items and in the answering options.

Table 3. Feedback resulting in an removal, addition or change by domain and dimension

The resulting full system of SiSPC indicators

As a result of the five steps, SiSPC consists of the following four domains (and dimensions within these domains):

  • - Context of Primary Care (Population, Economy, Social- and cultural values, Welfare benefits and social protection, Education (-related) resources, Life style, Health system overall);

  • - Structure of Primary Care (Governance, Economic & Financial Conditions, Workforce Development, Information Structures);

  • - Systemic Aspects of Facility Management (Scale of Primary Care Delivery, Systems /structures for Quality Assurance and Safety, Practice Management Incentives, Community Involvement);

  • - Systemic Aspects of Care Delivery (Accessibility, Comprehensiveness, Continuity, Coordination).

The full system of indicators is provided in the appendix; a selection of one item for each dimension is given in Table 4.

Table 4. Overview of the domains and dimensions (with the number of indicators) and one exemplary SiSPC indicator for each dimension and their response categories

Discussion

We have developed the new indicator system SiSPC in a number of steps. SiSPC is based on existing frameworks. The (future) measurement of the items will provide continuity with the past and make comparison over time possible. Topical issues and challenges were added to provide an update with new indicators for the strength of primary care. The resulting indicator system is summarized in Figure 4.

Figure 4. The SiSPC framework.

The system of indicators provided by SiSPC will be an important tool for researchers to measure the strength of primary care. The results of the measurement of the SiSPC indicators can be used by policy-makers to monitor the primary care system in their country. As latest developments were taken into account, it measures ‘strength’ in line with current expectations of primary care. SiSPC can be used to satisfy various needs for information, such as:

  • - Describing, at country level, the state of affairs of primary care (particularly in high- and middle-income countries) and to monitor its development in the future (with repeated measurement);

  • - Analyzing whether and how the strength of primary care is related to the country context;

  • - Analyzing whether and how the strength of primary care is associated with outcomes of primary care, as measured, e.g., at provider level and at patient level.

  • - Showing changes in the strength of primary care between 2005 and 2023 (by comparing SiSPC with PHAMEU).

By its exclusive focus on the structural or systemic features of primary care systems, SiSPC contributes to clarity of information relevant to different levels of health care. In other tools and frameworks, indicators relating to the system level, the provider level and the patient level are often mixed. This hinders a clear analytical separation of issues that are at play at these different levels. Such a separation, however, is vital for policymakers, as policy levers employed to improve the primary care system often operate level-specific. A clear empirical analysis of the different areas where improvements can be made, is possible by combining SiSPC data with, for instance, data from surveys among providers and patients in a multi-level design (see for example Figure 1 in (Groenewegen et al., Reference Groenewegen, Spreeuwenberg, Timans, Groene, Sunol, Valderas and Rijken2024)).

The practical use of SiSPC in research has been facilitated by a focus on the feasibility of data collection. Many data can be collected centrally from international sources (e.g. from databases of the OECD, World Health Organization, European Union, World Bank and from international publications, such as the Health Systems in Transition series from the European Observatory on Health Systems and Policies), as witnessed by the entries in the column ‘sources’ in the overview of SiSPC. This will reduce the burden of data collection at country level considerably. Furthermore, experts in the countries have been asked to provide their feedback on the draft final system of indicators, particularly on the clarity of the indicator questions and the feasibility of data collection.

In developing SiSPC, we seized the opportunity to realize it alongside the PaRIS project. OECD aims to develop PaRIS into a regular data collection in an increasing number of countries. Updates and data collection for SISPC could follow the future rounds of PaRIS. However, even though the indicator system is ready-for-use, a large-scale data collection and analyzing the data (e.g.) every five years may be a challenge.

Further to previously mentioned strong points of SiSPC we point to its basis in existing validated frameworks, in particular PHAMEU and PHC-IMPACT. At the same time, we have not performed a new literature review to assess the evidence-base for newly developed indicators. As a second-best option we relied on previous work by the authors of the main frameworks that we used in the development of SiSPC, and on the Position Paper of EFPC on the organization of primary care (Akman et al., Reference Akman, Ayhan Başer, Usanma Koban, Marti, Decat, Lefeuvre and Miller2022).

The focus in SiSPC is on family physicians. We are aware that primary care is broader and also includes the work of nurses and professionals within primary care. Family physicians are (still) the core providers of primary care. However, we have given attention to their relationships with other primary care providers and social care. Another limitation is that we focused largely on Western countries and OECD member states, which are mostly higher-middle and high-income countries. This was done first of all for reasons of comparability. Despite the heterogeneity that generally characterizes health care systems, those in these countries are relatively well comparable as they share a basic institutional set-up. Another reason was that SiSPC has been developed in the context of the PaRIS project and on the basis of PHAMEU. The first implementation, in terms of data collection and analytical use of the data, will be in the countries participating in PaRIS and those in PHAMEU. Nevertheless, it will be important and interesting to assess the usability and validity of the SiSPC in lower- and middle-income countries, in line with developments in their primary care systems. SiSPC’s focus is on the system level and on national level. However, there may be subnational, regional variation in primary care systems in some countries. These are difficult to handle in international comparative research and can be better studied within countries.

Our next step is the collection of data to measure the indicator items. After this is done, it is possible to analyze whether and how the strength of primary care is associated with the assumed outcomes of strong primary care. The data collection has started and we hope to report about it soon.

Supplementary material

The supplementary material for this article can be found at https://doi.org/10.1017/S1463423625100509

Data availability statement

No new data was generated or analyzed in support of this research.

Acknowledgements

We thank the PaRIS NPMs and other experts for their valuable feedback on the development and contents of SiSPC: Mehmet Akman (Turkey), Chantal Arditi and Isabelle Peytremann-Bridevau (Switzerland), Øyvind Andresen Bjertnæs (Norway), Dagmar Annaert (Belgium), Claire Collins (Ireland), Krisztina Davidovics (Hungary), Tiina Hetemaa (Finland), Daphne Kaitelidou, Olga Siskou and Olympia Olympia Konstantakopoulou (Greece), Zalika Klemenc Ketiš (Slovenia), Ausrine Kontrimiene (Lithuania), Margus Lember (Estonia), Sara Al Munif (Saudi Arabia), Anna Maria Murante (Italy), Marek Oleszczyk (Poland), Lucia Povalová (Slovakia), Sarah Puntoni (Wales), Bohumil Seiffert (Czechia), Paulo Sousa (Portugal), Stefanie Stark (Germany), Neophytos Stylianou (Cyprus), Herdís Sveinsdóttir and Inga Þórsdóttir (Iceland), Tim Tenbensel (New Zealand), Gunta Ticmane (Latvia), Pia Vracko (North Macedonia), and Dorothy Zammit (Malta).

Author contributions

All authors were involved in the conceptualization of SiSPC and in reviewing the final indicator system. The indicators were developed by WB, PG, and RT. The first draft of this article was written by WB, PG, and RT; all authors reviewed the text. WB, PG, RT, SB, RS, PIC, and JMV discussed the design of the indicator system in several rounds and reviewed all drafts of the manuscript.

Funding statement

No external funding was received for the development of SiSPC. The authors received no financial support for the research, authorship, and/or publication of this article.

Competing interests

The authors declare they have no conflicting interests.

Ethical standards

This study only includes desk research and no ethical permission was needed.

References

Adan, M, Gillies, C, Tyrer, F and Khunti, K (2020) The multimorbidity epidemic: challenges for real-world research. Primary Health Care Research and Development 21, e6.10.1017/S146342361900094XCrossRefGoogle ScholarPubMed
Akiya, K, Fisher, E, Wells, A, Li, Y, Peck, C and Pagán, JA (2021) Aligning health care and social services to reduce hospitalizations and emergency department visits an evaluation of the community care connections program. Medical Care 59, 671678.10.1097/MLR.0000000000001578CrossRefGoogle Scholar
Akman, M, Ayhan Başer, D, Usanma Koban, B, Marti, T, Decat, P, Lefeuvre, Y and Miller, R (2022) Organization of primary care. Primary Health Care Research and Development 23, e49.10.1017/S1463423622000275CrossRefGoogle ScholarPubMed
Aller, MB, Vázquez, ML, Vargas, H, Coderch, J, Calero, S, Llopart, JR, et al. (2012) Indicadores de Coordinación Asistencial Entre niveles de atención. Documento de trabajo Barcelona, Consorci de Salut i Social de Catalunya. Available from: http://www.consorci.org/coneixement/cataleg-de-publicacions/80/indicadores-de.Google Scholar
Barbazza, E, Kringos, D, Kruse, I, Klazinga, N and Tello, JE (2019) Creating performance intelligence for primary health care strengthening in Europe. BMC Health Services Research 19, 1006.10.1186/s12913-019-4853-zCrossRefGoogle ScholarPubMed
Bodenheimer, T and Sinsky, C (2014) From triple to quadruple aim: care of the patient requires care of the provider. Annals of Family Medicine 12, 573576.10.1370/afm.1713CrossRefGoogle ScholarPubMed
Bosmans, MWG, Boerma, WGW and Groenewegen, PP (2021) Imbalances in Rural Primary Care: A Scoping Literature Review with an Emphasis on the WHO European Region. Technical Series on Primary Health Care. Geneva: WHO.Google Scholar
Buck, D and Ewbank, L (2020) What is Social Prescribing? [Online]. King’s Fund. Available at https://www.kingsfund.org.uk/publications/social-prescribing?gclid=EAIaIQobChMIzK_RipSz_wIVARMGAB1UpgNoEAAYASAAEgJp8PD_BwE (accessed 08 June 2023).Google Scholar
Burgmann, S, Paier-Abuzahra, M, Sprenger, M, Avian, A and Siebenhofer, A (2023) Identifying key policy objectives for strong primary care: a cross-sectional study. Primary Health Care Research and Development 24, e52.10.1017/S1463423623000403CrossRefGoogle ScholarPubMed
De Boer, D, Van Den Berg, M, Ballester, M, Bloemeke, J, Boerma, WGW, De Bienassis, K, Groenewegen, PP, Groene, O, Kendir, C, Klazinga, N, Porter, I, Sunol, R, Thomas, L, Valderas, JM, Williams, R and Rijken, M (2022) Assessing the outcomes and experiences of care from the perspective of people living with chronic conditions, to support countries in developing people-centred policies and practices: study protocol of the International Survey of People Living with Chronic Conditions (PaRIS survey). BMJ Open 12, e061424.10.1136/bmjopen-2022-061424CrossRefGoogle ScholarPubMed
De Maeseneer, J (2017) Family Medicine and Primary Care: at the Crossroads of Societal Change. Leuven, Belgium: Lannoo Campus.Google Scholar
Decamp, M, Dukhanin, V, Hebert, LC, Himmelrich, S, Feeser, S and Berkowitz, SA (2019) Patients’ views about patient engagement and representation in healthcare governance. Journal of Healthcare Management/American College of Healthcare Executives 64, 332.Google ScholarPubMed
Demaio, AR, Kragelund Nielsen, K, Pinkowski Tersbøl, B, Kallestrup, P and Meyrowitsch, DW (2014) Primary health care: a strategic framework for the prevention and control of chronic non-communicable Disease. Global Health Action 7, 24504F.10.3402/gha.v7.24504CrossRefGoogle ScholarPubMed
Donabedian, A (1988) The quality of care: how can it be assessed? JAMA 260, 17431748.10.1001/jama.1988.03410120089033CrossRefGoogle ScholarPubMed
Eder, MM, Carter-Edwards, L, Hurd, TC, Rumala, BB and Wallerstein, N (2013) A logic model for community engagement within the CTSA Consortium: can we measure what we model? Academic Medicine 88, 1430.10.1097/ACM.0b013e31829b54aeCrossRefGoogle ScholarPubMed
EuroHealthNet (2022) The European Semester and Health Equity: Findings from the Recovery and Resilience Plans in Eight EU Member States. Brussels: EuroHealthNet.Google Scholar
EXPH (2017) Opinion on Tools and Methodologies for Assessing the Performance of Primary Care. Brussels: Expert Panel on Effective Ways of Investing in Health.Google Scholar
EXPH (2020) The Organisation of Resilient Health and Social Care Following the COVID-19 Pandemic. Brussels: Expert Panel on Effective Ways of Investing in Health.Google Scholar
Friedman, C, Rubin, J, Brown, J, Buntin, M, Corn, M, Etheredge, L, Gunter, C, Musen, M, Platt, R, Stead, W, Sullivan, K and Van Houweling, D (2015) Toward a science of learning systems: a research agenda for the high-functioning Learning Health System. J Am Med Inform Assoc 22, 4350.10.1136/amiajnl-2014-002977CrossRefGoogle Scholar
Gonzalez-Holguera, J, Gaille, M, Del Rio Carral, M, Steinberger, J, Marti, J, Bühler, N, Kaufmann, A, Chiapperino, L, Vicedo Cabrera, AM, Schwarz, J, Depoux, A, Panese, F, Chèvre, N and Senn, N (2022) Translating planetary health principles into sustainable primary care services. Frontiers in Public Health 10, 931212.10.3389/fpubh.2022.931212CrossRefGoogle ScholarPubMed
Groenewegen, PP, Spreeuwenberg, P, Timans, R, Groene, O, Sunol, R, Valderas, JM and Rijken, M (2024) Data analysis plan of the OECD PaRIS survey: leveraging a multi-level approach to analyse data collected from people living with chronic conditions and their primary care practices in 20 countries. BMC Research Notes 17, 157.10.1186/s13104-024-06815-7CrossRefGoogle ScholarPubMed
Guanais, FC, Regalia, F, Perez-Cuevas, R and Anaya, M (eds.) (2018) Desde el Paciente: experiencias con la atención Primaria de Salud en América Latina y el Caribe. Banco Interamericano de Desarrollo.10.18235/0001255CrossRefGoogle Scholar
Hansen, J, Groenewegen, PP, Boerma, WGW and Kringos, DS (2015) Living in a country with a strong primary care system is beneficial to people with chronic conditions. Health Affairs 34, 15311537.10.1377/hlthaff.2015.0582CrossRefGoogle Scholar
IOM (2007) The Learning Healthcare System: Workshop Summary. Washington, DC: National Academies Press.Google Scholar
Jiao, S, Slemon, A, Guta, A and Bungay, V (2022) Exploring the conceptualization, operationalization, implementation, and measurement of outreach in community settings with hard-to-reach and hidden populations: a scoping review. Social Science and Medicine 309, 115232.10.1016/j.socscimed.2022.115232CrossRefGoogle ScholarPubMed
Kelley, E and Hurst, J (2006) OECD Health Working Papers No. 23. Health Care Quality Indicators Project Conceptual Framework Paper. Health Working Papers.Google Scholar
Klemenc Ketis, Z and Rochfort, A (2022) Sustainability for planetary health: a seventh domain of quality in primary care. Zdr Varst 61, 198200.Google ScholarPubMed
Kringos, DS (2012) The Strength of Primary Care in Europe. Utrecht University PhD thesis, NIVEL.Google Scholar
Kringos, DS, Boerma, WGW, Bourgueil, Y, Cartier, T, Dedeu, T, Hasvold, T, Hutchinson, A, Lember, M, Oleszczyk, M, Rotar-Pavlic, D, Svab, I, Tedeschi, P, Wilm, S, Windak, A, Van der Zee, J and Groenewegen, PP (2013a) The strength of primary care in Europe: an international comparative study. British Journal of General Practice 63, e742e750.10.3399/bjgp13X674422CrossRefGoogle ScholarPubMed
Kringos, DS, Boerma, WGW, Bourgueil, Y, Cartier, T, Hasvold, T, Hutchinson, A, Lember, M, Oleszczyk, M, Pavlic, DR, Svab, I, Tedeschi, P, Wilson, A, Windak, A, Dedeu, T and Wilm, S (2010) The European primary care monitor: structure, process and outcome indicators. BMC Family Practice 11, 81.10.1186/1471-2296-11-81CrossRefGoogle ScholarPubMed
Kringos, DS, Boerma, WGW, Van Der Zee, J and Groenewegen, PP (2013b) Political, cultural and economic foundations of primary care in Europe. Social Science and Medicine 99, 917.10.1016/j.socscimed.2013.09.017CrossRefGoogle ScholarPubMed
Kruk, ME, Myers, M, Varpilah, ST and Dahn, BT (2015) What is a resilient health system? Lessons from Ebola. Lancet 385, 19101912.10.1016/S0140-6736(15)60755-3CrossRefGoogle ScholarPubMed
Lenzen, M, Malik, A, Li, M, Fry, J, Weisz, H, Pichler, P-P, Suveges Moreira Chaves, L, Capon, A and Pencheon, D (2020) The environmental footprint of health care: a global assessment. Lancet Planetary Health 4, e271e279.10.1016/S2542-5196(20)30121-2CrossRefGoogle ScholarPubMed
Mackenbach, J (2019) A History of Population Health: Rise and Fall of Disease in Europe. Leiden: Brill/Rodopi.Google Scholar
Modigh, A, Sampaio, F, Moberg, L and Fredriksson, M (2021) The impact of patient and public involvement in health research versus healthcare: a scoping review of reviews. Health Policy 125, 12081221.10.1016/j.healthpol.2021.07.008CrossRefGoogle ScholarPubMed
NASEM (2023) Achieving Whole Health: A New Approach for Veterans and the Nation. Washington, DC: National Academies Press.Google Scholar
NHS (2019) The NHS Long Term Plan (Online). National Health Service. Available at https://www.longtermplan.nhs.uk/wp-content/uploads/2019/08/nhs-long-term-plan-version-1.2.pdf (accessed 07 June 2023).Google Scholar
OECD (2020) Realising the Potential of Primary Health Care. OECD Health Policy Studies. Paris: OECD.Google Scholar
OECD (2021) Strengthening the Frontline: How Primary Health Care Helps Health Systems Adapt during the COVID 19 Pandemic. Paris: OECD.Google Scholar
OECD (2024) Rethinking Health System Performance Assessment: a Renewed Framework, OECD Health Policy Studies. Paris: OECD Publishing. https://doi.org/10.1787/107182c8-en.Google Scholar
OECD (2025) Does Healthcare Deliver?: Results from the Patient-Reported Indicator Surveys (PaRIS). Paris: OECD Publishing.Google Scholar
PAHO (2021) Marco de monitoreo para la salud universal en las Américas. Washington DC: Panamericain Health Organization.Google Scholar
RCGP (2016) Continuity of Care in Modern Day General Practice. London: Royal College of General Practitioners.Google Scholar
RCGP (2019) Fit for the Future: A Vision for General Practice. London: Royal College of General Practitioners.Google Scholar
Rijken, M, Hujala, A, Van Ginneken, E, Melchiorre, MG, Groenewegen, PP and Schellevis, FG (2018) Managing multimorbidity: profiles of integrated care approaches targeting people with multiple chronic conditions in Europe. Health Policy 122, 4452.10.1016/j.healthpol.2017.10.002CrossRefGoogle ScholarPubMed
RVS (2023) De basis op orde: Uitgangspunten voor toekomstgerichte eerstelijnszorg. Den Haag: Raad voor Volksgezondheid en Samenleving.Google Scholar
Schäfer, W, Boerma, WGW, Van Den Berg, MJ, De Maeseneer, J, De Rosis, S, Detollenaere, J, Greß, S, Heinemann, S, Van Loenen, T, Murante, AM, Rotar-Pavlic, D, Seghieri, C, Vainieri, M, Willems, S and Groenewegen, PP (2019) Are people’s health care needs better met when primary care is strong? A synthesis of the results of the QUALICOPC study in 34 countries. Primary Health Care Research and Development 20, 19.10.1017/S1463423619000434CrossRefGoogle Scholar
Senn, N, Breton, B, Ebert, ST, Lamoureux-Lamarche, C, Lévesque, J-F (2021) Assessing primary care organization and performance: literaturesynthesis and proposition of a consolidated framework. Health Policy 25, 160167.10.1016/j.healthpol.2020.10.004CrossRefGoogle Scholar
Sharma, AE and Grumbach, K (2017) Engaging patients in primary care practice transformation: theory, evidence and practice. Family Practice 34, 262267.Google ScholarPubMed
Sidel, VW and Sidel, R (1977) Primary health care in relation to socio-political structure. Social Science and Medicine 11, 415419.10.1016/0037-7856(77)90105-6CrossRefGoogle ScholarPubMed
Smit, D, Hill, L, Walton, I, Kendall, S and De Lepeleire, J (2020) European forum for primary care: position paper for primary care mental health: time for change, now more then ever! Primary Health Care Research and Development 21, e6.10.1017/S1463423620000304CrossRefGoogle Scholar
Starfield, B (1994) Is primary care essential? Lancet 344, 11291133.10.1016/S0140-6736(94)90634-3CrossRefGoogle ScholarPubMed
Steeman, L, Uijen, M, Plat, E, Huibers, L, Smits, M and Giesen, P (2020) Out-of-hours primary care in 26 European countries: an overview of organizational models. Family Practice 37, 744750.10.1093/fampra/cmaa064CrossRefGoogle ScholarPubMed
Thomas, S, Sagan, A, Larkin, J, Cylus, J, Figueras, J and Karanikolos, M (2020) Strengthening Health Systems Resilience: Key Concepts and Strategies. Policy Briefs. Copenhagen: European Observatory on Health Systems and Policy.Google Scholar
Valderas, JM, Porter, I, Martin Delgado, J, Rijken, M, De Jong, JD, Groene, O, Bloemeke-Cammin, J, Sunol, R, Williams, R, Ballester, M, De Biennassis, K, Kendir, C, Guanais, F, De Boer, D and Van Den Berg, M (2024) Development of the Patient-Reported Indicator Surveys (PaRIS) conceptual framework to monitor and improve the performance of primary care for people living with chronic conditions. BMJ Quality and Safety 34, 529536.10.1136/bmjqs-2024-017301CrossRefGoogle Scholar
Veillard, J, Cowling, K, Bitton, A, Ratcliffe, H, Kimball, M, Barkley, S, et al. (2017) Better measurement for performance improvement in low- and middle-income countries: the primary health care performance initiative (PHCPI) experience of conceptual framework development and indicator selection. Milbank Quaterly 95(4), 836883.10.1111/1468-0009.12301CrossRefGoogle ScholarPubMed
Whitehead, M (1990) The Concepts and Principles of Equity and Health. Copenhagen: WHO Regional Office for Europe.Google Scholar
Whitehead, M and Dahlgren, G (2006) Concepts and Principles for Tackling Social Inequities in Health. Copenhagen: WHO Regional Office for Europe.Google Scholar
WHO (2015) Self-Assessment Tool for the Evaluation of Essential Public Health Operations in the WHO European Region. Copenhagen: World Health Organisation European office.Google Scholar
WHO (2016a) Global Strategy on Human Resources for Health: Workforce 2030. Geneva: World Health Organisation.Google Scholar
WHO (2016b) Multimorbidity: Technical Series on Safer Primary Care. Geneva: World Health Organization.Google Scholar
WHO (2019) Indicator Passport. WHO European Primary Health Care, Impact, Performance and Capacity Tool (PHC-IMPACT). WHO European Framework for Action on Integrated Health Services Delivery (version 1). Copenhagen: World Health Organization.Google Scholar
WHO (2022) A Toolkit on How to Implement Social Prescribing. Manilla: World Health Organization Regional Office for the Western Pacific.Google Scholar
WHO and UNICEF (2022) Primary Health Care Measurement Framework and Indicators: Monitoring Health Systems through a Primary Health Care Lens. Geneva: World Health Organization.Google Scholar
Figure 0

Figure 1. Overview of steps in the development of SiSPC.

Figure 1

Figure 2. The PHAMEU framework of primary care.

Figure 2

Figure 3. The framework underpinning PHC-IMPACT.

Figure 3

Table 1. Overview of domains and indicator fields from other primary care-relevant frameworks

Figure 4

Table 2. Overview of indicator fields on context

Figure 5

Table 3. Feedback resulting in an removal, addition or change by domain and dimension

Figure 6

Table 4. Overview of the domains and dimensions (with the number of indicators) and one exemplary SiSPC indicator for each dimension and their response categories

Figure 7

Figure 4. The SiSPC framework.

Supplementary material: File

Boerma et al. supplementary material

Boerma et al. supplementary material
Download Boerma et al. supplementary material(File)
File 64.6 KB