INTRODUCTION
Increasingly, it is recognized that annual estimates of influenza vaccine effectiveness (VE) are necessary given frequent changes to the vaccine composition as well as the circulating strains. In Australia, annual estimates for influenza VE using a general practitioner (GP) sentinel surveillance network have been published from Victoria, Australia, since 2009 [Reference Kelly1]. However, until recently [Reference Sullivan2–Reference McAnerney5] these have been the only VE estimates regularly reported from the Southern Hemisphere. The generalizability of estimates from Victoria applied to the rest of Australia is unclear. A further problem with estimating VE from a single surveillance network is that there are often insufficient data generated to provide estimates by influenza type/subtype or age group. There may also be too few data for interim estimates. Thus, there is a need to increase the information available for calculating VE estimates for Australia.
Australia has three sentinel networks for influenza-like illness (ILI) surveillance in general practice. These are the Victorian Sentinel Practice Influenza Network (VicSPIN) [Reference Kelly1], the Australian Sentinel Practices Research Network (ASPREN) [6, Reference Parrella7] and the Sentinel Practitioners Network of Western Australia (SPNWA) [Reference Levy3]. While VicSPIN and SPNWA perform surveillance for their respective states, ASPREN manages surveillance in the remaining six states and territories and also has several GPs in Victoria. VE estimates have previously been published from these networks for 2012 [Reference Sullivan2, Reference Levy3, Reference Sullivan, Tay and Kelly8–Reference Sullivan10] and 2013 [Reference Carville11], but not 2014. In those analyses, samples were too small to enable estimates for specific age groups, such as children aged <5 years or the elderly. VE is expected to vary within age groups, given the varying level of exposure across the lifetime, the relative immaturity of the very young immune system [Reference Widdowson, Monto and Wenster12] and immunosenescence in the elderly [Reference Haq and McElhaney13]. Thus there is a compelling need to estimate VE within age groups. Similarly, VE is expected to vary by influenza type and subtype [Reference Sullivan, Feng and Cowling14]. Prior to 2015, influenza vaccines in Australia were all trivalent vaccines, containing an A(H3N2), A(H1N1)pdm09 and B component. So, while it is of public health interest to understand the overall performance of the vaccine, it is also helpful to estimate the effectiveness of each component.
The three Australian influenza surveillance networks use similar methods to collect information on patients presenting with ILI to sentinel GPs and can use the test-negative design to estimate VE [Reference Kelly1–Reference Levy3]. These similarities mean the data can be easily pooled for estimation of nationwide VE. Pooling individual data across similarly designed studies has several advantages over individual reports or conventional meta-analyses of published estimates. First, the definitions and categorization of exposure, outcome and important confounders can be standardized [Reference Smith-Warner15]. Moreover, a uniform statistical model can be used, further eliminating analytical inconsistencies [Reference Blettner and Sauerbrei16]. Variations in these parameters may be important sources of heterogeneity in studies of influenza VE [Reference Sullivan, Feng and Cowling14]. Second, pooling data across studies increases the available sample size, which may permit subgroup analyses of the association of interest with greater statistical power than is possible in a single study [Reference Smith-Warner15]. In the case of influenza, pooling may permit estimation for groups which are typically under-represented in individual studies, such as young children and individuals with medical conditions, and importantly can enable evaluation of VE by subtype.
The purpose of the present study was to use data from three surveillance networks to calculate influenza VE estimates for all of Australia, as is regularly done in Europe [Reference Kissling17], Canada [Reference Skowronski18] and the United States [Reference Ohmit19].
METHODS
Study design
Data for 2012, 2013 and 2014 from three influenza surveillance networks were used. Together, these networks included 256 GPs (ASPREN, 100; SPNWA, 64, VicSPIN, 92) in 2012, 262 GPs (ASPREN, 97; SPNWA, 71, VicSPIN, 94) in 2013 and 354 GPs (ASPREN, 177; SPNWA, 82, VicSPIN, 95) in 2014. Surveillance is year-round in ASPREN and SPNWA, but only from May to October (inclusive) in Victoria. Patients presenting with ILI (fever, cough, fatigue) were asked for nasal and throat swabs at the participating GPs’ discretion. GPs collected demographic data (age, sex) and vaccination status. Since 2012, VicSPIN and SPNWA GPs additionally collected information about any comorbidities that could increase the risk of severe influenza, while ASPREN began collecting this information in 2014. Moreover, since 2012, VicSPIN collected patients’ influenza status for the previous year, while ASPREN began collecting these data in 2014 and SPNWA does not collect this information.
Vaccination status was obtained via patient's medical record or patient's self-report. During 2012–2014 vaccines were produced by six manufacturers [20], but manufacturers’ data were not collected in this study so all were assumed to have equal effectiveness. Vaccine components for each year are summarized in Table 1. Patients with an unknown vaccination status were excluded from the study. We could not exclude patients on the basis of presenting too soon after vaccination, as the date of vaccination and date of onset were not collected by SPNWA or ASPREN. However, VicSPIN data suggested these were few in number.
ASPREN, Australian Sentinel Practices Research Network; VicSPIN: Victoria Sentinel Practices Network; SPNWA, Sentinel Practitioners Network of Western Australia; A(NS), A, not subtyped; LR, low reactor.
Values given are n (%).
P values are for the χ 2 test. No test performed for haemagglutination inhibition data.
* Included in the 2012 vaccine.
† Included in the 2013 vaccine.
‡ Included in the 2014 vaccine.
Laboratory methods
Respiratory specimens were collected by GPs using pre-prepared kits. ASPREN doctors collected samples using Copan flocked swabs (Copan Diagnostics, USA) in 3 ml universal transport medium (UTM), SPNWA doctors collected two nasal and one throat swab using Copan Mini Tip flocked swabs in virus transport medium and VicSPIN doctors used Copan flocked swabs in 3 ml UTM. Samples were sent to SA Pathology (for ASPREN), PathWest Laboratory Medicine (for SPNWA) or the Victorian Infectious Diseases Reference Laboratory (VIDRL) (for VicSPIN) for testing. PathWest and VIDRL are national influenza centres, while SA Pathology is the public reference laboratory for the state of South Australia. Influenza was detected by real-time RT–PCR using in-house primers. Both the type and subtype were identified; however, SA Pathology only tested for A(H1N1)pdm09 and not A(H3N2) in 2012. Samples that were ‘type A, not A(H1N1)pdm09’ were treated as A(H3N2), based on virus characterization data available on a subset of these samples.
All influenza-positive specimens from VicSPIN, those with cycle threshold ⩽30 from ASPREN and those able to be isolated in culture at SPNWA were forwarded to the WHO Collaborating Centre for Reference and Research on Influenza in Melbourne where they were further characterized to identify the virus strain using the haemagglutination inhibition (HI) assay, as previously described [Reference Sullivan10, Reference Hobson21]. Isolates were identified as antigenically similar to the cell- or egg-propagated vaccine strain if the test samples had a titre that was ⩽fourfold different compared to the homologous vaccine reference strain. Results were reported against reference antisera raised against the vaccine strains.
Statistical analysis
All analyses were conducted in Stata version 12 (StataCorp., USA). Patients’ characteristics by influenza status and vaccination status were compared by odds ratio (OR) and χ 2 test for categorical variables. All P values were two-sided.
To estimate VE, data were analysed using a test-negative design [Reference Jackson and Nelson22–Reference Skowronski24] where the exposure (vaccination) odds among those testing positive for influenza by RT–PCR were compared to those testing negative; i.e. VE = 1 – ORadj × 100%. Estimates were adjusted for known confounders, selected a priori, including age group (<5, 5–17, 18–64, ⩾65 years), date of consultation modelled as a cubic spline with four knots, and network. Estimates were made for the periods of epidemic activity in each network. This period began when a positive case had been reported for two consecutive weeks at least 2 weeks after the annual vaccination campaign (mid-March) and ended after the peak when no case had been reported for at least 3 weeks. Prior to pooling, the data were meta-analysed, using the ‘metan’ command [Reference Harris25], to identify potential heterogeneity issues. The I 2 statistic was inspected and summary estimates were made using both fixed and random effects, where large discrepancies between the two were indicative of poor fit of the summary model [Reference Greenland26, Reference Friedenreich27]. The data were then pooled and modelled as described above, including a fixed effect for the network. Estimates were stratified by type/subtype as well as age group (<18, 18–64, ⩾65 years). In a sensitivity analysis, data were multiply imputed using chained equations and VE estimated using the imputed data (n = 20 imputed datasets). Where there were fewer than four vaccinated cases (or unvaccinated cases) in an analysis or where the imputed model and the complete case model differed by >10 percentage points, the estimates were not reported because of potential sparse data bias [Reference Greenland28].
Ethical considerations
ASPREN data were de-identified and obtained in accordance with National Health Security Act 2007. Therefore, Human Research Ethics Committee approval was not required. VicSPIN data were collected, used and reported under the legislative authorization of the Victorian Public Health and Wellbeing Act 2008 and Public Health and Wellbeing Regulations 2009 and thus did not require Human Research Ethics Committee approval. The SPNWA system is implemented by the Communicable Disease Control Directorate of the WA Department of Health as part of routine public health surveillance. Human Research Ethics Committee approval is not required.
RESULTS
Patients who consented to provide a swab sample for the surveillance networks in 2012, 2013 and 2014 numbered 4115, 2371 and 3570, respectively. Of these, 432, 329 and 496 were excluded (see Supplementary Table S1). In 2012, ILI presentations peaked in week 28 and continued until week 51 (Fig. 1). In contrast, presentations in 2013 peaked much later in week 36 and continued until the end of the year. In 2014, presentations peaked in week 33 and continued until week 48.
Patient characteristics are shown by vaccination status in Table 1 and by influenza status in Table 2. The 2012 season was characterized by a higher percentage of positive tests (40%) than 2013 (22%) or 2014 (29%), and the dominant virus was A(H3N2) (69% of confirmed influenza cases) (Table 2). In 2013, A(H3N2) viruses were least frequent (22%) and the majority of viruses (39%) were influenza B, followed closely by A(H1N1)pdm09 (36%). In 2014, A(H1N1)pdm09 was dominant (46%), followed by A(H3N2) (39%). HI assays suggested that most viruses were antigenically similar to their relevant influenza A vaccine strain (Table 1), but in 2013 and 2014 were poorly matched to the influenza B strain. In addition, in 2013 and 2014, A(H3N2) viruses showed good antigenic match to the cell-propagated strain (Table 1) but all were low reactors to the egg-propagated strain (data not shown).
ASPREN, Australian Sentinel Practices Research Network; VicSPIN, Victoria Sentinel Practices Network; SPNWA, Sentinel Practitioners Network of Western Australia; Values given are n (%).
The proportion of vaccinated patients ranged from 23% in 2012 to 29% in 2013 and was generally higher in women than men (Table 1). In addition, vaccine coverage increased with increasing age, being very low in young children (<5 years) at 3–5% and relatively high in the elderly (>65 years) at 68–77%.
Preliminary analysis indicated moderate heterogeneity, with I 2 ranging from 35% in 2012 to 54% in 2014 (Fig. 2). The fixed- and random-effects estimates were consistent and did not highlight any major heterogeneity problems. Based on these two metrics, data were pooled for VE estimation. VE estimates for each age group with type/subtype are presented in Figure 3. Estimates and their sample sizes are shown in Supplementary Table S2. VE estimates obtained using the imputed data were generally within a percentage point of the complete-case analysis. Thus, they did not suggest any substantial bias in the complete-case analysis.
VE for any type of influenza for all patients was 38% [95% confidence interval (CI) 24–49] in 2012, 60% (95% CI 45–70) in 2013 and 44% (95% CI 31–55) in 2014. For influenza A(H1N1)pdm09, VE estimates were similar across the seasons studied at 54% (95% CI –28 to 83) in 2012, 59% (95% CI 33–74) in 2013 and 55% (95% CI 39–67) in 2014. There were insufficient data available to make estimates for this subtype for children or the elderly in 2012 or 2013.
For influenza A(H3N2), VE for all age groups was low in 2012 at 30% (95% CI 14–44) and in 2014 at 26% (95% CI 1–45), but higher in 2013 at 67% (95% CI 39–82). Point estimates were lowest for the elderly in 2014 and highest for working-age adults in 2013. There were too few data to make a reliable estimate for the elderly or children in 2013, nor were there sufficient data to make estimates for children aged <5 years in 2014.
For influenza B, VE point estimates were similar in all years, despite the change in dominant lineage. Estimates for all ages were 56% (95% CI 37–70) in 2012, 57% (95% CI 30–73) in 2013 and 54% (95% CI 21–73) in 2014. There were too few vaccinated cases to estimate VE for children aged <5 years in any year, or for children aged <18 years in 2013 and 2014, and there were too few unvaccinated cases to estimate VE in the elderly in 2014.
DISCUSSION
In this study, data from three influenza surveillance schemes were pooled to increase the sample used and enable estimation of influenza VE within types/subtypes and age groups. This permitted estimation of VE for A(H1N1)pdm09 in 2012, which had not previously been possible using only the VicSPIN or ASPREN data [Reference Sullivan2, Reference Sullivan10] and permitted type-/subtype-specific estimation within some age groups, which had not previously been reported for the years studied [Reference Sullivan2, Reference Levy3, Reference Sullivan10, Reference Carville11]. In 2012, the VE estimates reported by these three networks were 23% (95% CI –4 to 43) for ASPREN, 45% (95% CI 8–66) for VicSPIN, and 49% (95% CI 30–63) for SPNWA, while the summary estimate reported in this study was within this range at 38% (95% CI 24–49). The pooled estimate was within the range of the previous estimate and had higher precision (see Supplementary Table S3). For other comparisons, only an A(H3N2) estimate was previously reported by all these networks in 2012. Again, the pooled estimate fell within the range of the published estimates. For other subtypes and for age groups, only SPNWA and ASPREN were able to report previously. Published estimates were similar to the pooled estimates for influenza B and for the elderly. For children aged <18 years and adults, the pooled estimate fell between the two published estimates. It should be noted that the statistical model used, the exclusion criteria applied and the statistical power in the published studies varied. Exploration of heterogeneity for the overall estimates revealed moderate heterogeneity. Heterogeneity was not explored within types/subtypes and may have been greater in these subgroups given the reduced sample size. However, this may not be reflected in the metrics used to detect heterogeneity, which would have reduced power in subgroup analysis.
Our VE estimates compared variably with those reported elsewhere. For example, our VE estimate for A(H1N1)pdm09 was 54% (95% CI –28 to 83) in 2012, which was lower than estimates reported from the United States (VE 65%, 95% CI 44–79) [Reference Ohmit19] and Canada (VE 80%, 95% CI 52–92) [Reference Skowronski18]. Our 2013 estimate for A(H1N1)pdm09 was 59% (95% CI 33–74) and not substantially different from New Zealand's (49%, 95% CI –90 to 86) [Reference Turner4], Europe's (50%, 95% CI 28–66) [Reference Kissling29] or Canada's (59%, 95% CI 16–80%) [Reference Skowronski30]. The 2014 estimate of 55% (95% CI 39–67) was close to New Zealand's (VE 59%, 95% CI 36–74) [Reference Pierse31] and Greece's (VE 57%, 95% CI 23–76) [Reference Lytras32]. For A(H3N2), our 2012 estimate was 30% (95% CI 14–44), and similar to the UK's estimate (VE 26%, 95% CI –4 to 48) [Reference Andrews33] and Canada's (VE 41%, 95% CI 17–59). The 2013 estimate at 67% (95% CI 39–82) was similar to the estimate from New Zealand (VE 61%, 95% CI 32–77), but higher than several estimates from the Northern Hemisphere 2012/2013 season [Reference Kissling29, Reference Andrews33, Reference Yang34]. The 2014 A(H3N2) estimate was low (VE 26%, 95% CI 1–45), which was in line with other reports for that season [Reference Pierse31, Reference Jimenez-Jorge35]. In all years, most point estimates for influenza B, including ours, were around 50–60% [Reference Turner4, Reference Ohmit19, Reference Kissling29, Reference Pierse31, Reference Andrews33, Reference Castilla36].
Despite pooling, there remained too few cases for some of the analyses attempted. For example, vaccination coverage was too low in young children aged <5 years to permit estimation for A(H1N1)pdm09 in 2012 or for any influenza type/subtype in 2013 or 2014. Vaccination coverage in young children in Australia is generally very low. In Western Australia, the government began subsidising influenza vaccination for children aged <5 years in 2008, which substantially increased uptake; surveillance data indicated uptake around 50% in 2008–2009 [Reference Blyth37]. However, serious adverse reactions to the 2010 vaccine in some children led to a loss of consumer confidence [Reference Kelly38], and in 2012 only 10·1% of children were vaccinated, half of whom were only partially vaccinated [Reference Blyth37]. At such low coverage, the power to see a modest effect (e.g. 50%) is extremely limited and a sample consisting of at least 365 influenza-positive cases is required to gain statistical significance (assuming a case-control ratio of 3:1, at α = 0·05, β = 0·2). Infections in children are proportionally more common than infections in adults and the health and economic costs of infection in this group are significant [Reference Ampofo39–Reference Poehling43]. However, reliable information on the effectiveness of the inactivated vaccine in children is scant [Reference Jefferson44]. In this study, despite pooling data across networks estimation of type-/subtype-specific VE in young children was not possible. Thus, there is a compelling need to scale up influenza surveillance activities in children and other groups with low vaccination uptake.
There were also insufficient cases of A(H1N1)pdm09 in the elderly to permit estimation. Low A(H1N1)pdm09 infection rates in the elderly have been reported since the pandemic in 2009 [Reference Booy45], a phenomenon attributed to prior infection with a similar influenza strain many years earlier [Reference Hancock46, Reference Miller47]. In contrast, A(H3N2) viruses tend to exhibit more rapid antigenic and genetic drift than A(H1N1)pdm09 viruses [Reference Hay48, Reference Neuzil and Bright49], resulting in continued vulnerability throughout an individual's lifetime. Indeed, in this study the proportion of elderly patients with A(H3N2) in 2012 was similar to the overall proportion of patients testing positive for A(H3N2) and that for children, at around 30%. For A(H3N2), VE was modest in the elderly in 2012 and was not estimated in 2013 due to the low number of vaccinated cases, again highlighting that pooling has not adequately overcome sample size limitations for subtype-/age group-specific estimates using current surveillance programmes in Australia.
Despite the change to the B lineage included in the vaccine between 2012 and 2013 (i.e. from Victoria to Yamagata), VE point estimates were the same. In contrast, VE against A(H3N2) was poor in 2012 when A(H3N2) dominated and most viruses were antigenically similar to the vaccine strain, A/Perth/16/2009. Estimates were paradoxically moderate in 2013 when all isolated A(H3N2) viruses were low reactors to the egg-propagated reference strain. Egg-acquired adaptations in the vaccine's A(H3N2) strain resulted in poor VE globally in 2012 [Reference Skowronski30], so VE was expected to be similarly low in Australia in 2013 and 2014. Genetic analysis was not routinely performed in these networks, so it was not possible to perform a thorough examination of clade variation that may have explained the relatively high VE for influenza A(H3N2) in 2013 compared to Northern Hemisphere estimates for the previous and following seasons. Limited genetic information from Victoria in 2012 [Reference Sullivan10] suggested about half of viruses fell into a genetic clade that differed from the vaccine clade, but no clustering by vaccination status was observed. Increasingly, evidence is surfacing that both antigenic and genetic matches between the vaccine and circulating strains correlates poorly with VE estimates and may vary with the virus type/subtype [Reference Sullivan10, Reference Skowronski50, Reference Tricco51]. Great efforts are being made to explore alternative options for measuring antigenic match [Reference Barr52].
This study had several limitations. First, the decision to pool was made retrospectively, so the data collection instruments did not collect exactly the same information across networks. For example, not all networks collected the date of vaccination so we were unable to exclude patients who presented too soon after vaccination, and who may have been misclassified as vaccinated. Moreover, how vaccination status was ascertained was not recorded and in many cases may have been by self-report. This may be an underappreciated source of measurement error in studies of influenza VE [Reference Sullivan, Feng and Cowling14]. Study coordinators are investigating the use of abstracting vaccination status and testing results from GP practice software for the purpose of measuring VE [Reference Regan53]. Second, the date of symptom onset was also not routinely collected, so we were unable to remove patients presenting too late after onset. GPs were instructed to only sample patients presenting within 4 days of illness onset, but study coordinators are aware that this stipulation is not strictly adhered to. Exclusion of patients who present too late can have quite an impact on VE point estimates [Reference Sullivan, Feng and Cowling14]. In theory, non-differential misclassification of outcome status due to poor sensitivity should only minimally bias estimates [Reference Sullivan, Feng and Cowling14]. This has been the case in VicSPIN, where applying a restriction reduced adjusted VE estimates by 7–15% in 2007 [Reference Fielding54], 5–35% in 2008 [Reference Fielding54], 0–3% in 2010 [Reference Fielding55], 2–14% in 2011 [Reference Fielding56] and 7% in 2013 [Reference Carville11]. Third, we were unable to adjust for the presence of comorbidities which might increase a person's likelihood of vaccination and infection. Although this information was collected by all networks in 2014, collection was inconsistent and precluded its use. In any case, interim estimates from Canada in 2013 and 2014 suggested that the inclusion of a variable indicating the presence of comorbid conditions resulted in minimal changes to point estimates and confidence intervals [Reference Skowronski57, Reference Skowronski58]. Moreover, many conditions included in this category affect susceptibility to a severe infection, but not infection itself and thus do not fulfil the conditions for confounding.
We did not combine estimates across the seasons studied. Figure 1 clearly shows that the severity of the season and predominant strains for each season differed substantially, so the outcomes of interest differed across seasons. Moreover, there were changes made to the vaccine between 2012 and 2014, so the exposure of interest also differed by season. Such differences are the justification for estimating VE each season, and this rationale should be equally applied to the pooling of VE estimates. While meta-analyses have reported summary estimates that combine data across seasons [Reference Osterholm59, Reference Darvishian60], this may not be sensible practice. Similarly, although reported here, there may be limited value in reporting an overall VE estimate combining data for A(H1N1)pdm09, A(H3N2) and B viruses. There is substantial evidence that VE varies by type/subtype [Reference Sullivan, Feng and Cowling14], and the estimation of an overall effect masks problems with the vaccine, particularly for the A(H3N2) viruses [Reference Skowronski30]. However, this is often the estimate of interest to public health practitioners and provides a single estimate comparable across seasons.
Analogously, it could be argued that combining data across geographically disparate areas could result in too much heterogeneity to enable reliable estimation of effect. This might be particularly true if there are latitudinal variations. Australia experiences a range of climates, from tropical to temperate to alpine. The epidemic period can vary between such climates [Reference Tamerius61–Reference Koul63], and in Northern Australia, there is often influenza activity around March, far earlier than the winter season. However, the population density in the far north of Australia is low. There were only six SPNWA and 11 ASPREN GPs obtaining samples in tropical regions. In addition, the main epidemic period in the Northern Territory tends to coincide with that of southern, temperate regions of the country [64]. Finally, cases from March would be excluded in this analysis as they precede or coincide with the roll-out of the vaccine. If people infected in March were then more likely to get vaccinated, it could inflate VE estimates, because their natural immunity would protect them, not the vaccine. However, because their populations are small, it is unlikely these geographical variations will have influenced the results here.
In summary, pooling of Australia-wide data enabled estimation of subtype-specific VE estimates, although there continued to be insufficient sample for some age group-specific subtype estimates. Increased study power arising from pooling of data may eventually mean other VE strata can be considered, such as vaccine brand, which is not routinely collected by any of the three networks but may be possible to obtain through abstraction of data from GP practice software and the recent establishment of an adult vaccination register in Australia. Data pooling may also prove useful for improving the precision of interim VE estimates. Australia currently does not routinely publish interim VE estimates, but does contribute data to the vaccine strain selection meeting [Reference Barr52]. Harmonization of the data collected by the networks has already begun which will also enable better integration of the data, reduce residual heterogeneity, and permit adjustment for variables, such as comorbidity status.
SUPPLEMENTARY MATERIAL
For supplementary material accompanying this paper visit http://dx.doi.org/10.1017/S0950268816000819.
ACKNOWLEDGEMENTS
We gratefully acknowledge all practices and general practitioners who participated in sentinel surveillance. We thank the laboratory staff of the SA Pathology, PathWest, the Victorian Infectious Diseases Reference Laboratory, and the WHO Collaborating Centre for Reference and Research on Influenza. Thanks also to Shuo Feng for assistance with Figure 3.
The Australian Sentinel Practices Research Network and the Melbourne WHO Collaborating Centre for Reference and Research on Influenza are supported by the Australian Government Department of Health. The Sentinel Practitioners Network of Western Australia is funded by the Western Australian Department of Health. The Victorian Sentinel Practice Influenza Network is funded by the Victorian Government Department of Health and Human Services.
DECLARATION OF INTEREST
None.