Hostname: page-component-78c5997874-ndw9j Total loading time: 0 Render date: 2024-11-10T05:19:10.776Z Has data issue: false hasContentIssue false

Alcohol assessment and feedback by email for university students: main findings from a randomised controlled trial

Published online by Cambridge University Press:  02 January 2018

Jim McCambridge
Affiliation:
Faculty of Public Health & Policy, London School of Hygiene and Tropical Medicine, London, UK
Marcus Bendtsen
Affiliation:
Department of Medicine and Health, and Department of Computer and Information Science, Linköping University, Linköping, Sweden
Nadine Karlsson
Affiliation:
Department of Medicine and Health, Linköping University, Linköping, Sweden
Ian R. White
Affiliation:
Biostatistics Unit, Institute of Public Health, Cambridge, UK
Per Nilsen
Affiliation:
Department of Medicine and Health, Linköping University, Linköping, Sweden
Preben Bendtsen
Affiliation:
Department of Medicine and Health, Linköping University, Linköping, Sweden
Rights & Permissions [Opens in a new window]

Abstract

Background

Brief interventions can be efficacious in changing alcohol consumption and increasingly take advantage of the internet to reach high-risk populations such as students.

Aims

To evaluate the effectiveness of a brief online intervention, controlling for the possible effects of the research process.

Method

A three-arm parallel groups design was used to explore the magnitude of the feedback and assessment component effects. The three groups were: alcohol assessment and feedback (group 1); alcohol assessment only without feedback (group 2); and no contact, and thus neither assessment nor feedback (group 3). Outcomes were evaluated after 3 months via an invitation to participate in a brief cross-sectional lifestyle survey. The study was undertaken in two universities randomising the email addresses of all 14910 students (the AMADEUS-1 study, trial registration: ISRCTN28328154).

Results

Overall, 52% (n = 7809) of students completed follow-up, with small differences in attrition between the three groups. For each of the two primary outcomes, there was one statistically significant difference between groups, with group 1 having 3.7% fewer risky drinkers at follow-up than group 3 (P = 0.006) and group 2 scoring 0.16 points lower than group 3 on the three alcohol consumption questions from the Alcohol Use Disorders Identification Test (AUDIT-C) (P = 0.039).

Conclusions

This study provides some evidence of population-level benefit attained through intervening with individual students.

Type
Papers
Copyright
Copyright © Royal College of Psychiatrists, 2013 

Alcohol causes huge problems, both for population health and for society more broadly. Reference Rehm, Mathers, Popova, Thavorncharoensap, Teerawattananon and Patra1 Heavy drinking among university students is a global phenomenon, and Swedish students drink heavily, with heavy episodic drinking normative. Reference Andersson, Wiréhn, Olvander, Ekman and Bendtsen2 Effective interventions have the potential to alter acute risk of car crashes, violence and suicide, the leading causes of death among young people globally Reference Gore, Bloem, Patton, Ferguson, Joseph and Coffey3 and chronic risk of the longer-term health and psychosocial consequences of alcohol consumption. Reference McCambridge, McAlaney and Rowe4 Population-level interventions that seek to influence the price, availability and cultural acceptability of hazardous and harmful drinking are likely to be most effective in reducing these problems. Reference Babor, Caetano, Casswell, Edwards, Giesbrecht and Graham5 These may be complemented by individual-level interventions delivered in health services and elsewhere. Reference Room, Babor and Rehm6

Brief feedback and computerised interventions have the capacity to alter behaviour and reduce alcohol problems in student populations. Reference Rooke, Thorsteinsson, Karpin, Copeland and Allsop7-Reference Moreira, Smith and Foxcroft10 This research literature is, however, both recent and evolving quickly and many important questions have not yet been addressed. These include the effect sizes to be expected, the conditions under which they are obtained, population moderators and intervention content mediators (for example is individualised feedback required, and if so should it be normative), as well as questions to do with different delivery models and cross-cultural variability. Reference Khadjesari, Murray, Hewitt, Hartley and Godfrey8,Reference McCambridge, Bendtsen, Bendtsen and Nilsen11 A key limitation of existing evidence is the paucity of multisite large-scale effectiveness trials of internet interventions. Reference Kypri, McCambridge, Cunningham, Vater, Bowe and De Graaf12,Reference Kypri, Hallett, Howat, McManus, Maycock and Bowe13 Such studies must address significant methodological challenges common to other areas of e-health research including management of assessment reactivity in seeking to detect subtle effects on behaviour Reference McCambridge and Kypri14 and attrition. Reference Cunningham, Kypri and McCambridge15 Following an earlier Swedish effectiveness study, Reference Ekman, Andersson, Nilsen, Stahlbrandt, Johansson and Bendtsen16 Sweden became the first country to implement a policy based on the accumulating international evidence-base in the form of a national system. It is now routine practice for university students to receive an email from student healthcare services inviting them to participate in a brief online alcohol intervention. Reference McCambridge, Bendtsen, Bendtsen and Nilsen11 New Zealand has recently decided to follow suit, Reference Kypri, McCambridge, Vater, Bowe, Saunders and Cunningham17 and it is anticipated that other countries will implement local, regional or national systems. This study aimed to evaluate the effectiveness of a brief online intervention, part of the national strategic response in Sweden, controlling for the possible effects of the research process.

Method

Study design and hypotheses

The lack of any standard timing of email delivery was exploited to undertake a randomised trial in the newly formed national system (trial registration: ISRCTN28328154).

This was a three-arm parallel group trial in which routine provision of assessment and feedback via email (group 1) was compared with assessment only (group 2) and a no-contact control (group 3). With this dismantling design we sought to assess possible overall and component effects, with equivalent numbers in each arm. Groups 1 and 2 completed identical assessments, the sole difference between them being that group 1 received normative and other feedback as usual, whereas group 2 did not. There were four pre-specified hypotheses tested, including three tests of universal prevention among university students in general and a per-protocol evaluation of the specific effects of feedback among baseline risky drinkers only. Reference McCambridge, Bendtsen, Bendtsen and Nilsen11 This design thus nests one conventional intervention effectiveness evaluation within a rare study of the effects of the universal provision of individualised intervention in the population as a whole. A key feature of this study design is that all participants were entirely unaware they were participating in a trial at any point (see Masking) specifically in order to minimise any possible effects of the research process.

Study procedures

The study was undertaken simultaneously in Linköping and Luleå universities in Sweden. These were selected on the basis of previously conducted research involving the local student healthcare services responsible for alcohol interventions. All students in semesters one, three or five of their studies during the autumn 2011 term were randomised via email addresses, through which all official mail is delivered. Randomisation was computerised (programmed by M.B.) and did not employ any strata or blocks and was not possible to subvert, as this and all subsequent study processes were fully automated. Study procedures are fully detailed in the study protocol. Reference McCambridge, Bendtsen, Bendtsen and Nilsen11

Groups 1 and 2 received an email from the student healthcare services on 5 September 2011 and completed an alcohol assessment instrument comprising ten items. The only difference between the emails was that group 1 were advised they would also get feedback, which they then received, whereas group 2 were simply thanked for their participation and offered a link to a commonly used alcohol website without content understood to be effective in assisting behaviour change. A demonstration version of the assessment and feedback intervention can be viewed at http://demo.livsstilstest.nu.

Three months later all three groups were sent an identical email from the Swedish principal investigator (P.B.). This made no reference to alcohol nor to the previous email and comprised an invitation to participate in an online lifestyle survey with a 15-item questionnaire. Trial outcomes were derived from the three alcohol questions (see Outcome evaluation) in this survey. There were three reminders containing a link to the questionnaire. The final reminder also provided an option of completing three brief questions in the body of an email, only one of which measured drinking (heavy episodic drinking) in order to preserve masking. Follow-up data collection was completed on 21 December 2011.

Masking

All three groups were unaware they were participating in an intervention study and that they had been randomised. Instead, at follow-up they were invited to participate in a seemingly unrelated cross-sectional lifestyle survey without any particular focus on alcohol. The non-alcohol nature of this invitation stemmed from our large pilot trial in which we obtained higher rates of follow-up than had been observed previously in Sweden, but also found markedly higher participation rates in group 3. Reference Bendtsen, McCambridge, Bendtsen, Karlsson and Nilsen18 We thus chose to conceal the alcohol study focus at follow-up. The use of masking and deception in this trial raises ethical issues that were considered and approved by the Regional Ethical Committee in Linköping, Sweden (No. 2010/291-31). We later undertook a focus group study debriefing two groups of AMADEUS-1 participants as part of an ethical evaluation and subsequently debriefed all participants about the nature of the study.

Outcome evaluation

The first three items of the Alcohol Use Disorders Identification Test (AUDIT-C Reference Bush, Kivlahan, McDonell, Fihn and Bradley19 ) were embedded within the 15-item lifestyle survey alongside questions on smoking, diet, physical activity and sociodemographic characteristics. The two primary outcomes were AUDIT-C scores and the prevalence of risky drinking (according to the Swedish definition of at least one heavy episode of drinking 5 drinks (of 12 g of alcohol) or more for men or 4 drinks or more for women in the past month or weekly consumption of more than 14 drinks for men or more than 9 drinks for women Reference Andréasson and Allebeck20 ). The three secondary outcomes were the component items of the AUDIT-C: (1) frequency of drinking; (2) typical quantity consumed; and (3) number of heavy episodes of drinking per month. Psychometric properties online have been established as valid in student populations. Reference Thomas and McCambridge21

By necessity, inferences involving group 3 can only be drawn in entirely unselected populations, as there were no baseline data. We declared a priori our approach as highly conservative, unavoidably including data biased towards the null (both from non-participants at baseline and those who are not risky drinkers). Reference McCambridge, Bendtsen, Bendtsen and Nilsen11 We undertook an additional analysis (reported in online Table DS2) and acknowledge that testing the specific effects of feedback in the per-protocol analysis among baseline risky drinkers involves a departure from the intention-to-treat principle. Reference McCambridge, Bendtsen, Bendtsen and Nilsen11

Sample size

The pilot study indicated that any between-group differences were likely to be very small. Reference Bendtsen, McCambridge, Bendtsen, Karlsson and Nilsen18 To detect an effect size of 0.08 standard deviations between any two groups with 5% significance level and 80% power, we required 2500 individuals analysed per group. Assuming a follow-up rate of 50%, we therefore aimed to recruit 5000 individuals per group.

Statistical methods

All analyses were restricted to individuals reporting outcome data and thus assumed that missing data were missing at random. To assess this assumption, we compared AUDIT-C and heavy episodic drinking outcomes between individuals who responded via the online questionnaire after the initial and first, second and third reminder emails, and between heavy episodic drinking among those who responded via the online questionnaire and in the body of the email. Any trend is suggestive of a missing not at random mechanism, with missing outcomes likely to be more similar to late responders than early responders. Reference Wood, White and Hotopf22 We also undertook pre-specified analyses of possible effect modification by university, term, age, gender and baseline drinking. We added an unplanned sixth outcome measure, combining drinking frequency and quantity (AUDIT items 1 and 2) to form a total weekly consumption outcome.

Differences in proportions between groups were examined with chi-squared tests and mean differences by Student's t-test. Logarithmic transformations were used to reduce skewness. Effect sizes were calculated as standardised mean differences (Cohen's d Reference Cohen23 ) and odds ratios as appropriate. Multivariate linear regression (for AUDIT-C outcomes) and multivariate logistic regression (for binary risky drinking outcomes) were used to adjust intervention effects for baseline covariates. In intention-to-treat analyses comparing groups 1, 2 and 3, baseline covariates were gender, age, term and university. In per-protocol analyses comparing groups 1 and 2, baseline covariates additionally included log-transformed weekly alcohol consumption. Interactions between intervention group and predictor variables were tested by comparing models excluding and including the interaction parameters using the F-test (for linear regression) or the likelihood ratio test (for logistic regression). For analysis of missing data, AUDIT-C and heavy episodic drinking (both log-transformed) were compared between the initial and first, second and third reminder emails using linear regression. A t-test further compared heavy episodic drinking among those who responded in the body of the final email with all those who responded via the online questionnaire. All tests were performed two-sided at P<0.05. The statistical analyses were performed using SPSS 19 and Stata 12 in Windows.

Results

There were small statistically significant differences in the participation rates at baseline (36% and 33% in groups 1 and 2) and at follow-up (51%, 52% and 54% in groups 1, 2 and 3 respectively; see Table 1 and Fig. 1). The proportion who were risky drinkers at baseline was similar in groups 1 and 2 (64% and 63%) as were levels of attrition in these groups (70% and 72% respectively). The sociodemographic and university characteristics of the follow-up participants in all three groups did not differ (Table 2) nor were there differences at baseline between the two groups for the per-protocol analyses in sociodemographic, university or alcohol consumption data (online Table DS1).

Table 1 Participation and attrition

n (%)
Group 1Footnote a Group 2Footnote a Group 3Footnote a Total P
Baseline
    Randomised 4969 4969 4972 14 910
    Completed baseline 1798 (36.2) 1621 (32.6) 3419 (34.4) <0.001
    Risky drinkersFootnote b who completed baseline 1155 (64.2) 1016 (62.7) 2171 (63.5) 0.34
Follow-up (for intention-to-treat analyses)
    Completed follow-up 2546 (51.2) 2594 (52.2) 2669 (53.7) 7809 (52.4) 0.049
    Completed both baseline and follow-up 1271 (25.6) 1221 (24.6) 2492 (25.1) 0.25
Follow-up (for per-protocol analyses)
    Risky drinkersFootnote b at baseline completing follow-up 805 (69.7) 728 (71.7) 1533 (70.6) 0.32

a. Group 1: assessment and feedback group; group 2: assessment-only group; group 3: no contact group (i.e. neither assessment nor feedback).

b. Risky drinking: heavy episodic drinking ⩾1 a month or weekly consumption >14 drinks for men or >9 for women (i.e. according to Swedish national guidelines).

Fig. 1 CONSORT flow chart.

Intention-to-treat analyses

The intention-to-treat analyses included those in all three groups who took part in the follow-up survey, regardless of earlier participation. The prevalence of risky drinking (one of two primary outcomes) was higher in group 3 compared with group 1 by approximately 3.7% (P = 0.006 in the multivariate model) and AUDIT item 3 (heavy episodic drinking) was statistically significantly higher in the multivariate model only (P = 0.044; Table 3). In addition to these assessment and feedback effects, assessment-only effects were apparent in the AUDIT-C total score primary outcome (P = 0.039 multivariate P-value) and AUDIT item 3 (P = 0.036 multivariate P-value) in comparisons between group 2 and group 3 (Table 3). There were consistently small differences in the anticipated direction in comparisons with group 3, which were possibly as a result of chance, with P<0.1 for four of five comparisons for both groups 1 and 2. Restricting the sample to those scoring 2+ on AUDIT item 1 at follow-up diminished any small between-group differences (online Table DS2). There were no differences between groups 1 and 2 in the intention-to-treat analyses, nor any which attained statistical significance in univariate comparisons.

Table 2 Participant characteristics at baseline and follow-up

n (%)
Group 1Footnote a Group 2Footnote a Group 3Footnote a P
Total completing follow-up 2546 2594 2669
GenderFootnote b 0.16
    Male 1230 (48.3) 1296 (50.0) 1264 (47.4)
    Female 1316 (51.7) 1298 (50.0) 1405 (52.6)
Age, yearsFootnote b 0.93
    18–20 687 (27.0) 692 (26.7) 694 (26.0)
    21–25 1422 (55.9) 1445 (55.7) 1511 (56.6)
    ⩾26 437 (17.2) 457 (17.6) 464 (17.4)
UniversityFootnote c 0.55
    Linköping 1886 (74.1) 1923 (74.1) 2008 (75.2)
    Luleå 660 (25.9) 671 (25.9) 661 (24.8)
TermFootnote c 0.94
    1 1020 (40.1) 1054 (40.6) 1095 (41.0)
    3 868 (34.1) 890 (34.3) 907 (34.0)
    5 658 (25.8) 650 (25.1) 667 (25.0)
University sectionFootnote c , Footnote d 1271 1221 0.89
    Faculty of arts and sciences 368 (29.0) 366 (30.0)
    Faculty of technology 638 (50.2) 600 (49.1)
    Faculty of education 131 (10.3) 132 (10.8)
    Faculty of health sciences 134 (10.5) 123 (10.1)

a. Group 1: assessment and feedback group; group 2: assessment-only group; group 3: no contact group (i.e. neither assessment nor feedback).

b. Collected at follow-up.

c. Collected at baseline.

d. Collected at baseline only for groups 1 and 2.

Additional analyses

Groups 1 and 2 did not differ to a statistically significant degree on either primary or secondary outcomes in the per-protocol analyses (Table 4). For the additional originally unplanned outcome of total weekly consumption, both the unadjusted test and the ANCOVA showed a statistically significant difference between the two groups (Table 4). There was no evidence of effect modification among five possible effect modifiers tested for both primary outcomes. Among those who responded via the online questionnaire, there was no evidence of differences in mean AUDIT-C scores or heavy episodic drinking at follow-up between responders after the initial and first, second and third reminder emails (AUDIT-C geometric mean: first email, 3.51; second email, 3.55; third email, 3.40, fourth email, 3.30, P = 0. 0.204; heavy episodic drinking geometric mean: first email, 1.08; second email 1.10; third email, 1.10; fourth email, 0.98; P = 0.447). However, there was evidence of a difference (P<0.001) in mean reported heavy episodic drinking between the 546 responders in the body of the email (geometric mean heavy episodic drinking: 1.46) and the 7809 responders via the online questionnaire (geometric mean heavy episodic drinking: 1.08).

Discussion

Main findings

This study found very small between-group differences in both primary and secondary outcomes favouring both assessment and feedback (group 1) and assessment only (group 2) in comparison with no contact (group 3). These differences were consistently in the anticipated direction, and some attained statistical significance. They provide evidence of a population-level effect obtained through very brief and simple individual-level interventions. However, this statement should not be interpreted to suggest that there is strong evidence of intervention benefit and any effects beyond those obtained after 3 months should be expected to deteriorate in the longer term. Reference Moyer, Finney, Swearingen and Vergun24 That many small differences were not statistically significant, even with such a large sample size, demonstrates just how small any such effects actually are. This study was highly naturalistic, comprising an unobtrusive evaluation of a national system in which student health services send emails to university students. We were aware at the outset that our evaluation strategy was conservative with populations randomised and compared regardless of their need for intervention, interest in participation and motivation to change, and also that the identification of even small effects is not without public health significance. Reference McCambridge, Bendtsen, Bendtsen and Nilsen11,Reference Bendtsen, McCambridge, Bendtsen, Karlsson and Nilsen18 This study design and the findings are novel not only for alcohol, but also for other health behaviours such as tobacco smoking for which it is desirable to intervene with individuals for population-level prevention purposes, now facilitated by the internet. Reference Borland, Balmford and Benda25

Strengths and limitations

A highly pragmatic evaluation was designed to minimise interference by research artefacts stemming from intervention study participation. This naturalistic study context, although having certain methodological advantages, also imposed limitations, most notably in participation rates and consequent potential for selection biases. Offering feedback in the initial email led to greater uptake in group 1 compared with group 2. Differential participation rates at baseline could bias outcomes away from the null in comparisons of groups 1 and 2, increasing the risk of selection bias in the per-protocol analysis in particular, whereas differential participation rates at follow-up are more difficult to interpret but may bias comparisons of all three groups. The overall follow-up rate of 52% is fairly unremarkable in the context of e-health trials, being higher than many and not as high as some. Reference Eysenbach26 Although other analyses suggested missing data were missing at random, the higher reported mean heavy episodic drinking among responders via email, compared with the large majority who responded via the online survey, provides further grounds for caution in interpreting these results. This suggests either a missing not at random mechanism, with heavier drinkers being disproportionately missing, or a mode effect.

Table 3 Main outcomes (intention-to-treat analyses of groups 1-3)Footnote a

Group 1 v. 2 Group 1 v. 3 Group 2 v. 3
Model, P Model, P Model, P
Group 1
(n = 2546)
Group 2
(n = 2594)
Group 3
(n = 2669)
Effect size or odds ratioFootnote b
(95% CI)
IFootnote c IIFootnote d Effect size or odds ratioFootnote b
(95% CI)
IFootnote c IIFootnote d Effect size or odds ratioFootnote b
(95% CI)
IFootnote c IIFootnote d
AUDIT score, geometric mean (s.d.)Footnote e
    AUDIT-C 3.46 (3.09) 3.44 (3.17) 3.60 (3.14) 0.005 (–0.050 to 0.060) 0.854 0.773 –0.046 (–0.101 to 0.008) 0.094 0.073 –0.051 (–0.105 to 0.003) 0.065 0.039
    AUDIT 1 1.50 (1.00) 1.50 (1.02) 1.55 (1.01) 0.003 (–0.052 to 0.057) 0.927 0.891 –0.048 (–0.102 to 0.007) 0.086 0.088 –0.050 (–0.104 to 0.005) 0.072 0.067
    AUDIT 2 1.07 (1.15) 1.08 (1.18) 1.10 (1.16) –0.009 (–0.063 to 0.045) 0.749 0.885 –0.029 (–0.083 to 0.026) 0.299 0.205 –0.020 (–0.074 to 0.035) 0.480 0.256
    AUDIT 3 1.06 (1.03) 1.06 (1.04) 1.12 (1.04) 0.001 (–0.053 to 0.056) 0.960 0.906 –0.052 (–0.107 to 0.002) 0.059 0.044 –0.054 (–0.108 to 0.001) 0.052 0.036
Risky drinking,Footnote f n (%) 1136 (44.6) 1194 (46.0) 1288 (48.3) 0.95 (0.85 to 1.05) 0.310 0.334 0.86 (0.78 to 0.96) 0.008 0.006 0.91 (0.82 to 1.02) 0.105 0.079

AUDIT, Alcohol Use Disorders Identification Test; AUDIT-C, three consumption questions from the AUDIT.

a. Group 1: assessment and feedback group; group 2: assessment-only group; group 3: no contact group (i.e. neither assessment nor feedback).

b. Cohen's d for AUDIT-C scores and odds ratio for risky drinking, unadjusted for baseline covariates.

c. Univariate analysis (t-test for AUDIT scores and χ2 test for risky drinking).

d. Multivariate analysis adjusted for age, gender, university and term.

e. Approximate standard deviation back-calculated from the log-scale.

f. Risky drinking: heavy episodic drinking ⩾1 a month or weekly consumption >14 drinks for men and >9 for women (i.e. according to Swedish national guidelines).

The AUDIT-C provides limited capacity to identify intervention effects, although such a short instrument served masking well. Outcomes were self-reported and although computerised data collection may minimise social desirability bias, Reference Turner, Ku, Rogers, Lindberg, Pleck and Sonenstein27 there is a need to study the validity of self-reported data in brief alcohol intervention trials as validity established in treatment contexts provides only limited reassurance. Reference Noknoy, Rangsin, Saengcharnchai, Tantibhaedhyangkul and McCambridge28,Reference Del Boca and Darkes29 The multiplicity of analyses should be borne in mind when interpreting study findings. Heterogeneity of findings from previous studies partly results from the detailed content of interventions evaluated, for example in the study by Moreira and colleagues Reference Moreira, Oskrochi and Foxcroft30 normative feedback arrived some weeks after the assessment. There are also differences among trial design and methods used, meaning that even the most rigorous estimates of intervention effects are contingent on the detailed characteristics of the evaluation studies. Reference Lipsey and Wilson31

This study has randomised and retained many more participants than any other alcohol study of which we are aware. Other study strengths include complete automation and minimisation of the potential for subversion of randomisation and observer bias in ascertainment of study outcomes. No previous study has been undertaken to evaluate a possible population-level impact of brief alcohol interventions. Reference Heather32 Indeed, there are no randomised studies and meagre time series data on alcohol programmes of any duration for any target group having an impact at a population level. Reference Heather32 Any such impact is thus noteworthy, especially when the costs of obtaining it are so low (annual cost per university is 6000 SEK, approximately £600 or US$920). Even if one assumes that the intervention was only delivered to those in groups 1 and 2, who participated at both baseline and follow-up (and thus ignoring subsequent delivery to all groups), the costs per intervention delivered are lower than in all previous brief intervention studies. Reference Bray, Zarkin, Hinde and Mills33 This calculation does not include the initial developmental costs, Reference McCambridge, O'Donnell, Godfrey, Khadjesari, Linke and Murray34 and although we did not include an economic evaluation (another study limitation to be borne in mind) it is reasonable to assume cost-effectiveness would be demonstrated for these effects given that the costs per brief intervention delivered are extremely low. Reductions in risky drinking and AUDIT scores can also be translated into possible effects on the prevalence of clinical diagnoses. Reference Foxcroft, Kypri and Simonite35

Implications

The effects of assessment alone observed here are striking. These findings extend previous randomised evaluations of assessment reactivity, almost entirely obtained in studies of hazardous and harmful drinkers. Reference McCambridge and Kypri14 It appears that students who are drinking at levels that are not hazardous may change their behaviour after thinking about it when prompted by answering questions. It also appears that feedback may be additionally useful to such thinking among those who are drinking at hazardous or harmful levels. These findings are compatible with self-regulation theory, Reference Clifford and Maisto36 and there is a need to develop conceptual frameworks to guide further studies of these effects. Reference McCambridge and Kypri14,Reference McCambridge37

This study was also designed to address key methodological issues. The differences between groups 2 and 3 are important because it has been shown that effect estimation depends on whether comparison is made with an assessed or an unassessed control group. Previous brief alcohol intervention studies have all used control conditions similar to group 2 rather than group 3. Group 2 constitutes a control condition that suffers fundamentally from contamination, as the data gathered for group 2 are entirely necessary to the delivery of the intervention received by group 1. Reference McCambridge and Kypri14,Reference McCambridge, Butor-Bhavsar, Witton and Elbourne38

Table 4 Per-protocol analyses of groups 1 and 2Footnote a among risky drinkers at study entry

Group 1
(n = 805)
Group 2
(n = 728)
Effect sizeFootnote b
(95% CI)
Model, P
IFootnote c IIFootnote d
Primary outcomes
    AUDIT-C, geometric mean (s.d.)Footnote e 5.44 (2.44) 5.67 (2.42) –0.095 (–0.195 to 0.006) 0.066 0.069
    Risky drinking at follow-up, n (%)Footnote f 552 (68.6) 526 (72.3) 0.84 (0.67 to 1.04) 0.115 0.161
Secondary outcomes
    AUDIT 1, geometric mean (s.d.)Footnote e 1.96 (0.69) 2.02 (0.68) –0.088 (–0.188 to 0.013) 0.076 0.079
    AUDIT 2, geometric mean (s.d.)Footnote e 1.70 (1.18) 1.79 (1.24) –0.074 (–0.175 to 0.026) 0.155 0.201
    AUDIT 3, geometric mean (s.d.)Footnote e 1.73 (0.94) 1.79 (0.96) –0.063 (–0.164 to 0.037) 0.193 0.212
Additional outcomeFootnote g
    Weekly consumption g/week 65.90 (68.27) 73.40 (74.92) –0.105 (–0.205 to −0.005) 0.041 0.040

AUDIT, Alcohol Use Disorders Identification Test; AUDIT-C, three consumption questions from the AUDIT.

a. Group 1: assessment and feedback group; group 2: assessment-only group; group 3: no contact group (i.e. neither assessment nor feedback).

b. Cohen's d for AUDIT-C scores and odds ratio for risky drinking, unadjusted for baseline covariates.

c. Univariate (t-test for AUDIT-C and weekly consumption and ω2 test for risky drinking).

d. Multivariate adjusted for gender, age, university, term and log (weekly consumption at baseline +1).

e. Approximate standard deviation back-calculated from the log-scale

f. Risky drinking: heavy episodic drinking ⩾1 a month or weekly consumption >14 drinks for men and >9 for women (i.e. according to Swedish national guidelines).

g. The weekly consumption analysis was not pre-specified.

This study has attempted both to evaluate a part of a national programme and to address important methodological problems in behavioural intervention trials. It makes clear the need to overcome certain methodological challenges associated with rigorous evaluation in behavioural intervention trials where the sought effects are subtle and thus vulnerable to interference by the research process. From an intervention perspective, study findings point towards the need to further develop content, delivery and tailoring methods, applying insights into behaviour change gained elsewhere. Experimentation with intervention timing as well as media such as smartphone applications may also be useful. This study provides useful evidence of both the need for, and potential benefit of, so doing. It indicates also the likely need to integrate these individual-level e-health interventions with other means to address high levels of alcohol consumption and problems associated with student drinking at a population level. Reference Room, Babor and Rehm6

To address problems within the general population, increasing the price of alcohol, better controlling its availability and restricting marketing to change the cultural acceptability of heavy drinking are most likely to be effective. Reference Babor, Caetano, Casswell, Edwards, Giesbrecht and Graham5 Student drinking may even be more price sensitive than that in adult populations, and university campuses provide environments that lend themselves to outlet and marketing controls. It is a key weakness of the existing literature that we do not possess multilevel studies that explore the synergy or otherwise of individual-level interventions with those implemented at the community or population level in any group. Although this particular intervention targeted university students, evaluation of universal applications for adult general populations may be warranted, for example in primary care. The global burden of alcohol-related harm is likely to grow in the coming years. Very modest interventions similar to those evaluated here appear capable of making a small but important contribution to moving the entire distribution of alcohol consumption and related problems to the left, and thus to the strategy of preventive medicine. Reference Rose39

Funding

This study was funded by The Swedish Council For Working Life and Social Research (FAS), grant number 2010-0024 and through a Wellcome Trust Research Career Development Fellowship in Basic Biomedical Science to the first author (WT086516MA). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

Footnotes

Declaration of interest

P.B. and M.B. own a company that has developed the online intervention used in this study and that develops and distributes computerised lifestyle interventions.

References

1 Rehm, J., Mathers, C., Popova, S., Thavorncharoensap, M., Teerawattananon, Y., Patra, J. Global burden of disease and injury and economic cost attributable to alcohol use and alcohol-use disorders. Lancet 2009; 373: 2223–33.CrossRefGoogle ScholarPubMed
2 Andersson, A., Wiréhn, AB, Olvander, C., Ekman, DS, Bendtsen, P. Alcohol use among university students in Sweden measured by an electronic screening instrument. BMC Public Health 2009; 9: 229.Google Scholar
3 Gore, FM, Bloem, PJN, Patton, GC, Ferguson, J., Joseph, V., Coffey, C., et al Global burden of disease in young people aged 10–24 years: a systematic analysis. Lancet 2011; 377: 2093–102.Google Scholar
4 McCambridge, J., McAlaney, J., Rowe, R. Adult consequences of late adolescent alcohol consumption: a systematic review of cohort studies. PLoS Med 2011; 8: e1000413.Google Scholar
5 Babor, T., Caetano, R., Casswell, S., Edwards, G., Giesbrecht, N., Graham, K., et al Alcohol, No Ordinary Commodity: Research & Public Policy. Oxford University Press, 2010.Google Scholar
6 Room, R., Babor, T., Rehm, J. Alcohol and public health. Lancet 2005; 365: 519–30.Google Scholar
7 Rooke, S., Thorsteinsson, E., Karpin, A., Copeland, J., Allsop, D. Computer- delivered interventions for alcohol and tobacco use: a meta-analysis. Addiction 2010; 105: 1381–90.Google Scholar
8 Khadjesari, Z., Murray, E., Hewitt, C., Hartley, S., Godfrey, C. Can stand-alone computer-based interventions reduce alcohol consumption? A systematic review. Addiction 2011; 106: 267–82.CrossRefGoogle ScholarPubMed
9 Carey, KB, Scott-Sheldon, LA, Elliott, JC, Bolles, JR, Carey, MP. Computer- delivered interventions to reduce college student drinking: a meta-analysis. Addiction 2009; 104: 1807–19.Google Scholar
10 Moreira, MT, Smith, LA, Foxcroft, D. Social norms interventions to reduce alcohol misuse in university or college students. Cochrane Database Syst Rev 2009; 3: CD006748.Google Scholar
11 McCambridge, J., Bendtsen, P., Bendtsen, M., Nilsen, P. Alcohol email assessment and feedback study dismantling effectiveness for university students (AMADEUS-1): study protocol for a randomized controlled trial. Trials 2012; 13: 49.Google Scholar
12 Kypri, K., McCambridge, J., Cunningham, JA, Vater, T., Bowe, S., De Graaf, B., et al Web-based alcohol screening and brief intervention for Maori and non-Maori: the New Zealand e-SBINZ trials. BMC Public Health 2010; 10: 781.Google Scholar
13 Kypri, K., Hallett, J., Howat, P., McManus, A., Maycock, B., Bowe, S., et al Randomized controlled trial of proactive web-based alcohol screening and brief intervention for university students. Arch Intern Med 2009; 169: 1508–14.Google Scholar
14 McCambridge, J., Kypri, K. Can simply answering research questions change behaviour? Systematic review and meta analyses of brief alcohol intervention trials. PLoS One 2011; 6: e23748.CrossRefGoogle ScholarPubMed
15 Cunningham, JA, Kypri, K., McCambridge, J. The use of emerging technologies in alcohol treatment. Alcohol Res Health 2011; 33: 320–6.Google ScholarPubMed
16 Ekman, DS, Andersson, A., Nilsen, P., Stahlbrandt, H., Johansson, AL, Bendtsen, P., et al Electronic screening and brief intervention for risky drinking in Swedish university students–a randomized controlled trial. Addict Behav 2011; 36: 654–9.Google Scholar
17 Kypri, K., McCambridge, J., Vater, T., Bowe, SJ, Saunders, JB, Cunningham, JA, et al Web-based alcohol intervention for Maori university students: double-blind, multi-site randomised controlled trial. Addiction 2013; 108: 331–8.Google Scholar
18 Bendtsen, P., McCambridge, J., Bendtsen, M., Karlsson, N., Nilsen, P. Effectiveness of a proactive mail-based alcohol Internet intervention for university students: dismantling the assessment and feedback components in a randomized controlled trial. J Med Internet Res 2012; 14: e142.Google Scholar
19 Bush, K., Kivlahan, DR, McDonell, MB, Fihn, SD, Bradley, KA. The AUDIT alcohol consumption questions (AUDIT-C): an effective brief screening test for problem drinking. Arch Intern Med 1998; 158: 1789–95.Google Scholar
20 Andréasson, S., Allebeck, P. Alkohol och Hälsa [Alcohol and Health]. The Swedish National Institute of Public Health, 2005.Google Scholar
21 Thomas, BA, McCambridge, J. Comparative psychometric study of a range of hazardous drinking measures administered online in a youth population. Drug Alcohol Depend 2008; 96: 121–7.Google Scholar
22 Wood, A., White, IR, Hotopf, M. Using number of failed contact attempts to adjust for non-ignorable non-response. J R Stat Soc A 2006; 169: 525–42.Google Scholar
23 Cohen, J. Statistical Power Analysis for the Behavioral Sciences (2nd edn). Lawrence Erlbaum Associates, 1988.Google Scholar
24 Moyer, A., Finney, JW, Swearingen, CE, Vergun, P. Brief interventions for alcohol problems: a meta-analytic review of controlled investigations in treatment- seeking and non-treatment-seeking populations. Addiction 2002; 97: 279–92.Google Scholar
25 Borland, R., Balmford, J., Benda, P. Population-level effects of automated smoking cessation help programs: a randomised controlled trial. Addiction 2013; 108: 618–28.Google Scholar
26 Eysenbach, G. The law of attrition. J Med Internet Res 2005; 7: e11.Google Scholar
27 Turner, CF, Ku, L., Rogers, SM, Lindberg, LD, Pleck, JH, Sonenstein, FL. Adolescent sexual behavior, drug use, and violence: increased reporting with computer survey technology. Science 1998; 280: 867–73.CrossRefGoogle ScholarPubMed
28 Noknoy, S., Rangsin, R., Saengcharnchai, P., Tantibhaedhyangkul, U., McCambridge, J. RCT of effectiveness of motivational enhancement therapy delivered by nurses for hazardous drinkers in primary care units in Thailand. Alcohol Alcohol 2010; 45: 263–70.Google Scholar
29 Del Boca, FK, Darkes, J. The validity of self-reports of alcohol consumption: state of the science and challenges for research. Addiction 2003; 98 (suppl 2): 112.Google Scholar
30 Moreira, MT, Oskrochi, R., Foxcroft, DR. Personalised normative feedback for preventing alcohol misuse in university students: solomon three-group randomised controlled trial. PLoS One 2012; 7: e44120.Google Scholar
31 Lipsey, MW, Wilson, DB. The way in which intervention studies have “personality” and why it is important to meta-analysis. Eval Health Prof 2001; 24: 236–54.Google Scholar
32 Heather, N. Can screening and brief intervention lead to population-level reductions in alcohol-related harm? Addict Sci Clin Pract 2012; 7: 15.CrossRefGoogle ScholarPubMed
33 Bray, JW, Zarkin, GA, Hinde, JM, Mills, MJ. Costs of alcohol screening and brief intervention in medical settings: a review of the literature. J Stud Alcohol Drugs 2012; 73: 911–9.Google Scholar
34 McCambridge, J., O'Donnell, O., Godfrey, C., Khadjesari, Z., Linke, S., Murray, E., et al, How big is the elephant in the room? Estimated and actual IT costs in an online behaviour change trial. BMC Res Notes 2010; 3: 172.CrossRefGoogle Scholar
35 Foxcroft, DR, Kypri, K., Simonite, V. Bayes' Theorem to estimate population prevalence from Alcohol Use Disorders Identification Test (AUDIT) scores. Addiction 2009; 104: 1132–7.Google Scholar
36 Clifford, PR, Maisto, SA. Subject reactivity effects and alcohol treatment outcome research. J Stud Alcohol 2000; 61: 787–93.Google Scholar
37 McCambridge, J. Research assessments: instruments of bias and brief interventions of the future? Addiction 2009; 104: 1311–2.Google Scholar
38 McCambridge, J., Butor-Bhavsar, K., Witton, J., Elbourne, D. Can research assessments themselves cause bias in behaviour change trials? A systematic review of evidence from Solomon 4-group studies. PLoS One 2011; 6: e25223.Google Scholar
39 Rose, G. The Strategy of Preventive Medicine. Oxford University Press, 1992.Google Scholar
Figure 0

Table 1 Participation and attrition

Figure 1

Fig. 1 CONSORT flow chart.

Figure 2

Table 2 Participant characteristics at baseline and follow-up

Figure 3

Table 3 Main outcomes (intention-to-treat analyses of groups 1-3)a

Figure 4

Table 4 Per-protocol analyses of groups 1 and 2a among risky drinkers at study entry

Supplementary material: PDF

McCambridge et al. supplementary material

Supplementary Table S1-S2

Download McCambridge et al. supplementary material(PDF)
PDF 59.3 KB
Submit a response

eLetters

No eLetters have been published for this article.