The sustained increase in overweight and obesity prevalence in Europe observed during the past two decades has become a serious public health concern( Reference Bundred, Kitchiner and Buchan 1 – Reference Lobstein and Millstone 4 ), demanding the direct involvement of governments of the European Union (EU) Member States( 3 , Reference Elmadfa 5 ). The associations between diet and health are not solely through overweight and obesity, but are mediated through overall diet and lifestyle( Reference Perez-Cueto, Verbeke and de Barcellos 6 ). The Food Standards Agency in the UK has calculated that 42 000 lives could be saved by increasing fruit and vegetable consumption to the five-a-day target (from about 3·5 portions) and 20 000 lives by reducing salt intake (from 9 to 6 g/d)( 7 ). In the USA, 1 % individual weight loss could result in an annual saving of $US 213 per diabetes patient( Reference Yu, Wu and Birnbaum 8 ). The fiscal effects of smoking, and in particular obesity, are large enough to become part of the social welfare calculation for evaluating changes in these two health behaviours and improvements in life expectancy( Reference Goldman, Michaud and Lakdawalla 9 ).
Responding to the endorsement of the WHO European Region's First Action Plan for Food and Nutrition Policy, fifty-one member states started implementing Action Plans at national level. A majority (75 %) of WHO European Member States had developed national food and nutrition policies by 1998/1999, but they were still lacking the national structures for the implementation. Most WHO European Member States had developed references for nutrient intakes and healthy eating guidelines. Furthermore, main nutrition-related outcomes were identified (chronic non-communicable diseases, obesity, iron-deficiency anaemia, iodine deficiency disorder), resulting in a call for policies that would aim at enhancing health, living conditions and equality for the European population( 10 ). Such considerations were the basis for the WHO Regional Office for Europe's request to implement concerted actions in different countries to tackle the challenge of obesity through healthy eating and increased physical activity( 3 ) and to launch the Second Action Plan for Food and Nutrition Policy 2007–2012, which specifically states that ‘Incorporation of monitoring and evaluation in every policy or programme contributes to the establishment of evidence-based public health’( 11 ). Many EU Member States have drafted policy papers in response to it, but large variations are observed between them in terms of terminology, nutritional recommendations, institutional framework, nutritional scope, social groups targeted, and monitoring and evaluation structures( Reference Lachat, Van Camp and De Henauw 12 ). Such actions and policies include the concept of healthy eating, its promotion and advice for intake levels. However, most policies have not been evaluated formally, and where they have, recommendations remain suggestive( Reference Luttikhuis, Baur and Jansen 13 – Reference Bluford, Sherry and Scanlon 16 ). Against this background, the EU Seventh Framework Programme collaborative research project EATWELL (Interventions to Promote Healthy Eating Habits: Evaluation and Recommendations) responds to the perceived need to provide accurate information as a basis for the efficient design of future policies( Reference Burris, Wagenaar and Swanson 17 , Reference Traill, Perez-Cueto and Shankar 18 ). The objective of the present paper is to identify and assess healthy eating policies at national level that have been evaluated in terms of their impact on awareness of healthy eating, food consumption, health outcome or cost/benefit. Furthermore, the paper highlights which kind of policies ‘worked’ and which ones did not.
Methodology
Healthy eating policies were defined as ‘any government action which can affect people's healthy eating behaviour by either supporting more informed choice or by changing the market environment’. Furthermore, healthy eating was defined as the adherence to the nutrition recommendations given by the WHO( 19 ). All the included policies and subsequent projects were selected on the basis that they were financially supported by public funds, whether or not there was also private participation. They had to be part of a larger general policy frame or refer to it. The scope of the present study is exhaustive in the ‘type’ of interventions, but it is not exhaustive in the number of interventions in all countries.
Data were collected systematically in seventeen out of the twenty-seven EU Member States (see online Supplementary material). The information on the policy interventions was gathered from governmental websites, through general search in databases and peer-reviewed journals, by personal contacts with national public servants and in direct consultation with policy makers. In addition, previous reviews and EU-funded projects were also consulted( Reference Lobstein and Millstone 4 , Reference Lachat, Van Camp and De Henauw 12 , Reference De Bourdeaudhuij, Van Cauwenberghe and Spittaels 20 – Reference Kumanyika, Obarzanek and Stettler 24 ).
Policies were classified into two main branches( Reference Mazzocchi and Traill 25 ): (i) policies that support more informed choice, with sub-categories of advertising controls, public information campaigns, nutrition education, nutritional labelling and nutritional information on menus; and (ii) policies that intended a change of the market environment, with possible categories of fiscal measures, regulation of meals, nutrition-related standards (e.g. CODEX Alimentarius), government actions to encourage private sector actions, availability measures for disadvantaged consumers, liability laws and others not specifically targeted to healthy eating but that may influence it. The search was exhaustive in terms of the kind of policy, so that all of them could be represented (S Capacci, M Mazzocchi, B Shankar et al., unpublished results). An exhaustive description of policies, provided as online Supplementary material, is outside the scope of the present paper.
Information about the different interventions was classified into different categories and entered into a database. Categories included the description of the policy/action, its type according to a predetermined list of options, its expected outcomes in terms of health and behaviour, and a potential evaluation approach (details provided as online Supplementary material). Since a larger policy (e.g. Portuguese Platform Against Obesity) may have a number of constituent elements (e.g. information campaign, school meal changes), constituent elements were catalogued separately. Furthermore, policy documents and actions were included only if associated with a healthy eating campaign. In many countries policies remain as such, since their implementation may be postponed or never get executed. Hence, only actions that were related to specific policies were retained to perform the ‘evaluation of evaluations’ in the present study.
It was then examined whether and to what extent actions were evaluated in terms of their impact on awareness or knowledge, food consumption or intake, and health outcomes (independently of the indicator used), and whether any information was available on implementation costs, budget or, preferably, cost/benefit analysis. Thus interventions were grouped into the following categories: no evaluation; awareness/knowledge evaluation; consumption/intake evaluated; health outcome provided; and cost/benefit calculated.
Results
Extent and type of evaluations
Figure 1 shows the distribution of evaluations of impact according to the aforementioned indicators. From the original 121 revised policies, only 107 were retained. The removal criteria for the fourteen policies were: (i) documents containing only guidelines; or (ii) a general framework or ‘political intention’ but without any further implementation as a consequence. From the 107 selected interventions, the larger group (36 %) did not have any evaluation on the basis of the selected indicators. Impact in terms of awareness was evaluated in 21 % of the actions. The measurements of awareness differed methodologically between countries and type of interventions. Some indicators referred to ‘remembering slogans of a campaign’, others to increased knowledge of what healthy eating is. However, comparability is hindered by the lack of uniform measures and hence of objective assessment.
Seventy-five per cent (n 80) of the actions that underwent some form of evaluation did not report changes in consumption, or at least did not include specific food consumption as indicators of intervention outcome. As with awareness, comparability of data is hindered by un-harmonized indicators. Some indicators referred to increased fruit and/or vegetable consumption, often in proportions or in quantities; other indicators referred to intake levels of specific nutrients such as iodine, cholesterol, saturated fat, total fat and fibre. Since many EU initiatives and actions targeted at school environments (e.g. breakfasts) are about milk, some actions have been evaluated in terms of milk and dairy products consumption. Snacking and breakfast (consumption or skipping) have also been used as measures of impact on consumption. Finally, lifestyle changes or a combination of lifestyle factors have also been used in some reports about impact on consumption.
Only 15 % of the interventions (n 16) did an impact assessment on health. The most common way to evaluate the impact on health was to analyse obesity levels before and after the intervention. The French ‘Together we fight obesity’ (EPODE) and its precursor, the ‘Fleurbaix-Laventie Ville Santé’ (FLVS) project, the Italian ‘Cultura che nutre’ and ‘Contratto della Merenda’ (CDM), the ‘Stockholm obesity prevention project’ in Sweden and the VIASANO project in Belgium all looked at the prevalence of obesity among their participants. Main indicators for health evaluation have been prevalence levels of overweight and obesity, derived from BMI. In some cases indirect measures such as increased fruit consumption have been reported as an indicator of potential health impact (e.g. Food and Well Being, Wales). The Finnish ‘North Karelia program’ (NKP) and the Portuguese ‘Peso Comunitario’ (PPC) also measured blood cholesterol, blood pressure and obesity prevalence as health indicators.
Reporting on the cost of interventions was available for three of the selected evaluations (2·8 %). The main indicators used in this case were the total budgets spent. Only the Finnish NKP stated that population-based prevention through influencing the population's diet and other lifestyle factors is by far the most cost-effective and sustainable way for a reduction in CVD rates and promotion of heart health in the population( Reference Puska 26 ).
None of the following revised categories of actions/policies in EU countries provided information on the performance indicators: tax/subsidy on foods; subsidies (e.g. vouchers) to disadvantaged consumers targeted at buying healthy foods; advertising controls; nutritional labelling; nutritional information on menus. The only example of a nutrition-related standard is the recent Danish ban on trans fats. However, this action has not been formally evaluated yet.
Evaluations of policies by category
Public information campaigns
A policy was classified in this category if it had the aim of improving individual and social knowledge about health issues connected to food habits, making use of mass media (newspapers or television) and was directed to any kind of target population. Most of such campaigns achieved the intended goal of raising awareness and knowledge about healthy eating at population level, as exemplified by the UK's ‘five-a-day’ (‘5D’) campaign, which was appraised by The Big Lottery Fund in 2006 and by the EPIC (European Prospective Investigation into Cancer and Nutrition) ‘Pilot Evaluation’( Reference Ashfield-Watt, Welch and Day 27 – Reference Myint, Welch and Bingham 30 ). Although the former reported greater levels of improvement in awareness and understanding of the implications of eating fruit and vegetables, only 24 % of surveyed individuals reported an increased fruit and vegetables intake in the previous six weeks. The latter reported that the campaign had a positive effect in people with the lowest intakes, which is relevant for addressing inequalities in health. The Italian ‘Eat well, live healthy’ campaign, executed between 2003 and 2005 targeting the general population and youth in particular, reported that 37·8 % of the participants in their evaluation survey improved their dietary habits as a consequence of the campaign.
Regulation of school/canteen meals
This category included any regulation of food supplied at school and work canteens, health standards for canteens and school shops as well as rules on vending machines placed in schools. It also covered the distribution of fruit, milk fountains or other healthy snacks to schoolchildren. The Italian programme ‘Eating Together’ reported a desirable increase in yoghurt consumption as a snack: 60 % v. 47 % among children at kindergarten and 38 % v. 30 % among primary-school children, comparing after v. before the campaign. Fruit consumption as a snack in the morning among children at middle school increased (6·5 % after v. 3·6 % before); fruit consumption in general also increased among adolescents (17 % after v. 4 % before), while sweet beverages consumption decreased (3·3 % after v. 9·6 % before). ‘Lait scolaire’ in France, which was the base for the EU School Milk Programme (SMP) launched in 2008, reported that more than 1700 milk fountains had been installed in school canteens, with the positive outcome of 33 % of teenagers drinking a glass of milk daily at school. In Poland, since 2004, over 366 million ‘glasses of milk’ have been consumed by pupils under the SMP representing a 178 % annual growth (2007/2008).
An example of workplace action is the Danish ‘six-a-day’ that consisted of an agreement with companies to provide free fruit to their employees. A behavioural change attributable to this campaign is the 700 % increase in companies providing their employees with free fruit between 2001 and 2003 (a total of 4986 workplaces, 10 % being public) and a resulting daily fruit consumption of 3·42 units on average.
Nutrition education programmes
‘Nutrition education’ was defined as any action involving schools or the use of typical educational tools (e.g. training, seminars, lectures) regardless of the age and the target population. The Danish ‘All about Diet’ programme consists of two web pages providing information to adults and children, a hotline and a rejsehold – a mobile task force – helping communities, schools and institutions to improve healthfulness of foods offered. This programme exemplifies the gap between having a policy and its implementation. In 51 % of cases a policy on school food was found, but only 39 % of all participants now provide school food despite an overall satisfaction with the programme.
The Portuguese PPC is targeted to the general adult population, and comprises training sessions. The evaluation reported reductions in total energy intake (−6·3 %), cholesterol (−9·2 %), total fat (−12·2 %) and saturated fat (−15·6 %) between baseline and follow-up. The programme also claimed a desirable increase of 7·6 % in fibre consumption. The private–public partnership ‘Programa Educativo apetece-me’ aimed at providing information about food, nutrition, health and well-being in school. It had an impact on food habits as reported after quantitative and qualitative evaluations. However, no objectively verifiable data were available for either of the evaluations. The regional programme PASSE consists of a series of tools for the promotion of healthy eating that were developed for targeted age groups, teachers and health practitioners. This programme has collected impact assessment data, which are not yet publicly available.
Advertisement regulations
This class covered all regulations regarding advertising of unhealthy foods to different population segments, particularly children. In 2007, the UK communications regulator, OFCOM (formerly the Independent Television Commission), introduced a series of rules prohibiting the advertisement of foods high in fat, salt and sugar during children's television programmes. The intervention was evaluated mostly in terms of children's exposure to advertising messages on television, concluding that children aged 4–9 years saw 39 % less advertising of unhealthy food, while children aged 10–15 years saw 28 % less advertising compared with the same period before the ban's implementation. Similar bans were applied in Sweden and Denmark, but these have not been evaluated yet. In France, the food advertising ‘mandatory health messages’ campaign claimed its success being due to simple and straightforward messages and to the use of television as the means for broadcasting them.
Combination of policies
This category included cases in which more than one type of policy was implemented. A classic example is the Finnish NKP that combined strong public information campaigns, nutrition education, stakeholder involvement and community participation. NKP further emphasised that population-based prevention through influencing the population's diet and other lifestyle factors seems the most cost-effective and sustainable way for reducing CVD rates and promoting heart health in the population( Reference Puska 26 ). Another example is the French FLVS that combined nutrition education, information campaigns, regulation of school meals, physical activity and private–public partnerships. During the first period of the FLVS study (from 1992 to 2000) the prevalence of childhood overweight first tended to increase. During the second period (from 2000 to 2004), this level decreased in FLVS whereas it increased in the control towns( Reference Borys, Romon and Raffin 31 , Reference Romon, Lommez and Tafflet 32 ). The subsequent French programme EPODE has registered children's heights and weights systematically, and found an overall decrease in the prevalence of obesity of almost 2 % during the period 2005–2007. The Portuguese Platform Against Obesity's claimed success in bringing behavioural changes (reduced fat intake or improved food habits) could not be supported by publicly available and reliable evaluation indicators.
Discussion
The Global Database on National Nutrition Policies and Programmes was established in 1995, to monitor and evaluate the progress in implementing the World Declaration and Plan of Action for Nutrition. All documents call for monitoring and evaluating the impacts of the different programmes but evaluations are not performed yet. Although several potential useful indicators exist at the WHO's European Health For All database, like protein and energy consumption, particular attention should be given to other markers of healthy eating and nutritional status of the population. It is plausible that many countries and policy actions may have performed evaluations of their performance; nevertheless, such information is rarely available in English, online or accessible to the general public, as exemplified by PASSE in Portugal or Tutti-Frutti in Belgium.
Regarding public information campaigns, there is evidence from consumer surveys (on food) and self-completed questionnaires (on health-related attitudes and outcomes) that more people now know and understand what is meant by a healthy diet, even if this does not always translate into consistent practice (e.g. Food and Well Being, Wales). What remains a challenge is the impact assessment of actions such as the ‘5D’ campaign since ecological observations based on aggregated data suggest that observed changes in intake are not nutritionally relevant( Reference Capacci and Mazzocchi 33 ). In Poland a milk-focused campaign (Mlekosław) reported that advertisements were remembered by 27 % of mothers and 44 % of children; however, it did not influence significantly actual consumption habits( Reference Świątkowska 34 ). Contrary to previous reports on Canadian interventions( Reference Ransome, Rusk and Yurkiw 35 ), such results indicate that awareness and knowledge do not translate into behaviour, and exemplify the gap between attitudes and behaviour( Reference Kaiser and Schultz 36 ).
Conflicting findings were observed as a result of the present study. On the one hand, for example, the NKP suggests that ‘change in actual behaviour is possible’( Reference Puska 26 ) resulting in improved health and longer life expectancy at population level, and FLVS( Reference Borys, Romon and Raffin 31 ) claims success in overweight reduction among children( Reference Borys, Romon and Raffin 31 , Reference Romon, Lommez and Tafflet 32 ). On the other hand, interventions like the UK's ‘5D’ or the Italian ‘Fruit-Snack campaign’ showed no substantial increase in actual fruit and vegetable consumption, just like other modest results of population-level CHD prevention actions( Reference Papadakis and Moroz 37 ). Heterogeneity in terms of study design, theoretical foundations and target populations hinder comparability and generalisation of these findings, similar to what was reported for weight gain prevention( Reference Lemmens, Oenema and Klepp 38 ). Probably different settings and the length of the interventions may be potential confounding factors. Positive synergistic effects of integrating vertical and horizontal interventions of weight loss and weight management may enhance their sustainability, and increase effectiveness of prevention and reduction efforts( Reference MacLean, Clinton and Edwards 39 ). Such contradictions would be avoided if an agreed protocol and measurement technique/unit were to be applied for evaluation.
Regarding interventions regulating school/canteen meals, some desirable trends were observed, particularly higher fruit, vegetable or milk consumption and less breakfast skipping. This is consistent with reports about policy interventions that make healthy dietary and physical activity choices easier, which are likely to achieve the greatest benefits in combating childhood obesity for example( Reference Sallis and Glanz 40 , Reference Frieden, Dietz and Collins 41 ). Skipping breakfast( Reference Herrero-Lozano and Fillat-Ballesteros 42 , Reference Morales, Vilas and Vega 43 ) and snacking( Reference Macdiarmid, Loe and Craig 44 ) could be mentioned among food intake patterns related to obesity and overweight. Breakfast skipping is associated with lower cognitive and academic performance( Reference Pollitt and Mathews 45 – Reference Fernandez, Weigand and Pomar 47 ). Eating between meals or snacking has become the source of at least 25 % of total energy intake in different EU settings and it provides more than the recommended quantities of added sugars and saturated fatty acids( Reference Macdiarmid, Loe and Craig 44 ). Hence, strategies specifically directed to the promotion of healthy breakfast and snacking habits are more likely to achieve success( Reference Rahmani, Djazayery and Habibi 48 , Reference Naylor and McKay 49 ) if they take into account socio-economic, sociodemographic and attitudinal differences( Reference Kaiser and Schultz 36 , Reference Salamon, Pfau and Grillenberger 50 ).
Nutrition education in schools can be successful in promoting awareness and generating healthy habits such as snacking with fruit, as the Italian CDM reported. Such a programme would not have been possible without parents’ involvement and their awareness of the importance of nutrition education( Reference De Bourdeaudhuij, Van Cauwenberghe and Spittaels 20 , Reference Harker, Sharma and Harker 51 ). Furthermore, this exemplifies the need for strategic alliances between concerned actors and stakeholders in carrying out the task of promoting healthy eating which would yield better academic performance and long-term health( Reference Ransome, Rusk and Yurkiw 35 , Reference Rahmani, Djazayery and Habibi 48 – Reference Salamon, Pfau and Grillenberger 50 ). Yet evidence remains contradictory; e.g. in US schools, participation in School Breakfast Programs has been reported as beneficial in the prevention of obesity, while participation in the National School Lunch Program seems to exacerbate the obesity levels among youths( Reference Millimet, Tchernis and Husain 52 ). Other multi-sector projects such as PASSE in Portugal have implemented evaluation procedures that will provide information on the effectiveness of the intervention. However such information is not yet publicly available.
Conclusions
The present study has shown that a large share of healthy eating policies has not been evaluated yet or their evaluation results are not public. The categories that are more likely to have a better or further-reaching evaluation are: (i) public information campaigns; (ii) regulation of meals at school/canteens; and (iii) nutrition education programmes. In general little or no evaluations have been carried out in terms of (or measured as) behavioural changes and cost/benefit.
The overall results of the study highlight issues to be considered in future policy formulation and action's evaluation. First, public information campaigns seem to be successful in increasing awareness, in creating an intention to engage in desired behaviours, but they fail to achieve actual behavioural change (reported as e.g. healthy eating). Second, there are a number of examples of potentially successful interventions classified as nutrition education in schools, particularly when a multi-sector and bottom-up approach is applied. Addressing healthy eating from a multidisciplinary and comprehensive perspective and the use of a range of actions can give better results( Reference De Bourdeaudhuij, Van Cauwenberghe and Spittaels 20 ). It seems that the general population is more likely to engage in any intervention where it feels part of it( Reference Sallis, Cervero and Ascher 53 , Reference Ventura and Birch 54 ). Third, regulating school/canteen meals is more likely to help students not to skip breakfasts and improve their healthy eating choices through improvement in terms of availability, but in the case of school meals regulations, they need to be comprehensive and also involve the parents( Reference Sharma 15 , Reference Brown and Summerbell 55 , Reference Campbell and Hesketh 56 ).
Because combinations of policies, such as with NKP( Reference Puska 26 ) and FLVS( Reference Borys, Romon and Raffin 31 ), have been better evaluated, either because of their long-standing life or their design, the evidence suggests that any policy aimed at healthy eating may be successful if there is a component of multi-stakeholder involvement and if the approach includes the synergy of different types of policy instruments( Reference Mohebati, Lobstein and Millstone 57 ). Furthermore, the present study emphasises the need for harmonised and verifiable indicators for measuring success and comparing between countries, and advocates for better informed (evidence based) policy choices. Proper evaluations should be included in any public-funded action, particularly when health outcomes are expected. Reasonable health outcomes such as reduced overweight levels or increased physical activity do not appear from one day to the other; such changes need time and it is a hard process. It is clear that changes at population level require a reasonable time frame to be measurable, e.g. weight loss or changes in nutritional status( Reference Romon, Lommez and Tafflet 32 ). Planning strategically ahead of time and applying pertinent indicators will prevent waste of public resources in interventions that may not have any significant effect( Reference Burris, Wagenaar and Swanson 17 , Reference Frieden, Dietz and Collins 41 , Reference Kim and Kawachi 58 , Reference Murimi and Harpel 59 ). The cost/benefit analyses performed by some actions suggest that prevention is indeed cheaper than treatment of obesity.
EU policies should provide a set of indicators that may be regularly collected in all countries. Such indicators should be able at least to measure the impact of policies on food and nutrient intakes. Since impact on health is mostly measured using nutritional status based on BMI, anthropometric measures should be included in regular surveys, although performing those measurements is time consuming and requires expertise. BMI-based nutritional status categories from measured heights and weights are, however, the most reliable epidemiological indicator for population studies( Reference Rothman 60 , Reference Perez-Cueto and Verbeke 61 ).
Distinction should be made between the evaluation of impact on intentions, attitudes, knowledge and behaviour. Measured knowledge of specific messages does not imply adopting a desirable behaviour (healthy eating, increased physical activity, etc.), since other drivers of behaviour may play a role, particularly when e.g. individuals have to choose between different food items( Reference Salamon, Pfau and Grillenberger 50 , Reference Resano, Verbeke and de Barcellos 62 , Reference Sharma, Harker and Harker 63 ). Since most ‘healthy eating’ policies advocate the increased consumption of foods of plant origin, limited consumption of meats and energy-dense foods, and also decreased consumption of processed meats and sugary drinks, our suggestion would be to include key indicators of food consumption or availability( Reference Lagiou, Trichopoulou and Contributors 64 ) using harmonised data collection schemes in Europe for any proper evaluation of future policies. Unless such harmonised data are systematically collected and analysed, evaluations of policies in terms of economic cost/benefit at population level will not be achievable.
Acknowledgements
The work was supported financially by the European Community under the Seventh Framework Programme for Cooperation, Theme Food, Agriculture and Fisheries, and Biotechnology, Contract 226713. Preliminary findings from this manuscript were presented orally at the Second Congress of Public Health Nutrition in Porto, Portugal, and won the Research Excellence Award to the free paper competition 1. The authors declare that they have no conflicts of interest. F.J.A.P.-C., J.A.-W., S.C., J.B.-M., A.K.-K., B.P. and A.T. were involved in data collection and analysis. F.J.A.P.-C. and J.A.-W. drafted the first version of the manuscript. W.V., W.B.T., B.S., M.M., B.N., T.B.-L., A.S., A.T. and J.W. contributed critically to the content of the article. J.W. revised the language. W.B.T. was the Project Coordinator.