Hostname: page-component-cd9895bd7-gbm5v Total loading time: 0 Render date: 2024-12-27T12:52:00.514Z Has data issue: false hasContentIssue false

Four decades of socio-economic inequality and secular change in the physical growth of Guatemalans

Published online by Cambridge University Press:  05 December 2019

Liina Mansukoski*
Affiliation:
School of Sport, Exercise and Health Sciences, Loughborough University, Loughborough, UK
William Johnson
Affiliation:
School of Sport, Exercise and Health Sciences, Loughborough University, Loughborough, UK
Katherine Brooke-Wavell
Affiliation:
School of Sport, Exercise and Health Sciences, Loughborough University, Loughborough, UK
J Andres Galvez-Sobral
Affiliation:
Centro de Investigaciones Educativas, Universidad del Valle de Guatemala, Guatemala City, Guatemala
Luis Furlán
Affiliation:
Centro de Estudios en Informática Aplicada, Universidad del Valle de Guatemala, Guatemala City, Guatemala
Tim J Cole
Affiliation:
Great Ormond Street Institute of Child Health, University College London, London, UK
Barry Bogin
Affiliation:
School of Sport, Exercise and Health Sciences, Loughborough University, Loughborough, UK
*
*Corresponding author: Email liina.mansukoski@sickkids.ca
Rights & Permissions [Opens in a new window]

Abstract

Objective:

To investigate changes in socio-economic inequalities in growth in height, weight, BMI and grip strength in children born during 1955–1993 in Guatemala, a period of marked socio-economic-political change.

Design:

We modelled longitudinal data on height, weight, BMI and hand grip strength using Super-Imposition by Translation and Rotation (SITAR). Internal Z-scores summarising growth size, timing and intensity (peak growth velocity, e.g. cm/year) were created to investigate inequalities by socio-economic position (SEP; measured by school attended). Interactions of SEP with date of birth were investigated to capture secular changes in inequalities.

Setting:

Urban and peri-urban schools in the region of Guatemala City, Guatemala.

Participants:

Participants were 40 484 children and adolescents aged 3–19 years of Ladino and Maya ancestry (nobservations 157 067).

Results:

The difference in height (SITAR size) between lowest and highest SEP decreased from −2·0 (95 % CI −2·2, −1·9) sd to −1·4 (95 % CI −1·5, −1·3) sd in males, and from −2·0 (95 % CI −2·1, −1·9) sd to −1·2 (95 % CI −1·3, −1·2) sd in females over the study period. Inequalities also reduced for weight, BMI and grip strength, due to greater secular increases in lowest-SEP groups. The puberty period was earlier and shorter in higher-SEP individuals (earlier SITAR timing and higher SITAR intensity). All SEP groups showed increases in BMI intensity over time.

Conclusions:

Inequality narrowed between the 1960s and 1990s. The lowest-SEP groups were still >1 sd shorter than the highest. Risks remain for reduced human capital and poorer population health for urban Guatemalans.

Type
Research paper
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited.
Copyright
© The Authors 2019

Growth is a powerful predictor of later-life health and disease risk(Reference Kuh, Richards, Cooper, Kuh, Cooper and Hardy1). Growth faltering in both height and weight in its most extreme form causes death, and in lesser forms, is linked to increased disease risk later in life, poorer economic productivity and lower educational attainment(2,Reference Victora, Adair and Fall3) . According to UN Sustainable Development Goals 2 and 3, it is a global health priority to understand inequalities in health and growth, and to target interventions accordingly(4). In a broader biocultural sense, child height and weight are reflective of the general living conditions of a society, including access to appropriate nutrition, health care, education, emotional well-being and money(Reference Bogin5). Macroeconomic growth per se does not seem to reduce rates of growth faltering but there is a consistent relationship between socio-economic position (SEP) and growth within populations(Reference Vollmer, Harttgen and Subramanyam6,Reference Tanner7) . Recent work from the UK has shown that patterns of inequality in child height, weight and BMI change through time, reflecting changes in the overall living conditions(Reference Tanner7,Reference Bann, Johnson and Li8) .

Many low- and middle-income countries are characterised by large socio-economic inequality (commonly measured by the Gini Index) and are therefore likely to show larger differences in physical growth between SEP groups compared with countries such as the UK. Guatemala is both one of the most income inequal and most stunted countries in the world(Reference Marini and Gragnolati9). The population experienced a devastating civil war between 1960 and 1996(Reference Tomuschat, Lux De Coti and Balsells Tojo10). Despite the signing of peace accords in 1996, violence continues until this day. During the civil war the indigenous population of Guatemala, the Maya, suffered extreme violence, oppression, and lack of access to education and health care. Today, up to 70 % of children in highland Maya populations are stunted(Reference Martinez, Webb and Gonzalez11). About half of the population of Guatemala is considered Maya, with the other half identifying as ‘Ladino’, descendants of predominantly Spanish, Spanish-Maya and other ethnic origins. Over the last 100 years, there has been a 9·6 cm increase in the average height of Guatemalan males and a 9·1 cm increase for Guatemalan females, but even so the women are the shortest of any living population and the men the 11th shortest(2). Due to the alarming global rates of obesity, weight and body-composition-related growth measures are important to study alongside height. Guatemalan obesity rates are not formally monitored, but nationally representative data from the Guatemalan Living Standard Measurement Survey (ENCOVI 2000) estimated that between 1995 and 2000 the adult obesity rate increased from 8·1 to 16·0 %, while 7·2 % of urban Guatemalan children were estimated to be obese(Reference Marini and Gragnolati9). For females, the rates are the highest in Latin America. A continuation of this trend has been described by the most recent Guatemalan Demographic and Health Survey from 2015(12).

Historically, comprehensive longitudinal growth and health data from countries outside Europe and North America are largely absent. Uniquely, in Guatemala there have been two large child growth and health studies: the Institute of Nutrition of Central America and Panama (INCAP) Study and the Universidad del Valle de Guatemala (UVG) Longitudinal Study of Child and Adolescent Development(Reference Martorell, Habicht and Rivera13Reference Bogin and MacVean15). The INCAP Study introduced a nutritional intervention to resource-deprived rural, Ladino-only Guatemalan villages, and a follow-up in the late 1980s showed that the benefits of this intervention carried into adulthood in terms of economic and educational success(Reference Hoddinott, Maluccio and Behrman16,Reference Maluccio, Hoddinott and Behrman17) . The UVG Study was started in 1953 and continued until 1999 with over 40 000 schoolchildren measured annually at six urban Ladino schools in Guatemala City and a semi-urban Maya school 25 km from the City. Differences in physical growth, bone maturation and cognitive measures were reported between high-, middle- and low-SEP individuals, whereby the Maya in particular suffered from growth faltering in comparison to the other groups(Reference Bogin and MacVean15,Reference Bogin and MacVean18,Reference Bogin, Smith and Orden19) . These analyses were based on relatively small sub-samples of the UVG Study and did not report on secular changes in growth. It is further unknown if there have been changes over time in the timing and intensity of physical growth. The aim of the present study was to investigate how SEP inequalities in growth pattern of height, weight, BMI and hand grip strength have changed for individuals born between 1955 and 1993 (a time of great socio-economic and political change) using the full UVG Study database.

Methods

Study design and participants

We carried out a retrospective cohort study using longitudinal growth data of children who participated in the UVG Longitudinal Study of Child and Adolescent Development. Each year, a team of investigators visited seven study schools and measured all the students in attendance. The time elapsed between measurements usually ranged between 0·95 and 1·05 years(Reference Bogin, Camacho de Paz and MacVean14). Some participants were seen only twice and others between three and thirteen times. The schools were chosen based on parental SEP as measured by the school fees and parental education and occupation(Reference Bogin and MacVean15). Upon enrolment in a school the children were automatically entered into the study and informed consent for participation was collected from their parents.

Procedures

Standard anthropometric measurements were taken by a trained research team from the UVG following the guidelines of the International Biological Program; detailed protocols have been described previously(Reference Bogin, Camacho de Paz and MacVean14,Reference Bogin and MacVean18) . For the present study, we used the data collected for height (cm), weight (kg) and hand grip strength (kg) with participants seated. BMI (kg/m2) was calculated from height and weight. The 40 848 individuals in the study yielded a total of 157 067 mixed longitudinal observations, see Table 1 for summary statistics.

Table 1 Summary statistics: numbers of individuals (n) with mean and sd for age and anthropometric outcomes, for the sample of children and adolescents (n 40 484) aged 3–19 years of Ladino and Maya ancestry born during 1955–1993 in Guatemala (n observations 157 067)

Ascertainment of socio-economic position

A SEP variable was created for the present study from the data of the school attended. Data are available from schools ranging from the most expensive private schools to underprivileged state schools, allowing investigations of population-level inequality(Reference Bogin, Camacho de Paz and MacVean14,Reference Bogin and MacVean15) . To reiterate, schools were chosen for the original study based on the SEP of the students’ families, as measured by the parents’ education and occupation and fees paid to the schools(Reference Bogin, Camacho de Paz and MacVean14). For the very early years of the study, data were not available for all seven schools and therefore SEP analyses were restricted to individuals born after 1955 (n 38 672), measurements were taken between 1963 and 1999. The highest SEP group (SEP 1, n 6369) consisted of individuals who attended a private institution charging high fees. SEP 2 (n 15 849) was made up of students who attended single-sex private Catholic schools with moderate fees. SEP 3 (n 3279) consisted of students attending two co-educational Catholic private institutions with low fees or no fee. SEP 4 (n 8508) included the students of a co-educational, state-run, non-sectarian institution with no fee. The students from SEP 1 to SEP 4 were virtually all Ladinos. SEP 5 (n 4667) consisted of students of two co-educational, state-run, non-sectarian schools with no fee, attended primarily by individuals of Maya ethnicity. The school-based assessment of SEP in the original study was investigated with a separate assessment for four of the study schools when the study was still ongoing(Reference Bogin and MacVean15). A composite SEP score (range 4–15), representing parental occupation, parental education and zone of residence in the City, supported the school-based SEP categorisation(Reference Bogin and MacVean15). The analysis included a random sample of 672 families with children attending the study schools. The school classified here as SEP 1 had a mean composite score of 12·2 (sd 3·4) and the two schools grouped as SEP 2 had a score of 10·2 (sd 6·6)(Reference Bogin and MacVean15). For the school categorised as SEP 4 the score was 5·75 (sd 0·4). Unfortunately, the schools that in the present study constitute SEP 3 and 5 were not assessed, and there are no records or data which could be used to retrospectively assess or assign SEP at the individual or family level beyond school attended by participants.

Statistical analysis

In the first stage of analysis we used Super-Imposition by Translation and Rotation (SITAR). This is a data reduction technique which results in three biologically meaningful traits summarising growth for each child. SITAR growth models for childhood height, weight, BMI and grip strength were created using the entire longitudinal database from the UVG Study. The SITAR growth curve model fits a smooth mean curve to the data (as a natural cubic B-spline) and at the same time it fits random effects for individuals that consider differences in mean size, pubertal timing and pubertal intensity. The strength of this approach is that the random effects are biologically meaningful, yet simple, transformations of the mean curve that can be visualised geometrically. The three traits are:

  1. 1. ‘Size’, which indicates by how much the mean curve is shifted up or down to best match the individual’s curve, where larger size is positive and smaller negative, measured in units of the outcome (e.g. cm for height).

  2. 2. ‘Timing’, which relates to the age at peak growth velocity (APV) and indicates by how much the mean curve is shifted left or right to best match the APV on the individual’s curve, where positive timing indicates later maturation and negative earlier maturation, measured in years.

  3. 3. ‘Intensity’, which relates to the peak growth velocity (PV) and indicates by how much the mean curve is adjusted (see below) to best match the PV on the individual’s curve, where positive intensity indicates greater PV and negative smaller PV, measured as a fraction of the mean PV.

The key assumption of SITAR is that applying each individual’s three transformations to the mean curve makes it a close match to the individual’s own curve(Reference Cole, Donaldson and Ben-Shlomo20). Equivalently, applying the inverse transformations to individual curves (i.e. with reversed sign) causes them to match the mean curve, so all the curves are superimposed. Size, timing and intensity are also estimated as fixed effects, so the random effects have a mean of 0. SITAR has been shown to provide an unbiased estimate of APV(Reference Cole, Donaldson and Ben-Shlomo20). The SITAR formula is:

$${y_{it}} = {{\rm{\alpha }}_i} + h\left( {{{{\rm{}}t - {\beta _i}} \over {{\rm{exp}}\left( { - {{\rm{\gamma }}_i}} \right)}}} \right),$$

where y it is the height of subject i at age t, h(t) is a natural cubic spline curve of height v. age and α i, β i and γ i are subject-specific random effects(Reference Cole, Donaldson and Ben-Shlomo20).

To develop the most appropriate models, various transformations of the outcome and age were compared using the Bayesian information criterion. The model for height benefited from a log-age transformation and the models for weight and BMI from a log transformation of the outcome. The BMI and grip strength models fitted better without the timing fixed effect. All models were fitted to girls and boys separately, as the mean curves are known to differ by sex.

In the second stage of analysis, the individual random effects derived from the SITAR models were transformed to internal Z-scores, by sex, to allow for easier comparisons between outcomes with different units of measurement. Linear regression models were used to investigate variation in size, timing and intensity according to SEP group and date of birth in the R programming language and software environment for statistical computing(Reference Simpkin, Sayers and Gilthorpe21). Models were outcome (size, timing, intensity of each measure) and sex specific. The interaction between SEP group and date of birth was added to capture whether SEP inequality increased or narrowed through time. The unit of measurement for date of birth was changed by dividing the decimal dates of birth by 10 (unit changed from year to decade) and the data were centred on the mean of the date of birth distribution. This allowed for meaningful interpretation of effect sizes whereby each decade increase in date of birth is associated with B × Z-score increase in the outcome. The regression estimates were centred at the beginning of full decades within the date of birth range, meaning the years 1960, 1970, 1980 and 1990. These centred values estimate the SEP inequality at the different time points and were used to plot the figures. SEP 1 was assigned as the ‘healthy’ reference group because, compared with the current WHO growth standards, individuals from SEP 1 are close to the WHO mean with an average height of −0·2 WHO Z-scores across all ages (Table 2).

Table 2 Mean WHO* Z-scores and sd at age 5–19 years for height and BMI, prevalence of stunting (height-for-age Z-score ≤ −2) and prevalence of obesity (BMI-for-age Z-score ≥ +2) by socio-economic position (SEP) group in the sample of children and adolescents (n 40 484) aged 3–19 years of Ladino and Maya ancestry born during 1955–1993 in Guatemala (n observations 157 067)

* de Onis et al.(Reference de Onis, Onyango and Borghi46). Weight-for-age Z-scores were not calculated as the WHO standards for weight only include ages up to 10 years.

Results

Summary statistics of the SITAR models show that the fixed effects (size, timing and intensity) explained between 69·0 and 98·3 % of variance in the outcomes, with the model for height being the most accurate (Table 3). Figure 1 summarises the mean height-for-age curve for the full sample and each sex. Correlations between the size, timing and intensity fixed effects were small to modest (0·17–0·44), except for grip strength where the size and intensity correlation coefficient was higher at 0·81 (Table 3).

Table 3 Median age at peak growth velocity and Super-Imposition by Translation and Rotation (SITAR) model summaries, including number of individuals (n) and parameter sd for height, weight, BMI, grip strength fitted on age by gender, in the sample of children and adolescents (n 40 484) aged 3–19 years of Ladino and Maya ancestry born during 1955–1993 in Guatemala (n observations 157 067)

Fig. 1 Super-Imposition by Translation and Rotation (SITAR) average male () and female () height (in centimetres) by age (in years) curve, with age at peak velocity (; first vertical line for females, second vertical line for males) and with raw data () in the background, for children and adolescents (n 40 484) aged 3–19 years of Ladino and Maya ancestry born during 1955–1993 in Guatemala (n observations 157 067)

Height

Size

There was evidence of high inequality in height Z-scores in this population whereby the lowest-SEP males were, on average, −1·8 (95 % CI −1·8, −1·7) sd and the females were −1·6 (95 % CI −1·7, −1·6) sd shorter relative to the reference group (SEP 1) at the centre of the date of birth distribution (in year 1972). Figure 2 shows the regression coefficients of male and female height Z-scores by SEP group and through the date of birth range. There is a narrowing of inequality through time, whereby by 1990 the two lowest-SEP groups have very similar height Z-scores to SEP 3. However, these three groups remain over 1 sd below SEP 1 in both male and female height (Fig. 2). The interaction estimates show formal evidence that the SEP inequality has decreased for both males and females as the SEP groups 4 and 5 show larger secular increases in height than the other groups (Table 4).

Fig. 2 Regression estimates of (a) male and (b) female height size Z-scores (dots) with 95 % CI (whiskers) across socio-economic position (SEP) groups (2–5), with SEP 1 as reference group (horizontal line at 0), by decade of birth centred on 1960 (), 1970 (), 1980 () and 1990 (), for children and adolescents (n 40 484) aged 3–19 years of Ladino and Maya ancestry born during 1955–1993 in Guatemala (n observations 157 067). The plots were created using R packages ggplot2, broom, jtools, dotwhisker and dplyr (see the online supplementary material for references)

Table 4 Socio-economic position (SEP) group and decimal date of birth (DOB, in decades) regressions (regression coefficient B, se and P value) for males and females in height, weight, BMI and grip strength size Z-scores, with SEP 1 as the reference group, in the sample of children and adolescents (n 40 484) aged 3–19 years of Ladino and Maya ancestry born during 1955–1993 in Guatemala (n observations 157 067)

Weight

Size

The inequality between the highest and lowest SEP in weight at the centre of the date of birth distribution was −1·4 (95 % CI −1·4, −1·3) sd for males and −1·0 (95 % CI −1·1, −0·9) sd for females. Figure 3 indicates that there was a narrowing of the inequality through time, and the regression estimates of the SEP and date of birth interactions confirm this (Table 4). As with height, the narrowing inequality is due to faster secular increases in weight for SEP groups 4 and 5.

Fig. 3 Regression estimates of (a) male and (b) female weight size Z-scores (dots) with 95 % CI (whiskers) across socio-economic position (SEP) groups (2–5), with SEP 1 as reference group (horizontal line at 0), by decade of birth centred on 1960 (), 1970 (), 1980 () and 1990 (), for children and adolescents (n 40 484) aged 3–19 years of Ladino and Maya ancestry born during 1955–1993 in Guatemala (n observations 157 067). The plots were created using R packages ggplot2, broom, jtools, dotwhisker and dplyr (see the online supplementary material for references)

BMI

Size

Inequalities in BMI were, on average, small compared with height and weight, the difference between the highest and lowest SEP was −0·5 (95 % CI −0·6, −0·5) sd for males and −0·2 (95 % CI −0·3, −0·1) sd for females. There were significant secular increases in BMI for males of SEP groups 1, 2, 4 and 5, and females of SEP groups 2, 4 and 5 (Table 4, Fig. 4). In SEP 3 males, the BMI trend was negative (Table 4).

Fig. 4 Regression estimates of (a) male and (b) female BMI size Z-scores (dots) with 95 % CI (whiskers) across socio-economic position (SEP) groups (2–5), with SEP 1 as reference group (horizontal line at 0), by decade of birth centred on 1960 (), 1970 (), 1980 () and 1990 (), for children and adolescents (n 40 484) aged 3–19 years of Ladino and Maya ancestry born during 1955–1993 in Guatemala (n observations 157 067). The plots were created using R packages ggplot2, broom, jtools, dotwhisker and dplyr (see the online supplementary material for references)

Grip strength

Size

There was evidence of high inequality in grip strength Z-scores whereby the lowest-SEP males were, on average, −1·44 (95 % CI −1·50, −1·38) sd and the females were −1·3 (95 % CI −1·3, −1·2) sd weaker than the reference group (SEP 1). There was a narrowing of inequality in grip strength through time, particularly for SEP 5 individuals whose grip strength increased, on average, by 0·3 (95 % CI 0·3, 0·4) sd per decade of birth for males and by 0·3 (95 % CI 0·3, 0·4) sd per decade of birth for females (Table 4, Fig. 5). By 1990, SEP groups 3, 4 and 5 had very similar grip strength, albeit still close to 1 sd lesser than the grip of SEP 1 (Fig. 5).

Fig. 5 Regression estimates of (a) male and (b) female grip strength size Z-scores (dots) with 95 % CI (whiskers) across socio-economic position (SEP) groups (2–5), with SEP 1 as reference group (horizontal line at 0), by decade of birth centred on 1960 (), 1970 (), 1980 () and 1990 (), for children and adolescents (n 40 484) aged 3–19 years of Ladino and Maya ancestry born during 1955–1993 in Guatemala (n observations 157 067). The plots were created using R packages ggplot2, broom, jtools, dotwhisker and dplyr (see the online supplementary material for references)

Timing and intensity (age at peak growth velocity and peak growth velocity)

Males in SEP 5 had a 0·2 (95 % CI 0·2, 0·3) sd and females a 0·4 (95 % CI 0·4, 0·5) sd later age at peak height velocity than individuals of SEP 1, while individuals in SEP 2 had earlier height APV than SEP 1 (see online supplementary material, Supplemental Table S1 and Supplemental Fig. S1). APV for both males and females of SEP groups 3–5 seemed to converge, whereby APV increased for SEP 3 and decreased for SEP 4 and 5 through time (Supplemental Table S1, Supplemental Fig. S1). PV showed larger SEP differences than APV, each decrease in SEP group resulted in a decrease in PV of 0·2–0·4 sd in males and 0·2–0·4 sd in females (Supplemental Table S2, Supplemental Figs S2 and S3). Secular increases in height PV were observed for SEP groups 2–5 (Supplemental Table S2, Supplemental Figs S2 and S3).

In weight, there were larger inequalities in APV than for height. The APV for SEP 5 was 0·9 (95 % CI 0·8, 0·9) sd delayed compared with SEP 1 males and 0·9 (95 % CI 0·8, 1·0) sd delayed for SEP 5 females compared with SEP 1 females (see online supplementary material, Supplemental Table S1 and Supplemental Fig. S1). As with height, individuals in SEP 2 had earlier weight APV than individuals from SEP 1 (Supplemental Table S1). Weight PV showed smaller inequalities than height PV (Supplemental Table S2, Supplemental Figs S2 and S3). Secular increases in peak weight velocity were observed for SEP groups 1, 2, 4 and 5 (Supplemental Table S2, Supplemental Figs S2 and S3).

The PV of BMI gain was highest in both males and females of SEP 2, and for females, all SEP groups had a higher PV in BMI than the reference group (see online supplementary material, Supplemental Table S2 and Supplemental Figs S2 and S3). There were significant secular increases in BMI PV for females of SEP 2 and 4, and for males of SEP 2, 4 and 5 (Supplemental Table S2, Supplemental Figs S2 and S3).

Grip intensity showed very similar patterns to grip size, whereby the initially large inequalities in grip PV decreased through time for both males and females (see online supplementary material, Supplemental Table S2 and Supplemental Figs S2 and S3).

Discussion

Using data on over 40 000 children, the present study found that considerable differences in height, weight and grip strength remain between the richest and the poorest in Guatemala, despite general decreases in inequality.

Overall, our findings are supportive of previous work on within-population SEP differences in growth that found patterns of secular changes differ across SEP group(Reference Bann, Johnson and Li8). However, the scale of the reported SEP differences in the present sample is considerably larger, and to our knowledge, we are the first to report SEP differences for timing and intensity of growth for weight, BMI and grip strength. In height the lowest-SEP individuals were 2 sd below the highest in year 1960, and the comparison with the WHO mean Z-scores by SEP group confirmed that, overall, this group was stunted by conventional height-for-age Z-score cut-offs. As previously stated, the high-SEP reference group of our study differs by only 0·2 Z-scores from international references in mean height and can be thus considered healthy or ‘normal’ height. Still, recent reports show that even among the highest 20 % of the Guatemalan income distribution, stunting rates of 17 % have been reported, highlighting the pernicious effects of the environment for growth in Guatemala across SEP groups(12).

The lowest two SEP groups showed an overall increase in body size, likely reflecting a raised standard of living and more favourable early-life environments. The secular changes coincided with the internal conflict in Guatemala which started in the 1950s, became a civil war in 1960 and continued, with varying intensity, until the signing of the peace accords in 1996. While the effects of the conflict were devastating to a large part of the civilian population in the rural countryside, particularly the Maya, reports suggest Guatemala City was better buffered(Reference Tomuschat, Lux De Coti and Balsells Tojo10). The two Maya schools were located in a village 25 km from Guatemala City and this proximity may have buffered the village as well. Between 1960 and 1985, American and European international corporations established offices in the City and the period included steady economic growth(22). This overall economic growth may have supported the physical growth of the lower SEP, despite the ongoing conflict. From 1974 to 1990 the country experienced the most severe consequences of the civil war resulting in an economic recession and the government becoming bankrupt by 1990. Previous work with smaller samples sizes found that 10–11-year-olds of SEP groups 1, 2 and 3 born between 1974 and 1985 experienced a negative effect on height(23). We did not find evidence for this, except for SEP 1 females who showed an overall negative secular trend in height. Why this trend existed only for this group is unknown and overall our results suggest secular increases in height.

The Cold War US investment in Guatemala included fast-food and supermarket chains. The urban population’s access to ‘Western’ nutrition was increased, although the prices of many imported food items remain high even today. The Happy Meal, McDonald’s famous children’s meal, was invented in Guatemala in the mid-1970s before being launched worldwide(Reference Bogin and Keep24). The secular trends we observed in the anthropometric outcomes of the SEP 2 individuals (upper-middle economic class) fit well with these changes to the food environment, as this group is likely to have been able to afford the newly available, energy-rich diets. The SEP group 1 (highest economic class) showed a very modest secular increase in male weight and a small negative trend in female weight, perhaps suggesting that the change in the nutritional landscape and access to energy-dense foods did not change their lifestyle significantly. For BMI, SEP 1 had the smallest secular increases of all the groups. There is evidence in the literature of high-SEP individuals from the USA and France having lower rates of obesity compared with lower-SEP groups(25), possibly relating to social desirability of non-overweight body shape and better awareness among high-SEP individuals of healthy behaviours due to higher educational attainment. In the SEP groups 4 and 5 there were secular increases in BMI for both males and females; however, they remained, on average, with lower BMI than that of their counterparts in SEP 1 and 2 at the end of the studied period. In SEP 3 there was a secular decrease in male BMI and no change for females. The reason for this is unclear but due to the ‘middle SEP’ nature of the two schools included in this category, it is possible that the socio-economic composition of the students in this group changed through time. If so, this could explain why there was very little evidence of secular trend in any parameter for this SEP group.

To try to investigate physical function in the sample, we looked at the longitudinal grip strength measure. No previous work, to our knowledge, has modelled childhood grip strength data in such a large sample, and there are no grip strength references based on longitudinal data for under 18-year-olds. The inequality in grip strength was similar to that in height, implying that height differences between SEP groups are reflected in the characteristics measured by grip strength: lean mass, especially muscle mass, and overall body strength. The analysis found that taller children are, on average, stronger. An international comparison of grip strength and BMI data concluded that both overweight and obesity, as well as chronic undernourishment, are associated with lower grip strength(Reference Drewnowski, Moudon and Jiao26). In the present study, individuals from SEP groups 4 and 5 increased their grip strength through time, which supports a positive association between height, weight and grip strength, and by implication lean mass. Indigenous school youths aged 6–17 years in Oaxaca, southern Mexico, were surveyed in 1968, 1978 and 2000, and showed small and generally non-significant increases in grip strength. The small secular gains in muscular strength were generally proportional to secular gains in body weight and height(Reference Massy-Westropp, Gill and Taylor27). For the UVG Study, SEP groups 1, 2 and 3 showed no secular increase in grip strength, despite increases in height and weight for SEP 2. The lack of association might reflect a change towards a more sedentary lifestyle, a phenomenon which has been globally well recorded in recent decades(Reference Malina, Reyes and Tan28). Similar lack of secular increase in adolescent grip strength has been found in Canada and the USA, despite increasing adolescent body weights(Reference Popkin, Adair and Ng29). In adults, there has been a reported secular decrease in grip strength(Reference Silverman30). In light of these other studies, we interpret the findings of our analysis for grip strength to indicate that for SEP groups 4 and 5, the increase in body weight and BMI with time was due more to the accrual of lean mass (muscle, bone, organs) than to fat mass.

At the end of the studied period, the lowest three SEP groups remained approximately 1 sd below the highest in height, weight and grip strength, signalling that even in the presence of secular increases, large inequalities persist. It is not feasible to pinpoint the exact reason for this, but these findings are likely related to the continuing disparities in Guatemala in access to health care, education and employment(Reference Silverman31). The lower-SEP groups also face insecurities in virtually all aspects of daily life (food, water, electricity, government services, high crime) due to poverty. Guatemala has the highest rate of poverty in all Latin America(Reference Cabrera, Lustig and Morán32). The public health-care and educational systems are severely underfunded, and the country has experienced a continuous procession of corruption scandals including government officials involved in organised crime networks. Until these underlying structural inequalities are addressed, it is possible that the health and growth discrepancies will remain high.

Investigation of timing (APV) and intensity (PV) of growth revealed further inequalities, whereby the richer individuals had both earlier maturity in height and weight, and a higher peak growth velocity. Peak weight gain followed peak height gain in females but not males. It is unclear which environmental conditions could result in shifts in growth timing and intensity, and whether growth faltering could be prevented by interventions targeted at the ‘speed’ or timing of growth. Evidence does suggest both timing and intensity of growth are to some extent influenced by intra-uterine growth, hormone balance (particularly insulin-like growth factor-I), nutritional status including calcium intake, and obesity status(Reference Cabrera, Lustig and Morán32Reference Ward, Cole and Laskey36). Early puberty is associated with increased risk of later-life cardiovascular mortality, hypertension, metabolic syndrome and mental health problems(Reference Wehkalampi, Silventoinen and Kaprio37Reference Prentice and Viner39). Late puberty is commonly thought to reflect poor early-life growth environment and is associated with poorer bone health in early old age(Reference Wehkalampi, Silventoinen and Kaprio37,Reference Viner, Ross and Hardy40,Reference Cole and Mori41) . This raises the question whether there is an ‘ideal’ APV and PV in terms of risk for later-life health and disease outcomes. The presence of socio-economic inequalities and secular shifts in these variables suggests a potentially significant environmental effect. In height, inequalities were primarily reflected in lower peak velocity for low-SEP individuals and less so in differences in pubertal timing (i.e. the more disadvantaged children grew more slowly), whereas for weight, the inequalities manifested more in an older age at peak weight gain for SEP groups 4 and 5. In female BMI, all SEP groups had a higher intensity of growth throughout the studied period than the reference group. As discussed above, this may reflect social discrepancies in weight desirability and body image v. the socio-economic and health-based height inequalities. Trends towards increasing weight-for-height in SEP group 2 in particular could in the future result in negative health outcomes from metabolic syndrome and its related diseases, including diabetes and CVD, for those individuals whose BMI is in the overweight or obese range(Reference Kuh, Muthuri and Moore42).

Our study had several strengths, including the UVG’s data set of Guatemalan anthropometry and the SITAR method of analysis that incorporates information on size, timing and intensity of growth. The data, collected over four decades, span nearly the entire SEP range of Guatemala and represent individuals of both Ladino and Maya ethnicity. A limitation of the present study is that as the data collection extended only until 1999, we are unable to describe more recent changes in growth or other outcomes. Further, our study cannot disentangle a possible ethnicity-linked influence in growth measures for SEP 5 which comprises predominantly Maya children, who are known to be shorter than Ladinos(12). Differences of growth measures between SEP 5 and SEP 1–4 are due to a wide range of factors associated with school attended and ethnicity. We cannot disentangle the two because there are very few Maya in SEP 1–4, or Ladinos in SEP 5. Over the last 500 years, the Maya have been both socially and politically repressed, and continue to have a higher incidence of poverty compared with the Ladino population(Reference Silverman31,43Reference Lovell45) . We doubt that genetics plays a role in the short stature of the Maya because we know that Maya 5–12-year-olds growing up in the USA are, on average, 11 cm taller than the Maya of the same ages living in Guatemala(Reference Bogin, Smith and Orden19). Finally, we did not include estimates of body fat in the analyses. A child with high BMI-for-age may be ‘fat’, muscular, or an early maturer compared with the population mean used to create the reference. We did, however, infer changes in fatness and lean mass via the data for height, weight and grip strength. Our data encompassed only urban and semi-urban Guatemalans, which means that inequalities in the growth patterns of the rural population could not be assessed. The semi-urban Maya sample may include segments of the more rural population who migrated to live closer to Guatemala City over the course of the civil war.

Conclusions

There has been a narrowing of disparity in physical growth between socio-economic status groups in Guatemala, but stark inequality remains. This is likely to result in poorer population health and productivity, as particularly low adult height has been connected to lower human capital. The later-life health implications of the increasingly fast pubertal BMI gains across the SEP groups remain to be investigated. While current follow-up studies in Guatemala focus only on rural, low-SEP Ladinos, most individuals in our samples of Maya and higher-SES Ladinos can be expected to be alive and currently aged 25–76 years old. This could facilitate future longitudinal follow-ups, for example looking at life-course disease risk factors, on urban and Maya samples, ranging from very high to very low SEP, whose childhood growth patterns are now well defined.

Acknowledgements

Acknowledgements: The authors thank Rosa Amalia Camacho de Paz for coordination and data collection for the original UVG Longitudinal Study of Child and Adolescent Development and for her assistance with recent reacquisition of data from 1953 to 1970. They thank colleagues at the Centro de Investigaciones Educativas (UVG) who provided invaluable help during follow-up data collection, particularly Anaite Cifuentes, Ana Aide Cruz, Monci Valladares, Jamey Burho, Victor Rosales, Jose Aceituno (deceased) and Alejandra Hernandez. The authors dedicate this article to the memory of Dr Robert B. MacVean (1917–2012), who initiated the UVG Longitudinal Study in 1953. Financial support: The Osk Huttunen Foundation supported L.M.; the Bill & Melinda Gates Foundation (Quantifying healthy birth, growth and development knowledge integration, grant number OPP1125811) and the UVG supported database creation; and the UK Medical Research Council (MRC) supported T.J.C. (grant number MR/R010692/1). W.J. is supported by an MRC New Investigator Research Grant (grant number MR/P023347/1) and acknowledges support from the National Institute for Health Research (NIHR) Leicester Biomedical Research Centre, which is a partnership between University Hospitals of Leicester NHS Trust, Loughborough University and the University of Leicester. The funders had no role in the design, analysis or writing of this article. The corresponding author had access to all the data and had final responsibility for the decision to submit for publication. Conflict of interest: The authors declare no competing interests. Authorship: L.M., W.J. and B.B. conceptualised this paper. L.M. and T.J.C. analysed the data. L.M. wrote the first draft. B.B., K.B.-W. and W.J. contributed to the interpretation of the results and the literature review. L.F. and A.J.G.-S. assisted with acquisition of data and revised the manuscript for important intellectual content. All authors approved the final version. Ethics of human subject participation: This study was conducted according to the guidelines laid down in the Declaration of Helsinki and the analysis of the existing data was approved by the Loughborough University Ethics Approvals (Human Participants) Sub-Committee and UVG Social Sciences Ethics Committee.

Supplementary material

To view supplementary material for this article, please visit https://doi.org/10.1017/S1368980019003239

Footnotes

Current affiliation: Centre for Global Child Health, The Hospital for Sick Children, 686 Bay Street, Toronto, Canada, M5G 0A4.

References

Kuh, D, Richards, M, Cooper, Ret al. (2014) Life course epidemiology, ageing research, and maturing cohort studies: a dynamic combination for understanding healthy ageing. In A Life Course Approach to Healthy Ageing, pp. 315 [Kuh, D, Cooper, R, Hardy, Ret al., editors]. Oxford: Oxford University Press.Google ScholarPubMed
NCD Risk Factor Collaboration (2016) A century of trends in adult human height. Elife 5, e13410.CrossRefGoogle Scholar
Victora, CG, Adair, L, Fall, Cet al. (2008) Maternal and child undernutrition: consequences for adult health and human capital. Lancet 371, 340357.CrossRefGoogle ScholarPubMed
United Nations (2018) Sustainable Development Knowledge Platform. Sustainable Development Goals. https://sustainabledevelopment.un.org/sdgs (accessed October 2018).Google Scholar
Bogin, B (1999) Patterns of Human Growth. Cambridge: Cambridge University Press.Google ScholarPubMed
Vollmer, S, Harttgen, K, Subramanyam, MAet al. (2014) Association between economic growth and early childhood undernutrition: evidence from 121 Demographic and Health Surveys from 36 low-income and middle-income countries. Lancet Glob Health 2, e225e234.CrossRefGoogle ScholarPubMed
Tanner, J (1989) Foetus into Man: Physical Growth from Conception to Maturity. Brickendonbury: Castlemead Publications.Google Scholar
Bann, D, Johnson, W, Li, Let al. (2018) Socioeconomic inequalities in childhood and adolescent body-mass index, weight, and height from 1953 to 2015: an analysis of four longitudinal, observational, British birth cohort studies. Lancet Public Health 3, e194e203.CrossRefGoogle ScholarPubMed
Marini, A & Gragnolati, M (2003) Malnutrition and Poverty in Guatemala. Washington, DC: World Bank.CrossRefGoogle Scholar
Tomuschat, C, Lux De Coti, O & Balsells Tojo, A (1999) Guatemala: Memory of Silence. Report of the Commission for Historical Clarification Conclusions and Recommendations. https://hrdag.org/wp-content/uploads/2013/01/CEHreport-english.pdf (accessed November 2018).Google Scholar
Martinez, B, Webb, MF, Gonzalez, Aet al. (2018) Complementary feeding intervention on stunted Guatemalan children: a randomised controlled trial. BMJ Paediatr 2, e000213.CrossRefGoogle ScholarPubMed
Ministerio de Salud Pública y Asistencia Social, Instituto Nacional de Estadística, Secretaría de Planificación y Programación de la Presidencia et al. (2017) Encuesta Nacional de Salud Materno Infantil 2014–2015: Informe Final. Guatemala City: MSPAS/INE/Segeplán/ICF International.Google Scholar
Martorell, R, Habicht, J-P & Rivera, JA (1995) History and design of the INCAP longitudinal study (1969–77) and its follow-up (1988–89). J Nutr 125, 10271041.Google Scholar
Bogin, B, Camacho de Paz, R & MacVean, RB (2018) The Universidad del Valle de Guatemala Longitudinal Study of Child and Adolescent Development: History, Description, and Research Prospectus. Guatemala City: Universidad del Valle de Guatemala.Google Scholar
Bogin, B & MacVean, RB (1983) The relationship of socioeconomic status and sex to body size, skeletal maturation, and cognitive status of Guatemala City schoolchildren. Child Dev 54, 115128.CrossRefGoogle ScholarPubMed
Hoddinott, J, Maluccio, JA, Behrman, JRet al. (2008) Effect of a nutrition intervention during early childhood on economic productivity in Guatemalan adults. Lancet 371, 411416.CrossRefGoogle ScholarPubMed
Maluccio, J, Hoddinott, J, Behrman, Jet al. (2006) The Impact of Nutrition During Early Childhood on Education among Guatemalan Adults. PSC Working Paper Series no. 06-04. Philadelphia, PA: Population Studies Center, University of Pennsylvania.Google Scholar
Bogin, B & MacVean, RB (1978) Growth in height and weight of urban Guatemalan primary school children of low and high socioeconomic class. Hum Biol 50, 477487.Google ScholarPubMed
Bogin, B, Smith, P, Orden, ABet al. (2002) Rapid change in height and body proportions of Maya American children. Am J Hum Biol 14, 753761.CrossRefGoogle ScholarPubMed
Cole, TJ, Donaldson, MDC & Ben-Shlomo, Y (2010) SITAR – a useful instrument for growth curve analysis. Int J Epidemiol 39, 15581566.CrossRefGoogle Scholar
Simpkin, AJ, Sayers, A, Gilthorpe, MSet al. (2017) Modelling height in adolescence: a comparison of methods for estimating the age at peak height velocity. Ann Hum Biol 44, 715722.CrossRefGoogle ScholarPubMed
R Core Team (2018) R: A Language and Environment for Statistical Computing. Vienna: R Foundation for Statistical Computing; available at http://www.r-project.org/ (accessed November 2018).Google Scholar
Trading Economics (2018) Guatemala GDP 1960–2018. https://tradingeconomics.com/guatemala/gdp (accessed October 2018).Google Scholar
Bogin, B & Keep, R (1999) Eight thousand years of economic and political history in Latin America revealed by anthropometry. Ann Hum Biol 26, 333351.Google ScholarPubMed
El Periodico (2006) La señora del Mac menú. https://web.archive.org/web/20140203041617/http://www.elperiodico.com.gt/es/20060801/14/30397/ (accessed November 2018).Google Scholar
Drewnowski, A, Moudon, AV, Jiao, Jet al. (2014) Food environment and socioeconomic status influence obesity rates in Seattle and in Paris. Int J Obes (Lond) 38, 306314.CrossRefGoogle ScholarPubMed
Massy-Westropp, NM, Gill, TK, Taylor, AWet al. (2011) Hand grip strength: age and gender stratified normative data in a population-based study. BMC Res Notes 4, 127.CrossRefGoogle ScholarPubMed
Malina, RM, Reyes, MEP, Tan, SKet al. (2010) Secular change in muscular strength of indigenous rural youth 6–17 years in Oaxaca, southern Mexico: 1968–2000. Ann Hum Biol 37, 168184.Google ScholarPubMed
Popkin, BM, Adair, LS & Ng, SW (2012) Global nutrition transition and the pandemic of obesity in developing countries. Nutr Rev 70, 321.CrossRefGoogle ScholarPubMed
Silverman, IW (2011) The secular trend for grip strength in Canada and the United States. J Sports Sci 29, 599606.CrossRefGoogle ScholarPubMed
Silverman, IW (2015) Age as a moderator of the secular trend for grip strength in Canada and the United States. Ann Hum Biol 42, 199209.CrossRefGoogle ScholarPubMed
Cabrera, M, Lustig, N & Morán, HE (2015) Fiscal policy, inequality, and the ethnic divide in Guatemala. World Dev 76, 263279.CrossRefGoogle Scholar
Cole, TJ, Ahmed, ML, Preece, MAet al. (2015) The relationship between Insulin-like growth factor 1, sex steroids and timing of the pubertal growth spurt. Clin Endocrinol (Oxf) 82, 862869.CrossRefGoogle ScholarPubMed
De Leonibus, C, Marcovecchio, ML, Chiavaroli, Vet al. (2014) Timing of puberty and physical growth in obese children: a longitudinal study in boys and girls. Pediatr Obes 9, 292299.CrossRefGoogle ScholarPubMed
Karaolis-Danckert, N, Buyken, AE, Sonntag, Aet al. (2009) Birth and early life influences on the timing of puberty onset: results from the DONALD (DOrtmund Nutritional and Anthropometric Longitudinally Designed) study. Am J Clin Nutr 90, 15591565.CrossRefGoogle ScholarPubMed
Ward, KA, Cole, TJ, Laskey, MAet al. (2014) The effect of prepubertal calcium carbonate supplementation on skeletal development in Gambian boys – a 12-year follow-up study. J Clin Endocrinol Metab 99, 31693176.Google Scholar
Wehkalampi, K, Silventoinen, K, Kaprio, Jet al. (2008) Genetic and environmental influences on pubertal timing assessed by height growth. Am J Hum Biol 20, 417423.CrossRefGoogle ScholarPubMed
Patton, GC & Viner, R (2007) Pubertal transitions in health. Lancet 369, 11301139.CrossRefGoogle ScholarPubMed
Prentice, P & Viner, RM (2013) Pubertal timing and adult obesity and cardiometabolic risk in women and men: a systematic review and meta-analysis. Int J Obes (Lond) 37, 10361043.CrossRefGoogle ScholarPubMed
Viner, R, Ross, D, Hardy, Ret al. (2015) Life course epidemiology: recognising the importance of adolescence. J Epidemiol Community Health 69, 719720.CrossRefGoogle ScholarPubMed
Cole, TJ & Mori, H (2018) Fifty years of child height and weight in Japan and South Korea: contrasting secular trend patterns analyzed by SITAR. Am J Hum Biol 30, e23054.CrossRefGoogle ScholarPubMed
Kuh, D, Muthuri, SG, Moore, Aet al. (2016) Pubertal timing and bone phenotype in early old age: findings from a British birth cohort study. Int J Epidemiol 45, 11131124.Google ScholarPubMed
World Health Organization (2018) Obesity and overweight. https://www.who.int/news-room/fact-sheets/detail/obesity-and-overweight (accessed September 2018).Google Scholar
Lovell, WG & Lutz, CH (1996) ‘A dark obverse’: Maya survival in Guatemala: 1520–1994. Am Geogr Soc 86, 398407.Google Scholar
Lovell, WG (2010) A Beauty That Hurts: Life and Death in Guatemala, pp. 105120. Austin, TX: University of Texas Press.Google Scholar
de Onis, M, Onyango, A, Borghi, Eet al. (2007) Development of a WHO growth reference for school-aged children and adolescents. Bull World Health Organ 85, 661666.CrossRefGoogle ScholarPubMed
Figure 0

Table 1 Summary statistics: numbers of individuals (n) with mean and sd for age and anthropometric outcomes, for the sample of children and adolescents (n 40 484) aged 3–19 years of Ladino and Maya ancestry born during 1955–1993 in Guatemala (nobservations 157 067)

Figure 1

Table 2 Mean WHO* Z-scores and sd at age 5–19 years for height and BMI, prevalence of stunting (height-for-age Z-score ≤ −2) and prevalence of obesity (BMI-for-age Z-score ≥ +2) by socio-economic position (SEP) group in the sample of children and adolescents (n 40 484) aged 3–19 years of Ladino and Maya ancestry born during 1955–1993 in Guatemala (nobservations 157 067)

Figure 2

Table 3 Median age at peak growth velocity and Super-Imposition by Translation and Rotation (SITAR) model summaries, including number of individuals (n) and parameter sd for height, weight, BMI, grip strength fitted on age by gender, in the sample of children and adolescents (n 40 484) aged 3–19 years of Ladino and Maya ancestry born during 1955–1993 in Guatemala (nobservations 157 067)

Figure 3

Fig. 1 Super-Imposition by Translation and Rotation (SITAR) average male () and female () height (in centimetres) by age (in years) curve, with age at peak velocity (; first vertical line for females, second vertical line for males) and with raw data () in the background, for children and adolescents (n 40 484) aged 3–19 years of Ladino and Maya ancestry born during 1955–1993 in Guatemala (nobservations 157 067)

Figure 4

Fig. 2 Regression estimates of (a) male and (b) female height size Z-scores (dots) with 95 % CI (whiskers) across socio-economic position (SEP) groups (2–5), with SEP 1 as reference group (horizontal line at 0), by decade of birth centred on 1960 (), 1970 (), 1980 () and 1990 (), for children and adolescents (n 40 484) aged 3–19 years of Ladino and Maya ancestry born during 1955–1993 in Guatemala (nobservations 157 067). The plots were created using R packages ggplot2, broom, jtools, dotwhisker and dplyr (see the online supplementary material for references)

Figure 5

Table 4 Socio-economic position (SEP) group and decimal date of birth (DOB, in decades) regressions (regression coefficient B, se and P value) for males and females in height, weight, BMI and grip strength size Z-scores, with SEP 1 as the reference group, in the sample of children and adolescents (n 40 484) aged 3–19 years of Ladino and Maya ancestry born during 1955–1993 in Guatemala (nobservations 157 067)

Figure 6

Fig. 3 Regression estimates of (a) male and (b) female weight size Z-scores (dots) with 95 % CI (whiskers) across socio-economic position (SEP) groups (2–5), with SEP 1 as reference group (horizontal line at 0), by decade of birth centred on 1960 (), 1970 (), 1980 () and 1990 (), for children and adolescents (n 40 484) aged 3–19 years of Ladino and Maya ancestry born during 1955–1993 in Guatemala (nobservations 157 067). The plots were created using R packages ggplot2, broom, jtools, dotwhisker and dplyr (see the online supplementary material for references)

Figure 7

Fig. 4 Regression estimates of (a) male and (b) female BMI size Z-scores (dots) with 95 % CI (whiskers) across socio-economic position (SEP) groups (2–5), with SEP 1 as reference group (horizontal line at 0), by decade of birth centred on 1960 (), 1970 (), 1980 () and 1990 (), for children and adolescents (n 40 484) aged 3–19 years of Ladino and Maya ancestry born during 1955–1993 in Guatemala (nobservations 157 067). The plots were created using R packages ggplot2, broom, jtools, dotwhisker and dplyr (see the online supplementary material for references)

Figure 8

Fig. 5 Regression estimates of (a) male and (b) female grip strength size Z-scores (dots) with 95 % CI (whiskers) across socio-economic position (SEP) groups (2–5), with SEP 1 as reference group (horizontal line at 0), by decade of birth centred on 1960 (), 1970 (), 1980 () and 1990 (), for children and adolescents (n 40 484) aged 3–19 years of Ladino and Maya ancestry born during 1955–1993 in Guatemala (nobservations 157 067). The plots were created using R packages ggplot2, broom, jtools, dotwhisker and dplyr (see the online supplementary material for references)

Supplementary material: File

Mansukoski et al. supplementary material

Mansukoski et al. supplementary material

Download Mansukoski et al. supplementary material(File)
File 30.9 KB