The prevalence and severity of childhood overweight have increased significantly in the past three decades(Reference Ogden, Carroll and Curtin1–Reference Wang and Lobstein3). Negative sequalae from being overweight during childhood include being at a higher risk for a number of chronic and acute conditions(Reference Lobstein, Baur and Jackson-Leach4) as well as negative social and psychological outcomes(Reference Lee5). The source for the majority of childhood obesity cases can be attributed to energy imbalance which has been linked to changes in the food and physical activity (PA) environments(Reference Dehghan, Akhtar-Danesh and Merchant6, Reference Spiegelman and Flier7).
The home environment has been documented as one that can either facilitate or inhibit healthful eating and PA, and caregivers play a key role in the development of the social and physical environment within a household(Reference Golan and Weizman8, Reference Rosenkranz and Dzewaltowski9). From a social environment perspective, caregivers serve as role models for PA, dietary and media behaviours and influence the child's health behaviours and weight status through parenting strategies and feeding styles(Reference Pugliese and Tinsley10–Reference Haerens, Craeynest and Deforche21). In addition, a child participates in more PA when a greater amount of space and active toys are available in the home(Reference Fees, Trost and Bopp22, Reference Spurrier, Magarey and Golley23). Likewise, access to food items can impact consumption(Reference Blanchette and Brug24, Reference Kratt, Reynolds and Shewchuk25). Similarly, when more screen opportunities are available, children are more likely to engage in sedentary behaviour(Reference Saelins, Sallis and Nader26, Reference Salmon, Timperio and Telford27).
Some researchers have conducted reviews of the home food environment(Reference French, Shimotsu and Wall28, Reference Bryant and Stevens29), while others have described measures of the community food environment(Reference McKinnon, Reedy and Morrissette30). There have also been a number of literature reviews on interventions targeting families to improve PA, diet and weight status in children(Reference Berry, Sheehan and Heschel31–Reference Young, Fors and Fasha36). In each case there has been a consistent call for assessing relevant home environment variables with validated measures. To develop an accurate assessment of the influence of the home environment it is important to have strong conceptual models and appropriate validation methodology(Reference Hand37). Several groups of researchers have worked independently over the past few decades developing measures of caregiver influence on childhood obesity that are pertinent to specific programmes of research. As a result there is a wide variety of measures available that range in scope (i.e. constructs assessed). The disadvantage of having multiple measures of the home environment is the limited ability to compare results across studies. Owing to the proliferation of measures of different components of the home environment there is a need to provide clarity on which tools are available and the degree to which these can validly and reliably provide a comprehensive assessment of the home environment. Therefore, the purpose of the present systematic review is to examine the scope, reliability and validity of measurement tools of the home environment as it relates to childhood obesity.
Design
Evidence acquisition
Manuscripts published between 1990 and 2010 were searched for in the following databases: MEDLINE, PYSCLIT, CINAHL, ERIC and PsychINFO. The inclusive dates were selected since no review on measurement of the home environment has been conducted previously (only reviews of correlates and interventions) and we wanted to include the full spectrum of research in this area. Measurement work in this area conducted prior to 1990 is very limited, and measures from that time have generally been incorporated into existing literature. Citations of the articles resulting from the searches were also scanned for inclusion. Once relevant manuscripts validating measures were identified, further measurement articles were searched for using the title of the measure as a search term. Relevant studies were considered if the manuscript reported on a measure of the home environment related to children's diet, PA and weight status while also reporting at least one indicator of reliability or validity.
Measures were included if they were used in families with children between birth and 18 years of age, if they were completed by a child or an adult, and, for the latter, only if the adult measure was in reference to the home environment. The format could be paper-and-pencil, telephone/in-person interview, or completed by the researcher through direct observation.
Key terms utilized in the search included those defined by a Conceptual Model for Eating and Physical Activity Environment(Reference Gattshall, Shoup and Marshall38): food physical environment, the food social environment, PA physical environment, PA social environment, media physical environment and media social environment, as well as terms related to psychometric properties. In each case (i.e. food, PA, media), the physical environment included availability and accessibility and the social environment included caregiver role modelling and policies (Fig. 1).
Exclusion criteria were: (i) unpublished literature reviews; (ii) manuscripts utilizing only a qualitative methodology; (iii) those not specific to children; and (iv) those in language other than English. Further, articles were also excluded if they (v) did not report on at least one of the following psychometric properties: test–retest reliability, inter-rater reliability, internal consistency, criteria validity, convergent validity, divergent validity, predictive validity or factorial validity. Two authors reviewed each manuscript and coded for home environment constructs and psychometric testing in order to meet criteria for inclusion.
Results
Overall, the combined search strategies identified 2606 unique manuscripts. After reviewing the abstracts of these studies, 2463 were eliminated; another 109 were eliminated upon reading the full manuscript. The main reason for excluding articles was that the study did not report on any psychometric properties of the measure (see Table 1 for a summary of psychometrics). An additional six manuscripts were added from screening reference lists, yielding a total of forty manuscripts included in the present review. Of these forty manuscripts overlapping constructs assessed included: 48 % (n 19) some aspect of the food social environment(Reference Campbell, Crawford and Salmon18, Reference Spurrier, Magarey and Golley23, Reference Young, Fors and Fasha36, Reference Gattshall, Shoup and Marshall38, Reference De Bourdeaudhuij, Klepp and Due43, Reference Cullen, Baranowski and Rittenberry45, Reference van Assema, Glanz and Martens47, Reference Golan and Weizman54–Reference Wilson and Magarey65); 50 % (n 20) food physical environment(Reference Campbell, Crawford and Salmon18, Reference Young, Fors and Fasha36, Reference Gattshall, Shoup and Marshall38–Reference van Assema, Glanz and Martens47, Reference Golan and Weizman54, Reference Evans, Dave and Tanner55, Reference Cullen, Baranowski and Rittenberry57, Reference Campbell, Crawford and Ball59, Reference Neumark-Sztainer, Wall and Perry61–Reference Bryant, Ward and Hales63, Reference Wilson and Magarey65); 18 % (n 7) PA physical environment(Reference Spurrier, Magarey and Golley23, Reference Gattshall, Shoup and Marshall38, Reference Hume, Ball and Salmon48, Reference Sirard, Nelson and Pereira49, Reference Rosenberg, Sallis and Kerr51, Reference Timperio, Salmon and Ball52, Reference Bryant, Ward and Hales63); 20 % (n 8) media physical environment(Reference Spurrier, Magarey and Golley23, Reference Salmon, Timperio and Telford27, Reference Gattshall, Shoup and Marshall38, Reference Sirard, Nelson and Pereira49, Reference Rosenberg, Sallis and Kerr51–Reference van Zutphen, Bell and Kremer53, Reference Bryant, Ward and Hales63); 30 % (n 12) food social environment(Reference Gattshall, Shoup and Marshall38, Reference Cullen, Baranowski and Rittenberry57, Reference Larios, Ayala and Arredondo60, Reference Bryant, Ward and Hales63, Reference Birch, Fisher and Grimm-Thomas66, Reference Robinson, Kiernan and Matheson67–Reference Hughes, Power and Orlet Fisher70, Reference Joyce and Zimmer-Gembeck72–Reference Kroller and Warschburger74); 23 % (n 9)(Reference Spurrier, Magarey and Golley23, Reference Gattshall, Shoup and Marshall38, Reference Hume, Ball and Salmon48, Reference Timperio, Salmon and Ball52, Reference Golan and Weizman54, Reference Pearson, Timperio and Salmon56, Reference Larios, Ayala and Arredondo60, Reference Bryant, Ward and Hales63, Reference Ihmels, Welk and Eisenmann64) parenting related to PA; and 20 % (n 8) PA and media social environment(Reference Spurrier, Magarey and Golley23, Reference Salmon, Timperio and Telford27, Reference Gattshall, Shoup and Marshall38, Reference Timperio, Salmon and Ball52, Reference van Zutphen, Bell and Kremer53, Reference Larios, Ayala and Arredondo60, Reference Bryant, Ward and Hales63, Reference Ihmels, Welk and Eisenmann64).
FV, fruit and vegetable; availability and accessibility = physical environments; parental policies/rules, role modelling = social environments; FJV, fruit, juice and vegetable; PA, physical activity; TV, television; SES, socio-economic status; ICC, intra-class correlation coefficient; CFQ, Child Feeding Questionnaire; PFDQ, Parent Feeding Dimensions Questionnaire; FEAHQ, Family Eating and Activity Habits Questionnaire; PEAS, Parenting Strategies for Eating and Activity Scale.
Psychometric properties across measures
Within each manuscript, internal consistency was the most commonly reported indicator of reliability (70 %) followed by test–retest reliability (38 %) and inter-rater reliability (8 %). Only 5 % reported on all three reliability indicators. Predictive and factorial validity were reported for 58 % and 25 % of the measures, respectively. However, convergent (8 %) and criteria (10 %) validity were rarely reported and no study provided all indicators of validity (Table 1).
Food availability and accessibility
Several researchers have developed measures of the availability and accessibility of healthy and less healthy foods in the home with most emphasis placed on fruits and vegetables(Reference Campbell, Crawford and Salmon18, Reference Young, Fors and Fasha36, Reference Gattshall, Shoup and Marshall38–Reference van Assema, Glanz and Martens47, Reference Golan and Weizman54, Reference Evans, Dave and Tanner55, Reference Cullen, Baranowski and Rittenberry57, Reference Campbell, Crawford and Ball59, Reference Neumark-Sztainer, Wall and Perry61–Reference Bryant, Ward and Hales63, Reference Wilson and Magarey65). While no gold standard exists for examining availability and accessibility of foods, some trials have used in-home inventories. This procedure involves a researcher checking food items that they observe as being present in the home(Reference Rosno, Steele and Johnston39, Reference Hearn, Baranowski and Baranowski40). Despite the validity of in-home inventories conducted by researchers, it is often not feasible to conduct this type of resource-intensive assessment and a checklist format completed by participants may be more practical. Many of the checklists focus on availability and accessibility of fruit and vegetables(Reference Hood and Ellison11, Reference Hearn, Baranowski and Baranowski40–Reference Cullen, Baranowski and Rittenberry45), and some on less healthful foods(Reference Campbell, Crawford and Salmon18), while others include a full range of food groups to reflect the typical US diet(Reference Fulkerson, Nelson and Lytle46). Availability has also been assessed most basically by asking whether caregivers purchase foods on their child's request and if foods are visible(Reference van Assema, Glanz and Martens47). When compared with consumption behaviours, the availability and accessibility of specific foods were related(Reference Hood and Ellison11, Reference Campbell, Crawford and Salmon18, Reference Hearn, Baranowski and Baranowski40–Reference Cullen, Baranowski and Rittenberry45, Reference van Assema, Glanz and Martens47).
Fruit and vegetable availability and accessibility checklists have displayed moderate internal consistency even when availability and accessibility scales are collapsed (i.e. median α = 0·69)(Reference Hearn, Baranowski and Baranowski40). When compared with researcher observation, sensitivity and specificity were generally supported with higher false positive rates in the case of perishable items which tend to be consumed at a faster rate(Reference Marsh, Cullen and Baranowski41). Additionally, some studies indicate that caregivers are more likely to report greater availability of fruits and vegetables than their children and that self-reported intake is more likely to correlate with the children's report(Reference Cullen, Baranowski and Owens42, Reference De Bourdeaudhuij, Klepp and Due43). Furthermore, the scales showed improved internal consistency when children reported (α = 0·82–0·92)(Reference Cullen, Baranowski and Owens42, Reference Cullen, Baranowski and Rittenberry45). In the case of a more comprehensive checklist, agreement between the researcher and the participant (criterion validity) was substantial, supporting measure validity(Reference Fulkerson, Nelson and Lytle46).
Physical activity availability and accessibility
Seven studies assessed PA availability and accessibility. Checklists are a commonly used method to assess these components of the home environment(Reference Spurrier, Magarey and Golley23, Reference Gattshall, Shoup and Marshall38, Reference Hume, Ball and Salmon48, Reference Sirard, Nelson and Pereira49, Reference Rosenberg, Sallis and Kerr51, Reference Timperio, Salmon and Ball52, Reference Bryant, Ward and Hales63). In one comprehensive and well-validated measurement of the PA environment Sirard et al.(Reference Sirard, Nelson and Pereira49) asked participants to record whether they had specific equipment in categories and each item was multiplied by the score of accessibility. From this, researchers could rank the overall quality of the home environment score by a ratio of activity-to-media equipment(Reference Sirard, Nelson and Pereira49). The researchers recommended that this instrument be used in conjunction with other measurements (e.g. home food availability) to identify obesogenic home environments(Reference Sirard, Nelson and Pereira49).
While these PA scales displayed moderate to high test–retest reliability (intra-class correlation coefficient (ICC) = 0·72–0·99)(Reference Hume, Ball and Salmon48, Reference Sirard, Nelson and Pereira49) one exception was for having a covered area outdoors and having active toys, where the internal consistency was low to moderate (α = 0·43–0·77)(Reference Hume, Ball and Salmon48). Criterion validity, established by comparing the responses from the participant to those that were observed by the researcher, was generally high (Pearson r = 0·67–0·98)(Reference Sirard, Nelson and Pereira49).
Media equipment availability
In a technology- and media-driven world, sedentary activities are often determined by the opportunities the child has to engage in screen behaviours(Reference Wartella and Jennings50). Typically caregivers complete an inventory of items in their home that may encourage or support children's screen-based behaviours: television, digital video disc player, video games and others(Reference Salmon, Timperio and Telford27, Reference Rosenberg, Sallis and Kerr51, Reference Timperio, Salmon and Ball52). Similar to the assessment of fruit and vegetable availability, some researchers take a simple approach and inquire how many televisions are in the home and whether the child has a television in his/her bedroom(Reference Timperio, Salmon and Ball52, Reference van Zutphen, Bell and Kremer53). With these measures, only the test–retest reliability was reported and the agreement between tests was high in each case (91–99 % agreement(Reference Salmon, Timperio and Telford27), ICC = 0·54–0.92(Reference Rosenberg, Sallis and Kerr51), ICC = 0·79–0·90(Reference Timperio, Salmon and Ball52)).
Role modelling and policies
Beyond the physical environment in the home, caregivers are also responsible for establishing the social environment that influences health behaviours(Reference Golan and Weizman8, Reference Gattshall, Shoup and Marshall38, Reference Golan and Weizman54). Some researchers focus on social support for healthy eating and PA(Reference Young, Fors and Fasha36, Reference Evans, Dave and Tanner55), while others use different terminology for a similar construct, such as asking children how often they were active with family members and if somebody at home encouraged them to be active(Reference Golan and Weizman54). Another method to consider how caregivers can socially influence health behaviours in their children is to examine rules and policies that they implement, including meal formality and consistency(Reference Campbell, Crawford and Salmon18, Reference Salmon, Timperio and Telford27, Reference van Assema, Glanz and Martens47) as well as role modelling of healthy eating and PA(Reference Rosenberg, Sallis and Kerr51, Reference Pearson, Timperio and Salmon56–Reference Campbell, Crawford and Ball59).
Overall, caregiver role modelling, support and rules and policies were all significant predictors of dietary intake and PA behaviours(Reference Campbell, Crawford and Salmon18, Reference Salmon, Timperio and Telford27, Reference Young, Fors and Fasha36, Reference van Assema, Glanz and Martens47, Reference Hume, Ball and Salmon48, Reference Rosenberg, Sallis and Kerr51, Reference Pearson, Timperio and Salmon56–Reference Vereecken, Keukelier and Maes58). Specifically, rules, policies and social support regarding media supported less screen time in children. Caregiver role modelling is a consistent correlate of positive health behaviours in children and not necessarily within the same behaviour domain (i.e. diet or PA). Internal consistencies ranged from moderate to high (α = 0·64–0·94)(Reference Campbell, Crawford and Salmon18, Reference Salmon, Timperio and Telford27, Reference Young, Fors and Fasha36, Reference Hume, Ball and Salmon48, Reference Cullen, Baranowski and Rittenberry57, Reference Vereecken, Keukelier and Maes58) and test–retest reliability was high (ICC = 0·61–0·90)(Reference Salmon, Timperio and Telford27, Reference Hume, Ball and Salmon48).
A good example of a measure developed and validated with a focus on caregiver role modelling and policies is the Parenting Strategies for Eating and Activity Scale (PEAS)(Reference Larios, Ayala and Arredondo60). The PEAS was tested in a sample of Latino women to evaluate a wider range of parenting strategies and demonstrated moderate to high internal consistency (α = 0·81–0·82)(Reference Larios, Ayala and Arredondo60). Construct validity was established for the PEAS by correlating the subscales with the appropriate subscales of a child feeding questionnaire.
Multiple components of the home environment
In attempts to assess multiple components of the home environment (e.g. those outlined in the Conceptual Model for Eating and Physical Activity Environment), several researchers have developed measurement tools with multiple subscales. These measurement tools contain a range of constructs and psychometric qualities which make them appropriate for use in different instances.
For comprehensive assessments of both environmental and behavioural components, Neumark-Sztainer et al.(Reference Neumark-Sztainer, Wall and Perry61) developed a 221-item questionnaire assessing a range of socio-environmental, personal and behavioural factors associated with dietary intake among adolescents(Reference Neumark-Sztainer, Wall and Perry61). Items identified to be relevant for the current review were availability of vegetables and family meal patterns as a source of caregiver role modelling, which demonstrated moderate internal consistency (α = 0·63–0·78)(Reference Neumark-Sztainer, Wall and Perry61) and test–retest reliability (r = 0·66–0·69)(Reference Bauer, Nelson and Boutelle17).
An example of a tool to assess multiple attitudinal and caregiver practices is the Home Nutrition Questionnaire developed by Dave et al.(Reference Dave, Evans and Pfeiffer62). Six factors were identified in a low-income and mainly Hispanic population: child's preferences for fruit and vegetables, caregiver practices that promote fruit and vegetables, caregiver role modelling, perceived cost of fruit and vegetables, perceived benefits of fast food and eating while watching television. The internal consistency of the scales was moderate to high (α = 0·69–0·87)(Reference Dave, Evans and Pfeiffer62).
Bryant et al.(Reference Bryant, Ward and Hales63) assessed multiple components of the home environment in their Healthy Home Survey (HHS) including food, media and PA availability and accessibility, caregiver role modelling and policies for eating and PA. The test–retest was high for most items except fresh fruit. Validity (in-home assessments) estimates were lowest for sweet snacks (κ = 0·00) and fresh vegetables (κ = 0·23) and highest for frozen fruit (κ = 0·87) and dried fruit (κ = 0·85). Food accessibility showed good reliability (biased-adjusted kappa (PABAK) = 0·96) and poor validity (PABAK = 0·85). The results of the HHS suggest that measurement of variety and quantity of foods may be a better indicator than presence or absence alone.
Finally, Gattshall et al.(Reference Gattshall, Shoup and Marshall38) developed and tested the Home Environment Survey (HES) which assesses a breadth of home environment variables including the availability and accessibility of food and PA, caregiver role modelling and policies for healthy eating and PA. The internal consistencies were moderate to high for these scales (α = 0·66–0·84), except for the accessibility of fat and sweets scale (α = 0·59) and accessibility for fruits and vegetables was reduced to a single item due to poor reliability. As the researchers suggest, perhaps the internal consistency was lower on these subscales because they were too broad (i.e. ‘How often do you store high-calorie foods in a place that was known but not seen?’). Another theory could be that that the items were too embedded (they ended up being confusing for the participant because they had too much information ‘embedded’, so that the participant could not cognitively interpret the construct). Test–retest and inter-rater reliabilities were low to high (r = 0·49–0·99 and r = 0·22–0·70, respectively), indicating some differences between caregiver report of the home environment. The subscales showed strong predictive validity for both the child and caregiver.
Screeners or short measures
Short screeners are useful as a brief and easy-to-administer tool to assess the overall home environment ‘at a glance’, giving the researcher a gross estimate of the family's home environment. Only three screeners are described in the literature which assess the overall impact of the home environment related to childhood obesity. Ihmels et al.(Reference Ihmels, Welk and Eisenmann64) developed and tested the Family Nutrition and Physical Activity (FNPA) screening tool for familial environment and behaviours that may predispose a child to become overweight. This is a twenty-one-item screening tool was developed based on established Evidence Analyses procedures of the American Dietetic Association, which demonstrates high content validity. The FNPA assesses caregiver role modelling of nutrition and PA, television availability and dietary/nutrition/sleep behaviours. Similarly, Wilson et al.(Reference Wilson and Magarey65) developed and tested the Child Nutrition Questionnaire which assesses fruit and vegetable availability and accessibility and policies for healthy eating in fourteen items. They found moderate test–retest reliability in ten of the twelve scales and low to moderate internal consistencies (α = 0·50–0·80). Golan and Weizman(Reference Golan and Weizman54) created the Family Eating and Activity Habits Questionnaire (FEAHQ) and included the availability of unhealthy foods as an indicator of stimulus exposure in addition to child eating behaviours. The eight items assessing availability had moderate internal consistency (α = 0·78) and the test–retest was acceptable.
Feeding style
Feeding style has received much attention in research, largely separate from the home environment, but is relevant to the social food environment as it is closely related to policies for healthy eating. Birch et al.(Reference Birch, Fisher and Grimm-Thomas66) established the Child Feeding Questionnaire (CFQ), a seven-factor model which focused on two broad categories: (i) parental perceptions and (ii) concerns for and use of child feeding practices. Seven factors included: perceived responsibility for the child's weight, perceived parent weight, perceived child weight, concern about child weight, pressure to eat, restriction and monitoring, and all subscales had high internal consistency (α ≥ 0·71)(Reference Birch, Fisher and Grimm-Thomas66).
Many researchers have modified or simply used certain subscales of the original CFQ based upon their research questions. In the interest of having a child's perspective on feeding style, the CFQ has been adapted from a parent-reported tool to a child-reported one(Reference Campbell, Crawford and Salmon18). With an emphasis on controlling feeding styles in a low-income population, it was concluded that previous findings of control being related to greater body weight of the child may not apply to younger children (aged 8–9 years) of diverse ethnic and sociodemographic backgrounds(Reference Robinson, Kiernan and Matheson67). The internal consistency of the control scale was low (α = 0·61)(Reference Robinson, Kiernan and Matheson67). Similarly, Ogden et al.(Reference Ogden, Reynolds and Smith68) wanted to expand the concept of child feeding to differentiate between overt and covert control, with overt control defined as controlling a child's food intake in a way that the child can detect while covert control cannot be detected by the child(Reference Ogden, Reynolds and Smith68). The two control scales had adequate internal consistency (α = 0·78–0·83)(Reference Ogden, Reynolds and Smith68).
Beyond controlling feeding styles, some researchers have developed items to reflect slightly different constructs from the CFQ: emotional feeding, instrumental feeding, prompting or encouraging child to eat, and control over eating(Reference Wardle, Sanderson and Guthrie69). These four subscales demonstrated moderate internal consistency (α = 0·65–0·85) and test–retest reliability (r = 0·67–0·83)(Reference Wardle, Sanderson and Guthrie69). Hughes et al.(Reference Hughes, Power and Orlet Fisher70) wanted to expand the concept of child feeding to include dimensions of Maccoby and Martin's(Reference Maccoby and Martin71) typology of general parenting (demandingness and responsiveness) regarding the child's eating: parent-centred and child-centred strategies(Reference Hughes, Power and Orlet Fisher70). These two scales revealed high test–retest reliability (r = 0·82–0·85) and convergent validity was supported by the subscales being correlated with the appropriate subscales on the CFQ(Reference Hughes, Power and Orlet Fisher70). Similarly, Joyce and Zimmer-Gembeck(Reference Joyce and Zimmer-Gembeck72) assessed multiple parental feeding-specific dimensions including: supportiveness, structure, coerciveness and chaos (α = 0·72–0·92).
Arredondo et al.(Reference Arredondo, Elder and Ayala73) adapted the CFQ based upon focus groups with Latina mothers and yielded a five-factor measure: monitoring, discipline, control, limit setting and reinforcement (α = 0·72–0·87). Kroller and Warschburger(Reference Kroller and Warschburger74) tested parental feeding strategies through translated items from two measures assessing restriction, monitoring, pressure, rewarding, child's control and modelling. These scales demonstrated adequate internal consistency (α = 0·75–0·93) and moderate test–retest reliability (Pearson r = 0·41–0·78)(Reference Kroller and Warschburger74).
Discussion
Several reviews of childhood obesity interventions focusing on the home or caregiver involvement have been conducted(Reference Berry, Sheehan and Heschel31, Reference Nowicka and Flodmark34). These reviews conclude that behavioural interventions including the family are effective; however, the mechanism of change is unclear(Reference Young, Northern and Lister75). In order for research in the area of the home environment and childhood obesity to move forward a greater emphasis on appropriate measurement is necessary. The current review assessed measures of the home environment in a broad sweep of the literature in order to gain a better understanding of appropriate measures of these complex constructs using a conceptual model as a guiding framework(Reference Gattshall, Shoup and Marshall38). The literature review resulted in forty manuscripts describing measurement of different aspects of the home environment. The sample would have been much larger had we included manuscripts describing measurements that did not have any supporting reliability and validity; however, it was the purpose of the review to describe those measures which have some psychometric evaluation. The reader is directed to Table 1 as a resource tool to identify and evaluate the measurement tools available assessing different components of the home environment. Table 1 describes the measurement tools, identifies which constructs are assessed, which population the tool was validated with, whether this sample included specific sub-populations (i.e. low-income, racial/ethnic minorities) and the results of any psychometric testing.
The objective of the current review was to assess the degree to which measurement tools of the home environment can validly and reliably provide assessment. The overall finding was that although many of the reviewed measurement tools have supporting psychometric properties, there is no consistency across similar types of measures (i.e. checklists v. subscales v. screeners) as to which psychometric properties are appropriate as supporting evidence. For example, Bollen and Lennox warn that not all types of scales lend themselves to item covariance (i.e. internal consistency)(Reference Bollen and Lennox76). Further, causal indicators of the latent construct do not necessarily need to be related to each other to provide meaningful assessment of the latent construct(Reference Bollen and Lennox76). Table 2 was developed as part of the review to help guide researchers in the validation of measurement tools utilizing specific types of psychometric properties for certain types of scales for assessing the home environment (checklists, subscales or screeners). One method of validation that is often overlooked is assessing other variables that are effects, or outcomes, of the latent construct(Reference Bollen and Lennox76). This method should be employed more often when building measurement and theoretical models in concert with survey development and validation.
ICC, intra-class correlation coefficient.
In conducting the present review, it was evident that many researchers chose to design new measures for their studies and often the tools employed were brief with a lack of reporting of psychometric properties. This is also evident in the number of measures that researchers have employed that were not included in the current review as they did not report any psychometric properties. When considering the psychometric findings, the data support the conclusion that the measures have adequate reliability, but that evidence of validity is more equivocal. It is important to note that although a measure is reliable, that does not support the validity. Based upon the results of the current review, there is a need for more measurement studies assessing the validity of measurement tools.
While additional validity studies are needed, it is also critical to test existing measures in diverse samples as current measures of the home environment may not necessarily translate to specific sub-populations. The majority of existing efforts to validate home environment measures did not seek out specific populations that experience obesity at disproportionate rates, such as low-income and/or ethnic/minority families. Future measurement efforts may want to focus on assessing the home environment of these harder-to-reach families in order to garner a better understanding of the factors that influence these important health behaviours, especially as many obesity prevention interventions currently target at-risk populations.
Despite limitations across studies, several researchers have designed and tested aspects of the home environment. For example, Bryant et al.(Reference Bryant and Stevens29) and Gattshall et al.(Reference Gattshall, Shoup and Marshall38) have both put forth two comprehensive measures of the home environment assessing both social and physical environments that influence childhood obesity. Conversely many research studies call for brevity in measurement, and screening tools that asses key components of the home environment that place children at risk for becoming obese have utility. Currently there are only three screening tools are evident in the literature. Further research that expands these measures is warranted.
Although closely related to policies and role modelling of healthy eating and PA, child feeding is a unique construct which has been studied extensively. The CFQ has been employed, manipulated and tested by a number of researchers, as have the factors involving caregiver perceptions and concerns regarding child feeding practices(Reference Wilson and Magarey65). Researchers should consider child feeding in their assessment of the social home environment related to nutrition. In addition to social aspects of the home environment, reporting of physical components by adults v. children has yielded interesting results. A few studies showed that when children reported availability of food items in the home, the internal consistency improved. One explanation is that caregivers may be more biased because they are motivated to appear as good providers of more healthful food options for their children. However, this requires further investigation along with validation studies.
The conceptual model guiding the present review(Reference Gattshall, Shoup and Marshall38) did not include the influence of siblings on behaviours within the home. Future research on the home environment may choose to include sibling variables and acknowledge the complexity of familial influences. However, a strength of the review is that it was guided by a theoretical model that was expanded (e.g. feeding style incorporated), resulting in a comprehensive review of measures of the home environment related to childhood obesity. Multiple measures assessing similar constructs of the home environment currently hinder a comparative analysis across studies. Many of the current measures of the home food and PA environment focus on one or two constructs; more comprehensive measures are necessary to capture influences in the home on food and PA behaviours of children. This calls for a more concerted effort to gain a better understanding of familial influences on childhood obesity. Once consistency in the measurement of the family and home environment has been established, the quality of the validation studies should be assessed.
Conclusions
The current review provides a summary and evaluation of measurement tools available in the assessment of the home environment related to childhood obesity. Practitioners can reference the available tools for use in assessing programmatic outcomes while researchers can review the available tools and use the guidance provided for future validation studies. The results of the current review clearly identify a need for comprehensive tools, assessment of specific constructs and short screeners. If more deliberate action is taken to improve and validate existing tools and create new ones with greater emphasis on appropriate measurement models and forms of psychometric testing, the evidence base behind childhood obesity interventions and epidemiological studies focusing on the home environment will be advanced.
Acknowledgements
This research received no specific grant from any funding agency in the public, commercial or not-for-profit sectors. The authors declare no conflicts of interests. All authors contributed to the development and production of the literature review. C.A.P. conducted the literature review under the guidance of P.A.E., M.M.M., M.H.H. and E.L.S.; P.A.E., M.M.M., M.H.H. and E.A.S. also edited the manuscript. A.L.Y. provided direction in terms of synthesizing the literature and edits overall.