Hostname: page-component-cd9895bd7-gvvz8 Total loading time: 0 Render date: 2024-12-27T07:19:49.112Z Has data issue: false hasContentIssue false

Prognostic value of different cut-off points of the NRS-2002 tool to identify nutritional risk in critically ill patients: a longitudinal study

Published online by Cambridge University Press:  17 February 2023

Bruna Barbosa Stello
Affiliation:
Federal University of Health Sciences of Porto Alegre, Porto Alegre, Rio Grande do Sul, Brazil
Aline Cattani
Affiliation:
Nutrition and Dietetics Coordination Service of Pompeia Hospital, Caxias do Sul, Rio Grande do Sul, Brazil
Danielle Silla Jobim Milanez
Affiliation:
Nutrition Sciences Graduate Program, Federal University of Health Sciences of Porto Alegre, Porto Alegre, Rio Grande do Sul, Brazil
Elisa Loch Razzera
Affiliation:
Nutrition Sciences Graduate Program, Federal University of Health Sciences of Porto Alegre, Porto Alegre, Rio Grande do Sul, Brazil
Júlia Lima
Affiliation:
Nutrition Sciences Graduate Program, Federal University of Health Sciences of Porto Alegre, Porto Alegre, Rio Grande do Sul, Brazil
Flávia Moraes Silva*
Affiliation:
Nutrition Department and Nutrition Sciences Graduate Program of Federal University of Health Sciences of Porto Alegre, Porto Alegre, Rio Grande do Sul, Brazil
*
*Corresponding author: Flávia Moraes Silva, email flaviams@ufcspa.edu.br
Rights & Permissions [Opens in a new window]

Abstract

The American Society of Parenteral and Enteral Nutrition recommends nutritional risk (NR) screening in critically ill patients with Nutritional Risk Screening – 2002 (NRS-2002) ≥ 3 as NR and ≥ 5 as high NR. The present study evaluated the predictive validity of different NRS-2002 cut-off points in intensive care unit (ICU). A prospective cohort study was conducted with adult patients who were screened using the NRS-2002. Hospital and ICU length of stay (LOS), hospital and ICU mortality, and ICU readmission were evaluated as outcomes. Logistic and Cox regression analyses were performed to evaluate the prognostic value of NRS-2002, and a receiver operating characteristic curve was constructed to determine the best cut-off point for NRS-2002. 374 patients (61·9 ± 14·3 years, 51·1 % males) were included in the study. Of these, 13·1 % were classified as without NR, 48·9 % and 38·0 % were classified as NR and high NR, respectively. An NRS-2002 score of ≥ 5 was associated with prolonged hospital LOS. The best cut-off point for NRS-2002 was a score ≥ 4, which was associated with prolonged hospital LOS (OR = 2·13; 95 % CI: 1·39, 3·28), ICU readmission (OR = 2·44; 95 % CI: 1·14, 5·22), ICU (HR = 2·91; 95 % CI: 1·47, 5·78) and hospital mortality (HR = 2·01; 95 % CI: 1·24, 3·25), but not with ICU prolonged LOS (P = 0·688). NRS-2002 ≥ 4 presented the most satisfactory predictive validity and should be considered in the ICU setting. Future studies should confirm the cut-off point and its validity in predicting nutrition therapy interaction with outcomes.

Type
Research Article
Copyright
© The Author(s), 2023. Published by Cambridge University Press on behalf of The Nutrition Society

Critical illness is a complex and multifactorial condition characterised by intense catabolic stress, and a systemic inflammatory response is associated with worse outcomes such as increased infectious morbidity, multiple organ failure, longer hospital length of stay (LOS) and mortality(Reference McClave, Taylor and Martindale1,Reference Boniatti, Friedman and Castilho2) . These patients have an exacerbated release of pro-inflammatory mediators and counter-regulatory hormones that trigger intense muscle wasting, with consequent functionality and contractility reduction, leading to muscle mass loss and subcutaneous fat loss(Reference Preiser, Ichai and Orban3). Although some patients may not present a nutritional status commitment at hospital or intensive care unit (ICU) admission, the persistent inflammatory response associated with critical illness contributes to malnutrition development(Reference White, Guenter and Jensen4).

Malnutrition prevalence in critically ill patients varies from 37·8 to 78·1 % and is associated with longer ICU LOS and higher death rates(Reference Lew, Yandell and Fraser5). This highlights the relevance of performing nutritional risk (NR) screening at ICU admission(Reference Castro, Ribeiro and Souza6,Reference Singer, Blaser and Berger7) . In general hospitalised patients, NR screening aims to identify patients at risk of malnutrition who could benefit from a detailed nutritional assessment and early nutritional intervention(Reference Mueller, Compher and Ellen8); screening should occur within the first 24–48 h after hospital admission(Reference McClave, Taylor and Martindale1,Reference Castro, Ribeiro and Souza6) . However, in the ICU setting, there is no consensus on the NR definition and when screening should occur, although 55·9 % (minimum 16·0 % to maximum 99·5 %) of critically ill patients are at NR according to a systematic review of thirty-six studies conducted by our research group(Reference Cattani, Eckert and Brito9).

The European Society for Clinical Nutrition and Metabolism (ESPEN) recommends that all patients whose ICU LOS exceeds 48 h should be considered at NR, since the weight and muscle mass loss related to the intense catabolic stress of critical illness is unavoidable(Reference Singer, Blaser and Berger7). On the other hand, the American Society of Parenteral and Enteral Nutrition (ASPEN)(Reference McClave, Taylor and Martindale1) and the Brazilian Society of Parenteral and Enteral Nutrition (BRASPEN/SBNPE)(Reference Castro, Ribeiro and Souza6) recommend that NR screening should be performed and suggest the use of Nutritional Risk Screening – 2002 (NRS-2002)(Reference Kondrup, Rasmussen and Hamberg10) or the Nutrition Risk in Critically Ill (NUTRIC) score(Reference Heyland, Dhaliwal and Jiang11).

Despite consolidated evidence of the prognostic value of a high NUTRIC score in critically ill patients, its variables do not directly reflect nutritional parameters, including the Acute Physiology and Chronic Health Evaluation II (APACHE II)(Reference Knaus, Draper and Wagner12) and Sepsis-Related Organ Failure Assessment (SOFA)(Reference Vincent, Moreno and Takala13), age, number of co-morbidities, and total days of hospitalisation before the ICU(Reference Heyland, Dhaliwal and Jiang11). ASPEN suggested a new approach for NR classification by NRS-2002 that considers scores ≥ 3 as NR and scores ≥ 5 as high NR(Reference McClave, Taylor and Martindale1). To the best of our knowledge, only three studies(Reference Maciel, Franzosi and Nunes14Reference Zhao, Li and Ge16) have evaluated the association between high NR defined by NRS-2002 ≥ 5 and worse clinical outcomes in critically ill patients; this cut-off point was based on expert opinion, and a cut-off point ≥ 3 was established for non-critically ill patients. Therefore, considering the scarce evidence related to the prognostic value of NRS-2002 in ICU settings and the lack of studies testing the best cut-off point for predicting meaningful clinical outcomes (such as ICU readmission, ICU and hospital LOS, and ICU and hospital mortality), further studies are necessary in this field.

Materials & methods

Study design

A cohort study was conducted in five ICU at a hospital complex in Porto Alegre (Brazil) to evaluate the validity of different NR screening tools and tools for malnutrition diagnosis, including as a specific objective the aim of the current study. The protocol was approved by the Ethical Committee of the Hospital (number 4·735·356) and conducted according to the 466/12 Resolution of the National Ethics Committee (https://conselho.saude.gov.br/resolucoes/2012/Reso466.pdf) and the principles of the Helsinki Declaration. All patients or their family members provided written informed consent before data collection. When this was not possible, the patient’s family provided oral consent before nutritional anamnesis by telephone.

Inclusion and exclusion criteria

Patients aged ≥ 18 years, of both sexes, that could answer a simplified nutritional anamnesis or whose family members could answer it were included in the study. Patients whose ICU LOS prediction was less than 24 h, pregnant and lactating women (up to 9 months postpartum), those without gasometry in the first 24 h, and those exhibiting anasarca (with the impossibility of performing a physical examination) and with medical contraindication of mobilisation (making not possible to perform anthropometric measures) were excluded. The last exclusion criterion is related to another aim defined by our research group, to be answered through the data collected from these patients. If the NRS-2002 could not be completed, the patient was excluded from this study.

Data collection

Data collection was performed prospectively between November 2019 and March 2020, and between April 2021 and May 2022, with a suspension period due to the COVID-19 pandemic, since ICU access was limited to professionals in the field. Three trained registered dietitians and three nutrition undergraduate students collected clinical, sociodemographic and nutritional data within 24 h of ICU admission.

Clinical and sociodemographic data were collected from electronic records or nursing sign sheets, and included age, sex, vital signs, hospital and ICU admission dates, reason for ICU admission, morbid history, number of co-morbidities, and number of hospitalisation days before ICU admission. Medications in use at ICU admission, need for mechanical ventilation (MV) and haemodialysis, and the first 24 h of clinical laboratory results were also collected. From these data, the disease severity rating score (Acute Physiology And Chronic Health Evaluation [APACHE II](Reference Knaus, Draper and Wagner12) and Sequential Organ Failure Assessment [SOFA](Reference Vincent, Moreno and Takala13)) were calculated. We also collected the electronic records of patients who underwent surgical procedures before ICU admission and if they had a cancer diagnosis.

BMI was calculated from the weight and height data provided by the patient or their family members during the patient’s visit or telephone contact. It was provided by the patients’ family members when the patient was sedated or on MV, or if there was an electronic record of mental confusion by the nursing staff. Simplified nutritional anamnesis performed with the patient or their family members comprised an assessment of food consumption 2 weeks before hospitalisation in terms of quantity and weight loss. To evaluate the alteration in food intake, the percentage of current consumption compared with the usual consumption was rated on a 0–100 % scale, considering the number of days since this modification. Patients or their family members were questioned about their usual and current weight. When weight loss was identified, we asked them about the period in which it occurred and whether it was intentional or not. Therefore, we calculated the percentage of unintentional weight loss and considered it and the period for the NR classification by NRS-2002.

NR was evaluated using the NRS-2002 tool performed in the first 24 h after ICU admission. Nutritional status impairment and disease severity (associated with increased nutritional requirements) were evaluated, with the cut-off points of absent (0), mild (1), moderate (2) or severe (3) being used for each item. If the patient was aged ≥ 70 years, 1 point was added to the final score(Reference Kondrup, Rasmussen and Hamberg10). The sum of nutritional status impairment items, disease severity and age was classified as follows: without NR (< 3 points), with NR (3–4 points) and high NR (≥ 5 points)(Reference McClave, Taylor and Martindale1).

Patients were followed up until hospital discharge to collect outcomes of interest in the medical record: ICU LOS, hospital LOS, ICU mortality and hospital mortality, and ICU readmission during the hospital stay.

Statistical analysis

Sample size calculation was based on the Maciel et al. (Reference Maciel, Franzosi and Nunes14) study, considering ICU (11·6 % and 33 %) and hospital (28·9 % and 44·7 %) percentage of deaths among patients with NR and high NR according to NRS-2002, a power of 80 %, a significance level of 5 % and an additional 20 % for multivariate analysis adjustments. Based on ICU and hospital deaths, the estimated sample sizes were 163 and 372 patients, respectively. The largest sample size was considered in this study. The sample size was calculated using the OpenEpi calculator (http://www.openepi.com/Menu/OE_Menu.htm).

Descriptive statistics were calculated for sample characterisation: mean and standard deviation for parametric quantitative variables, median and interquartile range for non-parametric quantitative variables, and absolute and relative frequencies for categorical variables. The normality of the variables was evaluated using the Kolmogorov–Smirnov test.

Patients without NR were compared with those with NR and those with high NR in terms of clinical and sociodemographic variables and outcomes of interest using ANOVA, Kruskal–Wallis test or χ 2 test. Tukey’s test and Bonferroni correction were performed for post hoc analysis. Finally, a significant difference between groups was defined as P < 0·20 considering the number of groups for comparisons.

The predictive validity of the different cut-off points of the NRS-2002 and its score as a continuous variable were assessed. We tested the following cut-off points of the NRS-2002: ≥ 3 v. < 3 and ≥ 5 v. < 5. When tested considering the punctuation of the NRS-2002 score, it ranged from 0 to 7 points. Logistic regression was adopted when LOS in the ICU, hospital LOS (categorised by the median of the sample as < median or ≥ median) and ICU readmission were included as dependent variables in the models. Cox regression analysis was performed to evaluate the association between NR according to the different NRS-2002 cut-off points and mortality. All analyses were adjusted for potential confounders (variables with P < 0·20 in the bivariate analysis and those with recognised clinical relevance) as dependent variables.

We also constructed a receiver operating characteristic (ROC) curve and calculated the sensitivity and specificity of the NRS-2002 to evaluate its predictive value considering all outcomes listed above (one ROC curve was constructed for each outcome). The greatest balance between sensitivity and specificity was defined as the best cut-off point when the ROC AUC was statistically significant. Patients with and without NR according to the new cut-off defined were compared through Student’s t test, Mann–Whitney and χ 2 tests. Logistic and Cox regression analyses were also performed to evaluate the independent association of this cut-off point and clinical outcomes after adjustment for confounders.

Data analyses were performed using SPSS 20.0, and statistical significance was set at P values < 0·05.

Results

General characteristics of the sample

Data from 374 critically ill patients were collected during the study. Almost one-third (n 102, 27·3 %) of patients were admitted to a lung disease-specialised ICU, 26·2 % (n 98) to a general ICU and 23·0 % (n 86) to an oncological ICU. The mean age of the patients was 61·9 ± 14·3 years, and most of them were males (n 191, 51·1 %). The main reasons for admission to the ICU were cancer complications (n 116, 31·0 %), pulmonary disorders (n 113, 30·2 %) and gastrointestinal disorders (n 52, 13·9 %). The median length of hospital stay before ICU admission was 2·0 (0·0–8·0). Most patients had cancer (n 191, 51·1 %), underwent surgical procedures during their hospital stay (n 243, 65·1 %), required MV upon ICU admission (n 198, 53·1 %) and were prescribed vasoactive drugs (n 228, 61·0 %). Indeed, 23·4 % of our sample had sepsis at ICU admission, and 8·2 % required haemodialysis at ICU admission.

The median of the SOFA and APACHE II scores were equal to 6·0 (3·0–10·0) and 17·0 (11·0–23·0), respectively. The mean of body weight, height, and BMI was equal to 71·7 ± 17·1 kg, 1·66 ± 0·09 m and 25·8 ± 5·2 kg/m2, respectively. According to dietary prescriptions, 53·8 % (n 109) of patients were on an exclusively oral diet, 35·1 % (n 130) on an exclusively enteral diet and 3·5 % (n 13) on a parenteral diet; four patients were on fasting, and the remaining had a prescription of more than one feeding route.

The median number of days spent in the ICU was 5 (3–9) d. The median hospital LOS was 19 (11–33) d, and 29·1 % (n 109) and 19·0 % (n 65) of the patients died during the hospital and ICU stays, respectively. Indeed, 10·8 % (n 40) of patients had ICU readmissions.

Nutritional risk according to the Nutritional Risk Screening – 2002

The NRS-2002 was applied from anamnesis performed with the patient (52·4 %) and or with their families (46·2 %). Eleven patients (2·9 %) had anamnesis data collected from electronic records. In our sample, 13·1 % of the patients were classified as without NR (NRS-2002 score < 3), 48·9 % as with NR (NRS-2002 score 3–4) and 38 % as having a high NR (NRS-2002 score ≥ 5). So, 86·9 % presented NR, considering that NRS-2002 ≥ 3.

Figure 1 illustrates the frequencies of scores for the NRS-2002 components. Related to the nutritional status impairment component, most patients presented normal nutritional status (n 165; 43·9 %). Otherwise, related to the disease severity component, most patients received the score 3 (n 287; 73·6 %). In 27·9 % of the sample, one point was added to the final score due to age ≥ 70 years. The NRS-2002 median score was 4 (3–5) points.

Fig. 1. Relative frequency of componentes for Nutritional Risk Screening According to NRS-2002.

Comparison of characteristics and clinical outcomes between patients grouped according to Nutritional Risk Screening – 2002 cut-off points proposed by American Society of Parenteral and Enteral Nutrition

Table 1 shows a comparison between patients grouped according to the NRS-2002 NR categories proposed by the ASPEN. No significant differences were observed between the groups regarding sex, frequency of cancer diagnosis and ICU readmission. Patients at high NR (NRS-2002 ≥ 5) were older and had a lower BMI than those classified as NRS-2002 < 3. The APACHE II and SOFA scores were significantly different between the three groups. Patients with an NRS-2002 score ≥ 5 had longer ICU and hospital LOS than those without NR, while no significant difference was found between patients with risk and those with high risk. The incidence of ICU and hospital deaths was also higher in patients with high NR than in those with and without NR.

Table 1. Characteristics and outcomes in critically ill patients according to the different cut-off points of Nutritional Risk Screening (NRS-2002)

APACHE II, Acute Physiology and Chronic Health Evaluation II; SOFA, Sepsis-Related Organ Failure Assessment; MV, mechanical ventilation; HD, haemodialysis; MVd, duration of mechanical ventilation; ICU, intensive care unit; LOS, length of stay.

Data are presented as absolute (relative) frequencies, mean ± standard deviation, or median (P25–P75).

* χ 2 with Bonferroni correction (P < 0·20 were considered significant, since three pairs of comparisons were performed and are represented by different superscript letters).

Anova one-way.

Kruskal–Wallis with Tukey’s post hoc test (Different superscript letters indicate P < 0·05 while equal superscript letters indicate a non-significant difference between groups).

Considering the differences observed between the groups, we adjusted the multivariate analyses for MV at ICU admission, haemodialysis at ICU admission and SOFA score. Age, APACHE, cancer diagnosis, surgical procedure and transplant status were not included as covariates because all these variables were already considered in the NRS-2002 to avoid multicolinearity.

Predictive validity of the Nutritional Risk Screening – 2002 cut-off points proposed by American Society of Parenteral and Enteral Nutrition

Multivariate analysis was performed to evaluate the predictive validity of the cut-off points of the NRS-2002 proposed by ASPEN on the clinical outcomes of interest. When adjusted for potential confounders, only the high NR category increased the chance of prolonged hospital LOS by 2·67 times, as presented in Table 2.

Table 2. Predictive validity of Nutritional Risk Screening (NRS-2002): multivariate analyses on the association between different cut-off points and clinical outcomes

LOS, length of stay; ICU, intensive care unit; HR, hazard ratio; MV, mechanical ventilation; HD, haemodialysis; SOFA, Sepsis-Related Organ Failure Assessment.

Multivariate analysis adjusted for sepsis, MV at admission, HD at admission and SOFA.

* For all logistic regression analyses, Hosmer and Lemeshow test presented a P-value > 0·05.

Logistic regression.

Cox regression.

Predictive validity of Nutritional Risk Screening – 2002 as a categorical or continuous variable

Considering the results presented in Table 2, which could be due to insufficient power to demonstrate the predictive validity of three categories for NR classification by NRS-2002, another multivariate analysis was conducted considering the NRS-2002 as bicategorical or as a continuous variable. We categorised NR by NRS-2002 as follows: NRS-2002 < 3 (without NR) v. NRS-2002 ≥ 3 (with NR), and NRS-2002 < 5 (without NR + with NR) v. NRS ≥ 5 (high NR).

According to the logistic and Cox regression results presented in Table 3 (crude and adjusted models), an NRS-2002 ≥ 5 score was an independent predictor of ICU mortality in comparison with an NRS-2002 score < 5. The categorical variable that grouped patients with NR and high NR (NRS-2002 ≥ 3) was only a predictor of hospital LOS ≥ 19 d in the multivariate analysis when compared with patients without NR. On the other hand, an increase of 1 point in the NRS-2002 score increased the chance of prolonged hospital LOS by 1·23 times and the risk of ICU and hospital death by 1·24 and 1·42 times, respectively.

Table 3. Predictive validity of Nutritional Risk Screening (NRS-2002) as a categorical or continuous variable: multivariate analyses

LOS, length of stay; ICU, intensive care unit; HR, hazard ratio; MV, mechanical ventilation; HD, haemodialysis; SOFA, Sepsis-Related Organ Failure Assessment.

Multivariate analyses adjusted for sepsis, MV at admission, HD at admission and SOFA.

* For all logistic regression analyses, Hosmer and Lemeshow test presented a P-value > 0·05.

Logistic regression.

Cox regression.

Definition of a new cut-off point for Nutritional Risk Screening – 2002

Considering that the continuous NRS-2002 was a predictor of a greater number of outcomes, we sought to assess the NRS-2002 accuracy and the need to define a new cut-off point for the tool in the context of critical illness. According to the values of accuracy, sensibility, and specificity, and considering a minimum sensitivity of 50 %, the NRS-2002 ≥ 4 cut-off point showed satisfactory performance in identifying prolonged hospital LOS, prolonged ICU LOS, hospital mortality and ICU mortality. For ICU readmission, a cut–off point was not defined because the area under the ROC curve was not significant (Table 4 and online Supplementary Fig. 1). According to this cut-off point, 57·9 % (n 216) of our sample was classified as NR.

Table 4. Definition of a Nutritional Risk Screening (NRS-2002) cut-off point for predicting clinical outcomes

LOS, length of stay; ICU, intensive care unit; ROC, receiver operating characteristics.

Since the AUC ROC gives us the results of an unadjusted analysis of predictive validity, based on the aforementioned results, we conducted a multivariate analysis to assess if NRS-2002 ≥ 4 in comparison with NRS-2002 < 4 would be a predictor of a greater number of outcomes when compared with the already established cut-off points.

A comparison of patients with NR (NRS-2002 ≥ 4) and those without NR (NRS-2002 < 4) is presented in Supplementary Table 1. Weight, BMI, age, SOFA, APACHE II, sepsis, MV at ICU admission, transplant status and surgical procedure frequency were different between the groups, while the frequency of males, cancer diagnosis, haemodialysis and vasoactive drug prescription at ICU admission did not differ between the groups. All clinical outcomes differed between the groups and were more frequent in patients with an NRS-2002 ≥ 4. Therefore, we adopted the SOFA score and MV as confounders at admission in the multivariate analysis. In both the univariate and adjusted analyses, NRS-2002 ≥ 4 demonstrated a significant association with all outcomes, except for prolonged ICU LOS (Table 5).

Table 5. Predictive validity of Nutritional Risk Screening (NRS-2002) cut-off point ≥ 4 for clinical outcomes: multivariate analyses

LOS, length of stay; ICU, intensive care unit; HR, hazard ratio; MV, mechanical ventilation; SOFA, Sepsis-Related Organ Failure Assessment.

Multivariate analyses adjusted for sepsis, MV at admission and SOFA.

* For all logistic regression analyses, Hosmer and Lemeshow test presented a P-value > 0·05.

Logistic regression.

Cox regression.

Supplementary Fig. 2 illustrates a summary of the association between NRS-2002 and clinical outcomes, considering its different cut-off points through the calculated OR/HR and its 95 % CI.

Discussion

The present study aimed to evaluate the predictive validity of the NRS-2002 cut-off points to identify NR in critically ill adult patients. When we compared patients with NR and high NR to those without NR, considering the cut-off points proposed by ASPEN, an NRS-2002 score ≥ 5 was an independent predictor only for hospital LOS ≥ 19 d. For each increase of 1 point in the NRS-2002 score, we demonstrated an increased chance of prolonged LOS of 1·23 times and an increased risk of ICU and hospital mortality of 1·24 and 1·42 times, respectively. Finally, when we explored the best cut-off point of the NRS-2002, we identified that a score ≥ 4 was independently associated with prolonged hospital LOS, ICU readmission, ICU and hospital death.

The frequency of patients with NR evaluated by NRS-2002 ≥ 3 was 86·9 %, and 38 % were classified as having a high NR (NRS-2002 ≥ 5). This tool has been applied in other studies, in which the prevalence of NR ranged from 39·4 % to 99·5 %(Reference Cattani, Eckert and Brito9), and a frequency of NRS-2002 score ≥ 5 in critically ill patients ranged between 20·9 % and 62 %(Reference Maciel, Franzosi and Nunes14Reference Gulsoy and Orhan18). This wide range can be explained by the heterogeneity of patients studied in relation to age and disease severity scores, the manner in which nutritional data were collected (from records v. informed or measured data), and with whom the anamnesis was taken. Shpata et al. showed that elderly patients had a 1·07-fold increase in the likelihood of NR, and an APACHE II score ≥ 15 was identified as a predictor of this condition in critically ill patients (OR = 3·06, 95 % CI: 1·85, 5·04)(Reference Shpata, Ohri and Nurka19). Zhao et al. considered all critically ill patients with COVID-19 to have a score of 3 in the component disease severity instead of evaluating the APACHE II score, and 73·6 % of patients scored 3 in the NRS-2002 component(Reference Zhao, Li and Ge16).

High NR was an independent predictor of prolonged hospital stay (≥ 19 d), but it was not associated with other unfavourable clinical outcomes in our sample compared with the other two categories. Indeed, NR (NRS-2002 ≥ 3 and < 5) was not an independent predictor of clinical outcomes when the three NR categories were considered in the analyses. We did not identify studies that performed a similar analysis to explore the association between NRS-2002 categories and hospital LOS. Regarding ICU LOS, Marchetti et al. (Reference Marchetti, Reis and Santos15) demonstrated that patients with a high NR spent more days in the ICU than those with NR, as in our results. However, in multivariate analyses, we did not find a significant association, while Marchetti et al. did not perform this. A prospective cohort study(Reference Maciel, Franzosi and Nunes14) showed that patients classified as having high NR had a 2·10-fold increase in ICU death compared with patients with NR (NRS-2002 ≥ 3). However, the authors excluded the group of patients without NR from the analyses (n 1). Patients with an NRS-2002 score ≥ 5 presented a higher incidence of infection, which could contribute to a higher risk of mortality, and it was not included as a potential confounder in the regression analyses(Reference Maciel, Franzosi and Nunes14). They did not find a significant association between high NR and hospital mortality in multivariate analyses. A Turkish study(Reference Özbilgin, Hancı and Ömür20) demonstrated a significant correlation between hospital mortality and the NRS-2002 score (r = 0·166, P < 0·05). However, the correlation test performed is questionable since it is a statistical test indicated for evaluating the association between two quantitative variables that are not applicable for mortality. We did not find any studies evaluating the association between NR categories and ICU readmission, precluding comparisons with our results. Furthermore, the studies discussed above compared patients with NR to patients with high NR, since they identified a reduced number of patients without NR and did not include them in the analyses. This precludes a direct comparison with our study. It is important to highlight that in our sample, only 13 % of patients were classified as without NR, and the incidence of outcomes was low in the three categories of NR. It can reduce the analysis power to identify the real prognostic value of NR and high NR, and these analyses need to be considered exploratory.

We also assessed the NRS-2002 as a categorical and continuous variable. NRS-2002 ≥ 3 compared with NRS-2002 < 3 was significantly associated with hospital LOS ≥ 19 d, while NRS-2002 ≥ 5 compared with NRS-2002 < 5 increased the risk of ICU mortality by 2·23 times. In contrast, the NR analysed as a continuous variable was a predictor of prolonged hospital LOS, ICU mortality and hospital mortality. Zhao et al. (Reference Zhao, Li and Ge16) demonstrated a higher risk of hospital mortality in patients with COVID-19 when NRS-2002 was considered a continuous variable; however, it was not associated with hospital LOS. It is necessary to highlight that the outcome was also considered a continuous variable, and the median LOS was higher than that in the current study (32 d v. 19 d). Another study conducted in a post-operative care unit reported a non-significant correlation between NRS-2002 and hospital LOS (r = 0·118, P > 0·05); however, a multivariate analysis was not conducted(Reference Özbilgin, Hancı and Ömür20). A Brazilian prospective cohort(Reference Marchetti, Reis and Santos15) classified patients with scores < 5 or ≥ 5 using the NRS-2002 tool and reported that a higher score was associated with hospital mortality; however, ICU mortality was not evaluated. Indeed, the authors did not consider potential confounders such as the requirement for MV and infection. The in-hospital mortality risk was 2-fold higher in patients classified as having high NR in the NRS-2002 (score ≥ 5) in another study involving 311 critically ill patients(Reference Gulsoy and Orhan18); however, ICU mortality was not evaluated. NRS-2002 ≥ 3 was associated with ICU-LOS ≥ 9 d (OR 5·33; 95 % CI: 2·82, 10·09) and 28-d mortality (OR 1·75; 95 % CI: 1·42, 2·16) in a study involving 440 Iranian critically ill patients, with 83·9 % at NR(Reference Majari, Imani and Hosseini21). The median ICU stay was almost 2-fold higher than that in our study, and the incidence of death was 30·8 %, while in our sample, it was 18·8 %.

To the best of our knowledge, the definition of the cut-off point proposed by the ASPEN, which classifies patients with high NR, is an expert-based recommendation. Kondrup et al. (Reference Kondrup, Rasmussen and Hamberg10) developed an NRS-2002 tool to detect NR in hospitalised patients based on the concept that nutrition therapy should be initiated in patients with nutritional status impairment and/or severe illness(Reference Kondrup22). It was derived from a systematic review of randomised clinical trials by analysing the nutritional features of patients from trials in which nutrition support was effective in improving clinical outcomes in comparison with trials in which it was not effective. Therefore, they defined a cut-off point ≥ 3 as a NR for non-critically ill patients(Reference Kondrup, Rasmussen and Hamberg10). To our knowledge, no study has defined an NRS-2002 cut-off point for critically ill patients. Therefore, we constructed an ROC curve and identified a cut-off point ≥ 4, which showed satisfactory prognostic value to identify higher odds for prolonged hospital LOS and ICU readmission, as well as a higher risk of ICU and hospital death.

Despite having satisfactory predictive validity, the NRS-2002 tool depends on a nutritional anamnesis so that it can be performed. In the current study, we were able to apply the NRS-2002 to the majority of patients, but in 46·2 % of patients, the anamnesis needed to be done with the patients’ families. However, in ICU, in which most patients require MV and contact with family members or caregivers is not possible, the feasibility of the tool is limited. Few studies address with whom the anamnesis was taken and, even in those studies, information regarding the frequency in which data were measured, collected from medical records, or collected from patients is not covered in detail by the authors(Reference Maciel, Franzosi and Nunes14Reference Machado Dos Reis, Marchetti and Forte Dos Santos17). It is necessary to highlight the impact of the difference between weight and height data collected from measurements, estimations or information in clinical practice. Chumlea’s equation for weight estimation(Reference Chumlea, Guo and Roche23), for example, showed a mean standard error of 4·5 kg for men and 3·8 kg for women. Likewise, a study conducted with 16 573 patients selected from the Third National Health and Nutrition Examination Survey (NHANES III)(Reference Kuczmarski, Kuczmarski and Najjar24) demonstrated that men tended to overestimate, and women underestimated their body weight. In our study, we used the weight and height provided by patients or family members/caregivers for all patients. Considering that we used informed data of weight and height to calculate BMI and weight loss percentage, the potential bias of measurement was systematic, and we adopted a pragmatic approach for data collection.

Our study had some limitations. The nutritional status impairment component of the NRS-2002 tool was originally subdivided into the percentage of recent weight loss, change in food intake, and/or reduced BMI, and the scores were stratified into mild, moderate, or severe. We did not evaluate the association between each of these factors and the clinical outcomes of interest, considering only the impairment of nutritional status as a whole and the severity of the disease. Furthermore, since we included only 130 patients on an enteral diet and for those on an oral diet we had no prospective control over food acceptance, we could not assess the interaction between outcomes and nutrition therapy, which is also relevant, based on the concept of NR. We did not evaluate the concurrent validity of different cut-off points of NRS-2002 because the agreement between NRS-2002 and NUTRIC is poor (kappa coefficient < 0·350), as demonstrated by Coruja et al. (Reference Coruja, Cobalchini and Wentzel25). In addition, a previous analysis conducted by our research group demonstrated that NRS-2002 ≥ 3 or NRS-2002 ≥ 5 is inaccurate in identifying NR using NUTRIC as a reference (data not published yet). On the other hand, our study has some strength. This is the first study to propose a specific cut-off point for the NRS-2002 tool in critically ill adults based on its predictive validity, involving a heterogeneous sample of critically ill patients, and achieved the sample size estimated. For future research, the interaction between NR and nutritional therapy should be assessed, and the predictive validity of NRS-2002 ≥ 4 should be confirmed in ICU settings.

Conclusion

A cut-off point of 4 for NRS-2002 was a predictor of prolonged hospital LOS, ICU readmission, and ICU and hospital mortality in critically ill patients, whereas NRS-2002 ≥ 3 was independently associated only with prolonged hospital LOS, while NRS-2002 ≥ 5 was independently associated only with ICU mortality.

Acknowledgements

The authors thank the Santa Casa de Misericórdia de Porto Alegre Hospital Complex and members of the Evidence-based Clinical Nutrition Research Group for their support in conducting this study. Flávia Moraes Silva has received a productivity scholarship from the Brazilian National Council for Scientific and Technological Development. Danielle Silla Jobim Milanez, Elisa Loch Razzera and Julia Lima received scholarships as Master’s Students from the Coordination for the Improvement of Higher Education Personnel.

This research received funding from Fundação de Amparo à Pesquisa do Rio Grande do Sul (FAPERGS, 19/2551–0001789–8).

F. M. S. contributed to the conceptualization, methodology, forma analysis, project administration, supervision, and writing - review & editing of this manuscript. B.B.S. contributed to the conceptualization, investigation, data curation, forma analysis, writing - original draft, and writing - review & editing of this manuscript. D. S. J. M., E. L. R., A. C. and J. L. contributed to the investigation, data curation, and writing - review & editing of this manuscript. A. C. contributed to the conceptualization, project administration, writing - review & editing of this manuscript.

There are no conflicts of interest.

Supplementary material

To view supplementary material for this article, please visit https://doi.org/10.1017/S0007114523000363

References

McClave, SA, Taylor, BE, Martindale, RG, et al. (2016) Guidelines for the provision and assessment of nutrition support therapy in the adult critically ill patient: Society of Critical Care Medicine (SCCM) and American Society for Parenteral and Enteral Nutrition (A.S.P.E.N.). JPEN J Parenter Enteral Nutr 40, 159211.CrossRefGoogle ScholarPubMed
Boniatti, MM, Friedman, G, Castilho, RK, et al. (2011) Characteristics of chronically critically ill patients: comparing two definitions. Clinics 66, 701704.CrossRefGoogle ScholarPubMed
Preiser, JC, Ichai, C, Orban, JC, et al. (2014) Metabolic response to the stress of critical illness. Br J Anaesth 113, 945954.CrossRefGoogle Scholar
White, JV, Guenter, P, Jensen, G, et al. (2012) Consensus statement Academy of Nutrition and Dietetics and American Society for Parenteral and Enteral Nutrition: characteristics recommended for the identification and documentation of adult malnutrition (undernutrition). JPEN J Parenter Enteral Nutr 36, 275283.CrossRefGoogle Scholar
Lew, CCH, Yandell, R, Fraser, RJL, et al. (2017) Association between malnutrition and clinical outcomes in the intensive care unit: a systematic review. JPEN J Parenter Enteral Nutr 41, 744758.CrossRefGoogle ScholarPubMed
Castro, MG, Ribeiro, PC, Souza, IAO, et al. (2018) Diretriz Brasileira de Terapia Nutricional no Paciente Grave (Brazilian Guidelines for Nutriton therapy of critically ill patients). BRASPEN J 33, 236.Google Scholar
Singer, P, Blaser, AR, Berger, MM, et al. (2019) ESPEN guideline on clinical nutrition in the intensive care unit. Clin Nutr 38, 4879.CrossRefGoogle ScholarPubMed
Mueller, C, Compher, C & Ellen, DM (2011) American Society for Parenteral and Enteral Nutrition (A.S.P.E.N.) Board of Directors. ASPEN clinical guidelines: nutrition screening, assessment, and intervention in adults. JPEN J Parenter Enteral Nutr 35, 1624.CrossRefGoogle ScholarPubMed
Cattani, A, Eckert, IC, Brito, JE, et al. (2020) Nutritional risk in critically ill patients: how it is assessed, its prevalence and prognostic value: a systematic review. Nutr Rev 78, 10521068.CrossRefGoogle ScholarPubMed
Kondrup, J, Rasmussen, HH, Hamberg, O, et al. (2003) Nutritional risk screening (NRS 2002): a new method based on an analysis of controlled clinical trials. Clin Nutr 22, 321336.CrossRefGoogle Scholar
Heyland, DK, Dhaliwal, R, Jiang, X, et al. (2011) Identifying critically ill patients who benefit the most from nutrition therapy: the development and initial validation of a novel risk assessment tool. Crit Care 15, R268.CrossRefGoogle ScholarPubMed
Knaus, WA, Draper, EA, Wagner, DP, et al. (1985) APACHE II: a severity of disease classification system. Crit Care Med 13, 818829.CrossRefGoogle ScholarPubMed
Vincent, JL, Moreno, R, Takala, J, et al. (1996) The SOFA (Sepsis-related Organ Failure Assessment) score to describe organ dysfunction/failure. Intens Care Med 22, 707710.CrossRefGoogle ScholarPubMed
Maciel, LRMA, Franzosi, OS, Nunes, DSL, et al. (2019) Nutritional risk screening 2002 cut-off to identify high-risk is a good predictor of ICU mortality in critically ill patients. Nutr Clin Pract 34, 137141.CrossRefGoogle ScholarPubMed
Marchetti, J, Reis, AM, Santos, AF, et al. (2019) O elevado risco nutricional está associado a desfechos desfavoráveis em pacientes internados na unidade de terapia intensiva (High nutritional risk is associated with worse outcomes in critically ill patients). Rev Bras Ter Intensiva 31, 326332.Google Scholar
Zhao, X, Li, Y, Ge, Y, et al. (2021) Evaluation of nutrition risk and its association with mortality risk in severely and critically ill COVID-19 patients. JPEN J Parenter Enteral Nutr 45, 3242.CrossRefGoogle ScholarPubMed
Machado Dos Reis, A, Marchetti, J, Forte Dos Santos, A, et al. (2020) NUTRIC Score: isolated and Combined Use With the NRS-2002 to Predict Hospital Mortality in Critically Ill Patients. JPEN J Parenter Enteral Nutr 44, 12501256.CrossRefGoogle ScholarPubMed
Gulsoy, KY & Orhan, S (2022) The Relationship between Mortality and the Modified Nutrition Risk in Critically Ill (mNUTRIC) and Nutritional Risk Screening 2002 (NRS-2002) scores in the intensive care unit. J Coll Physician Surg Pak 32, 848854.Google ScholarPubMed
Shpata, V, Ohri, I, Nurka, T, et al. (2015) The prevalence and consequences of malnutrition risk in elderly Albanian intensive care unit patients. Clin Interv Aging 10:481486.CrossRefGoogle ScholarPubMed
Özbilgin, Ş, Hancı, V, Ömür, D, et al. (2016) Morbidity and mortality predictivity of nutritional assessment tools in the postoperative care unit. Medicine 95, e5038.CrossRefGoogle ScholarPubMed
Majari, K, Imani, H, Hosseini, S, et al. (2021) Comparison of modified NUTRIC, NRS-2002, and MUST scores in Iranian critically ill patients admitted to intensive care units: a prospective cohort study. JPEN J Parenter Enteral Nutr 45, 15041513.CrossRefGoogle ScholarPubMed
Kondrup, J (2014) Nutritional-risk scoring systems in the intensive care unit. Curr Opin Clin Nutr Metab Care 17, 177182.CrossRefGoogle ScholarPubMed
Chumlea, WC, Guo, S, Roche, AF, et al. (1988) Prediction of body weight for the nonambulatory elderly from anthropometry. J Am Diet Assoc 88, 564568.CrossRefGoogle ScholarPubMed
Kuczmarski, MF, Kuczmarski, RJ & Najjar, M (2001) Effects of age on validity of self-reported height, weight, and body mass index: findings from the Third National Health and Nutrition Examination Survey, 1988–1994. J Am Diet Assoc 101, 2834.CrossRefGoogle ScholarPubMed
Coruja, MK, Cobalchini, Y, Wentzel, C, et al. (2020) Nutrition risk screening in intensive care units: agreement Between NUTRIC and NRS 2002 Tools. Nutr Clin Pract 35, 567571.CrossRefGoogle Scholar
Figure 0

Fig. 1. Relative frequency of componentes for Nutritional Risk Screening According to NRS-2002.

Figure 1

Table 1. Characteristics and outcomes in critically ill patients according to the different cut-off points of Nutritional Risk Screening (NRS-2002)

Figure 2

Table 2. Predictive validity of Nutritional Risk Screening (NRS-2002): multivariate analyses on the association between different cut-off points and clinical outcomes

Figure 3

Table 3. Predictive validity of Nutritional Risk Screening (NRS-2002) as a categorical or continuous variable: multivariate analyses

Figure 4

Table 4. Definition of a Nutritional Risk Screening (NRS-2002) cut-off point for predicting clinical outcomes

Figure 5

Table 5. Predictive validity of Nutritional Risk Screening (NRS-2002) cut-off point ≥ 4 for clinical outcomes: multivariate analyses

Supplementary material: File

Stello et al. supplementary material

Table S1 and Figures S1-S2

Download Stello et al. supplementary material(File)
File 477.2 KB