Abstract
Objective
External validation of the paediatric logistic organ dysfunction (PELOD) score in two paediatric intensive care units (PICU) in South America.
Methods
Prospective observational cohort study including all PICU admissions from July 2003 to December 2004 in Porto Alegre, Brazil, and from January 2004 to December 2004 in Buenos Aires, Argentina. The data collected included demographic variables, diagnosis, need for mechanical ventilation, length of PICU stay and mortality, and the 12 variables in the PELOD score. For each PELOD score variable, the worst daily value and the worst value of the whole PICU stay were used for the daily PELOD (dPELOD) and PELOD scores, respectively.
Results
A total of 1,476 admissions (51.3% from Argentina and 48.7% from Brazil) were analysed. Observed and predicted mortality were, respectively, 4.7% and 6.6%, with a standardized mortality ratio of 0.72. The score showed excellent discrimination capacity, with an area under the receiver operator characteristic (ROC) curve of 0.93 (0.88–0.98). The dPELOD score on days 1–5 also showed good discrimination capacities, with areas under the ROC curve >0.85. However, PELOD and dPELOD scores showed poor calibration with the Hosmer–Lemeshow test (chi-square 72.3, p < 0.001). This poor calibration was explained by a deficiency in the PELOD score where it fails to identify two risk intervals; 3.1–16.2% and 40–80%.
Conclusions
The PELOD score is reproducible, has excellent discrimination, but over-predicts mortality and has poor calibration. Although the lack of calibration may not invalidate the score, the PELOD score is a discontinuous variable and we advise careful consideration when using it as a surrogate endpoint in clinical trials.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Leteurtre S, Martinot A, Duhamel A, Gauvin F, Grandbastien B, Nam TV, Proulx F, Lacroix J, Leclerc F (1999) Development of a pediatric multiple organ dysfunction score: use of two strategies. Med Decis Making 19:399–410
Leteurtre S, Martinot A, Duhamel A, Proulx F, Grandbastien B, Cotting J, Gottesman R, Joffe A, Pfenninger J, Hubert P, Lacroix J, Leclerc F (2003) Validation of the paediatric logistic organ dysfunction (PELOD) score: prospective, observational, multicentre study. Lancet 362:192–197
Lacroix J, Cotting J (2005) Severity of illness and organ dysfunction scoring in children. Pediatr Crit Care Med 6:S126–S134
Leteurtre S, Duhamel A, Grandbastien B, Lacroix J, Leclerc F (2006) Paediatric logistic organ dysfunction (PELOD) score. Lancet 367:897 author reply 900–892
Leteurtre S, Duhamel A, Grandbastien B, Lacroix J, Leclerc F (2006) Paediatric logistic organ dysfunction (PELOD) score. Lancet 367:902
National Institute of health hemofiltration for respiratory failure after bone marrow transplantation. Available from http://www.clinicaltrials.gov/ct/show/NCT0012575. Accessed 15 July 2008
ISRCTN Register (2008) A study of the efficacy of vasopressin in pediatric vasodilatory shock. Available from http://www.controlled-trials.com/mrct/trial/225315. Accessed 15 July 2008
UK clinical trials gateway control of hyperglycaemia in paediatric intensive care. Available from http://www.controlled-trials.com/mrct/trial/255059. Accessed 15 July 2008
Timsit JF, Fosse JP, Troche G, De Lassence A, Alberti C, Garrouste-Orgeas M, Bornstain C, Adrie C, Cheval C, Chevret S (2002) Calibration and discrimination by daily logistic organ dysfunction scoring comparatively with daily sequential organ failure assessment scoring for predicting hospital mortality in critically ill patients. Crit Care Med 30:2003–2013
Pollack MM, Ruttimann UE, Getson PR (1988) Pediatric risk of mortality (PRISM) score. Crit Care Med 16:1110–1116
Balakrishnan G, Aitchison T, Hallworth D, Morton NS (1992) Prospective evaluation of the paediatric risk of mortality (PRISM) score. Arch Dis Child 67:196–200
Slater A, Shann F, Pearson G (2003) PIM2: a revised version of the paediatric index of mortality. Intensive Care Med 29:278–285
Martha VF, Garcia PC, Piva JP, Einloft PR, Bruno F, Rampon V (2005) Comparison of two prognostic scores (PRISM and PIM) at a padiatric intensive care unit. Jornal de pediatria 81:259–264
Eulmesekian PG, Perez A, Minces PG, Ferrero H (2007) Validation of pediatric index of mortality 2 (PIM2) in a single pediatric intensive care unit of Argentina. Pediatr Crit Care Med 8:54–57
Bleeker SE, Moll HA, Steyerberg EW, Donders AR, Derksen-Lubsen G, Grobbee DE, Moons KG (2003) External validation is necessary in prediction research: a clinical example. J Clin Epidemiol 56:826–832
Terrin N, Schmid CH, Griffith JL, D’Agostino RB, Selker HP (2003) External validity of predictive models: a comparison of logistic regression, classification trees, and neural networks. J Clin Epidemiol 56:721–729
Graciano AL, Balko JA, Rahn DS, Ahmad N, Giroir BP (2005) The pediatric multiple organ dysfunction score (P-MODS): development and validation of an objective scale to measure the severity of multiple organ dysfunction in critically ill children. Crit Care Med 33:1484–1491
Flora JD (1978) A method for comparing survival of burn patients to a standard survival curve. J Trauma 18:701–708
Garcia PC, Eulmesekian P, Sffogia A, Perez A, Branco RG, Piva JP, Tasker RC (2006) Limitation in paediatric logistic organ dysfunction score. Lancet 368:1151 author reply 1151–1152
Khemani RG, Markivitz BP, Curley MAQ (2007) Epidemiologic factors of mechanically ventilated PICU patients in the United States. Pediatr Crit Care Med: A39
Randolph AG, Meert KL, O’Neil ME, Hanson JH, Luckett PM, Arnold JH, Gedeit RG, Cox PN, Roberts JS, Venkataraman ST, Forbes PW, Cheifetz IM (2003) The feasibility of conducting clinical trials in infants and children with acute respiratory failure. Am J Respir Crit Care Med 167:1334–1340
Ream RS, Mackey K, Leet T, Green MC, Andreone TL, Loftis LL, Lynch RE (2007) Association of nursing workload and unplanned extubations in a pediatric intensive care unit. Pediatr Crit Care Med 8:366–371
Peek N, Arts DG, Bosman RJ, van der Voort PH, de Keizer NF (2007) External validation of prognostic models for critically ill patients required substantial sample sizes. J Clin Epidemiol 60:491–501
Marcin JP, Pollack MM (2000) Review of the methodologies and applications of scoring systems in neonatal and pediatric intensive care. Pediatr Crit Care Med 1:20–27
Altman DG, Royston P (2000) What do we mean by validating a prognostic model? Stat Med 19:453–473
Pollack MM (2003) Prognostication scores. In: Field MJ, Behrman RE (eds) When children die: improving palliative care and end-of-life care for children and their families. The National Academies Press, Washington DC, pp 449–475
Thukral A, Kohli U, Lodha R, Kabra SK, Kabra NK (2007) Validation of the PELOD score for multiple organ dysfunction in children. Indian Pediatr 44:683–686
Hosmer DW, Hosmer T, Le Cessie S, Lemeshow S (1997) A comparison of goodness-of-fit tests for the logistic regression model. Stat Med 16:965–980
Leteurtre S, Duhamel A, Grandbastien B, Lacroix J, Leclerc F (2006) Paediatric logistic organ dysfunction (PELOD) score. Lancet 368:1151–1152
Acknowledgment
This article has not received any financial support.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Garcia, P.C.R., Eulmesekian, P., Branco, R.G. et al. External validation of the paediatric logistic organ dysfunction score. Intensive Care Med 36, 116–122 (2010). https://doi.org/10.1007/s00134-009-1489-1
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00134-009-1489-1