An acute kidney injury prediction nomogram based on neurosurgical intensive care unit profiles
Original Article

An acute kidney injury prediction nomogram based on neurosurgical intensive care unit profiles

Shuo An1,2#, Hongliang Luo1,2#, Jiao Wang3#, Zhitao Gong1,2, Ye Tian1,2, Xuanhui Liu1,2, Jun Ma3, Rongcai Jiang1,2

1Department of Neurosurgery, Tianjin Medical University General Hospital, Tianjin 300052, China; 2Tianjin Neurological Institute, Key Laboratory of Post-Neuroinjury Neuro-repair and Regeneration in Central Nervous System, Tianjin Medical University General Hospital, Ministry of Education and Tianjin City, Tianjin 300052, China; 3Department of Health Statistics, College of Public Health, Tianjin Medical University, Tianjin 300070, China

Contributions: (I) Conception and design: R Jiang, J Ma; (II) Administrative support: S An; (III) Provision of study materials or patients: None; (IV) Collection and assembly of data: H Luo, Z Gong; (V) Data analysis and interpretation: J Wang; (VI) Manuscript writing: All authors; (VII) Final approval of manuscript: All authors.

#These authors contributed equally to this work.

Correspondence to: Rongcai Jiang. Department of Neurosurgery, Tianjin Medical University General Hospital, 154 Anshan Road, Tianjin 300052, China. Email:; Jun Ma. Department of Health Statistics, College of Public Health, Tianjin Medical University, No. 22 Qixiangtai Road, Heping District, Tianjin 300070, China. Email:

Background: Acute kidney injury (AKI) is a common and serious complication with high mortality within the neural-critical care unit, and can limit the treatment of osmotic diuresis and body fluid equilibrium. Given its seriousness, it is necessary to find a tool to predict the likelihood of AKI and to prevent its occurrence.

Methods: In this retrospective study, patients’ clinical profiles, laboratory test results, and doctors’ prescriptions were collected. Least absolute shrinkage and selection operator (LASSO) regression was used to select variables, and a logistic regression model was then applied to find independent risk factors for AKI. Based on the results of multivariate analysis, we established a nomogram to evaluate the probability of AKI, which was verified through the use of a receiver operating characteristic (ROC) curve and its calibration curves.

Results: Risk factors given by logistic regression were Glasgow Coma Scale (GCS) classification (1.593; 95% CI: 0.995–2.549; P=0.0523), coefficient of variation (CV) of GCS (1.017; 95% CI: 0.995–1.04; P=0.1367), hypertension (2.238; 95% CI: 1.124–4.456; P=0.0219), coronary heart disease (2.924; 95% CI: 1.2–7.126; P=0.0182), pneumonia within 7 days (3.032; 95% CI: 1.511–6.085; P=0.0018), heart failure within 7 days (6.589; 95% CI: 2.235–19.42; P=0.0006), furosemide (1.011; 95% CI: 1.005–1.016; P<0.0001), torasemide (1.028; 95% CI: 0.976–1.082; P=0.297), dopamine (1; 95% CI: 1–1.001, P=0.3297), and norepinephrine (1.007; 95% CI: 1–1.015; P=0.0474). The area under the curve (AUC) of the prediction model was 0.8786, and the calibration curves showed that the model had a good ability to predict AKI occurrence.

Conclusions: This study presents an AKI prediction nomogram based on LASSO, logistic regression, and clinical risk factors. The clinical use of the nomogram may allow for the timely detection of AKI occurrence and thus improve the prognosis of patients.

Keywords: Neurosurgical intensive care; acute kidney injury (AKI); risk factors; nomogram

Submitted Oct 14, 2019. Accepted for publication Dec 20, 2019.

doi: 10.21037/atm.2020.01.60


The development of neurosurgery/neurological critical care medicine has an over 50-year history. The purpose of this care is to provide advanced life support and effective solutions to treat traumatic and non-traumatic acute central nervous system injury. Given the severe conditions of the patients and the specialized nature of the medical treatment in neurosurgery/neurological intensive care units (NICU), serious complications are to be expected when compared with patients in regular wards. Gruber et al. found that 81% of patients suffer from at least 1 additional organ dysfunction apart from the central nervous system (1). The commonly used medications in the NICU, including mannitol, vancomycin, and various contrast agents, are nephrotoxic, which limits the options of drug therapy when acute kidney injury (AKI) occurs. This is of particular concern as it is essential to prevent the occurrence of renal dysfunction, (also known as AKI), at as early a stage as possible. However, physicians and surgeons may be indecisive or reluctant in choosing a given medication or its dosage, and thus outcomes can be adversely affected.

AKI, as a worldwide health issue, is considered to be a complication with high mortality and poor prognosis. Previous studies have shown the AKI incidence range dramatically from between 0.7% and 77.2% depending on the different diagnostic standards and study cohorts (2-4). According to Büttner’s research, this figure was 11.6% in neurocritical care settings (5), while the mortality of AKI patients has been reported to be more than 16 per 100 person-years (6), and increasing. Based on the verification of traditional risk factors, we designed a new, retrospective study to identify new risk factors and their related effects according to different clinical profiles. Specifically, we aimed to determine the risk factors of AKI development and create a scale to evaluate the probability for patients undergoing critical neurosurgical care to suffer from AKI.


Patient selection

In the NICU of Tianjin Medical University General Hospital (which is the highest-level hospital located in the center of the municipality of Tianjin), we admit patients with life-threatening acute brain injury (ABI) with or without complications. This includes patients who suffer from traumatic brain injury, intracerebral hemorrhage, subarachnoid hemorrhage, post-operation, and other acute central nervous system injury. With the support of the consulting protocol, any non-neurosurgery issue is solved in cooperation with the other relevant department. The ABI patients who met the standard of our NICU admission and who were admitted to the NICU between January 2017 and December 2017 were included in this retrospective study. Patients who stayed in the NICU less than 24 hours, who had been hospitalized multiple times, or who had been diagnosed with chronic kidney disease (CKD), including those found with renal dysfunction within the last 3 months (as determined by their medical histories) were excluded (Figure 1). This study was approved by the ethics committees of Tianjin Medical University General Hospital.

Figure 1 Study flow chart. LASSO, least absolute shrinkage and selection operator.

Data collection

We retrospectively collected the patients’ data, including demographics, laboratory parameters, pharmacy prescription details, and surgery and operation information. Patients were monitored during their hospital stays. We used the highest value of the Glasgow Coma Scale (GCS) per hour of every day to assess impaired consciousness and coma (7). For blood pressure (BP), invasive BP and non-invasive BP were measured and recorded by the hour. We recorded non-invasive systolic pressure and diastolic pressure separately. Intake and output volume were recorded every 24 hours. The coefficient of variation (CV) and mean were calculated for each of GCS, BP, and intake/output value. We also collected patients’ medical history, particularly information related to diabetes, coronary artery disease, and hypertension. Laboratory test results during patients’ hospital stay, including serum creatine (SCr), aspartate aminotransferase (AST), alanine aminotransferase (ALT), white blood cell (WBC) count, and other values were recorded. We recorded the baselines of these tests with the first value being within 3 days of onset admission.

Definition of AKI

The outcome was the occurrence of AKI during the patients’ hospital stay, according to the Kidney Disease: Improving Global Outcomes (KDIGO) guidelines (8). In this study, once a patient met the standard of stage 1 (serum creatinine, 1.5–1.9 times baseline or ≥26.5 µmol/L increase; urine output, <0.5 mL/kg/h for 6–12 hours), we placed that patient into the AKI group.

Statistical analysis

Numerical variables of the normal distribution are expressed as mean ± SD, while those of non-normal distribution are expressed as median (quartile). The continuous data and category data between the AKI and non-AKI groups were compared by Wilcoxon rank-sum test and Chi-square test, respectively. The significance level of the above statistical analyses was set as α=0.05, and P<0.05 (two-tailed) was considered statistically significant. Least absolute shrinkage and selection operator (LASSO) regularization was used for variable selection, and logistic regression was used to estimate the association of independent risk factors and AKI. LASSO regression is a compression estimation that is used to deal with the collinearity between covariates. When there are several collinear predictors, LASSO selects only one and ignores the others or zeroes out some regression coefficients. In this study, the training set and the validation set were divided into a 7:3 ratio to find the optimal LASSO model. Multicollinearity was tested using the variance inflation factor (VIF) method, with a VIF ≥10 indicating the presence of several multicollinearities. Finally, we built a nomogram based on the results of a logistic regression model, which was verified through the use of the Hosmer-Lemeshow tests and the calibration curve. All statistical analyses were performed using SAS 9.4 and R software (version 3.5.1; (packages: ResourceSelection, rms, ggplot2).


In total, 583 patients were enrolled in this study, and 143 patients were excluded. Seventy-one patients had AKI, meaning that the incidence of AKI was 12.17%. With the median age of 66 years, over six-tenths (64.79%) of the patients were male. Compared with non-AKI patients, patients with AKI were significantly older (P=0.001), while their mortality and NICU stays were significantly higher and longer (P<0.0001). Table 1 shows a comparison of the significant characteristics of patients enrolled in the study (P<0.05). The proportions of main diagnoses, medical history, the occurrences of comorbidities, etc. were significantly different (P<0.05).

Table 1
Table 1 Characteristics of patients enrolled in this study
Full table

The baselines of laboratory tests and drug usage are shown in Table 2 and Table 3, respectively. AKI patients tended to have significantly higher alkaline phosphatase (ALP), blood potassium concentration (K+), and lower blood platelet (PLT) levels (P<0.05). Differences in drug administration were also observed, with AKI patients having significantly more use of antibiotics, including meropenem, piperacillin sodium tazobataner sodium (PSTS), cefoperazone sodium, and sulbactam sodium (CSSS) (P<0.05). Compared with non-AKI patients, vasopressor agents like dopamine and noradrenaline were significantly more prescribed in AKI patients (P<0.05). All the other significant differences in drugs including that of fasudil, furosemide, torasemide, etc. can be seen in Table 2 (P<0.05).

Table 2
Table 2 Baselines of laboratory test values
Full table
Table 3
Table 3 Use of medicines
Full table

To confirm the independent risk factors of AKI, we performed LASSO regularization to select variables (Figure 2) and followed this with logistics regression analysis. Table 4 shows the results of multivariate analysis. With a poorer GCS classification (1.593; 95% CI: 0.995–2.549), higher CV of GCS (1.017; 95% CI: 0.995–1.04), hypertension (2.238; 95% CI: 1.124–4.456), coronary heart disease (CHD) (2.924; 95% CI: 1.2–7.126), pneumonia diagnosed within 7 days (3.032; 95% CI: 1.511–6.085), and heart failure within 7 days (6.589; 95% CI: 2.235–19.42), along with greater use of furosemide (1.011; 95% CI: 1.005–1.016), torasemide (1.028; 95% CI: 0.976–1.082), dopamine (1; 95% CI: 1–1.001), and norepinephrine (1.007; 95% CI: 1–1.015), the patients would be more likely to suffer from AKI. However, a higher GCS (0.955; 95% CI: 0.848–1.074) showed a reduced likelihood of AKI occurrence.

Figure 2 Least absolute shrinkage and selection operator (LASSO) coefficient profiles of variables. The figure illustrates the selection process of LASSO. The abscissa stands for the step-by-step selection of variables. Eleven variables were admitted to the final model based on the minimum average square error (ASE).
Table 4
Table 4 The multivariable analysis of AKI
Full table

Figure 3 is the nomogram of the logistic regression model. All selected variables have their own lines in the nomogram, with each receiving a point according to the value and the scale at the top of the figure. Total points were added up, and the probability of AKI occurrence was matched. Figure 4 is the calibration curve. The apparent value is close to the bias-corrected value. The Hosmer-Lemeshow tests proved the good predictive performance of the model (χ2=4.4175 and P value =0.8176). According to the above picture and area under the ROC curve (AUC =0.8786) (Figure 5), the model obtained in this study has a good predictive performance for AKI.

Figure 3 The nomogram developed by logistic regression. Each selected variable is represented by a line in the figure. According to the value, each variable receives a point. Total points are added for each variable and matched with the probability of AKI occurrence. AKI, acute kidney injury.
Figure 4 Calibration curves of the nomogram. The lines in the figure represent the apparent value, the bias corrected value, and the ideal value. The apparent and the bias-corrected values are close to each other, which means the nomogram has a good predictive performance. The good performance of the model can also be confirmed by the Hosmer-Lemeshow test (χ2=4.4175 and P value =0.8176).
Figure 5 The ROC curve. The area under the receiver operating characteristic (AUC) is 0.8786.


Currently, there is no effective practical tool for estimating the likelihood of AKI occurrence after acute brain injury, especially in the NICU. To redress this shortcoming, we conducted a study based on NICU patients’ clinical profiles and effective mathematical modelling methods. This risk score system in the study is easy and convenient to apply to early stage AKI prediction in the NICU. It may help clinical physicians detect AKI and manage it in a timely manner. Based on different regressions, we found 10 risk factors of AKI occurrence in this retrospective study, including GCS, CV, hypertension, CHD, and pneumonia and heart failure within the first week, along with the use of furosemide, torasemide, dopamine, and noradrenaline. GCS difference was performed as a protective factor in our analysis.

In the NICU, the GCS scoring system is commonly used to evaluate the severity of a patient’s condition. In our study, based on hourly GCS scoring, we calculated the mean GCS value in the first week to estimate the condition of the patients. We also calculated the coefficient of variation to observe the stability of consciousness and the value gap between the seventh day after admission and admission day. Results revealed that the patients with a low GCS mean value and a high CV were more likely to suffer from AKI. In contrast, the probability of AKI decreased the higher the GCS value gap was.

Our study highlights medical histories of coronary heart disease and hypertension as risk factors, which corresponds to the significant difference in the age of AKI patients (P=0.001). CHD has been reported to be associated with acute or chronic kidney injury (9). Furthermore, the connection between hypertension and weaker renal function has been known since the first description of untreated hypertensive vascular disease (10).

Infection, especially sepsis, is the most important risk factor for renal function. In the NICU, infection is mainly caused by pneumonia (lung infection) which is related to a disturbance of consciousness, immune dysfunction, or a weaker bucking response of the patients. Mechanical ventilation (MV) is the most commonly used medical treatment in the NICU, especially for serious cases that require externally assisted breathing. Our analysis indicates that MV is more often used in AKI patients who also have a high incidence of pneumonia (P<0.01).

Although use of antibiotics medicine was not found to be significant in our multivariate analysis result based on 7-day treatment data, the univariate analysis did show some significant differences between AKI patients and non-AKI patients for piperacillin sodium tazobataner sodium (PSTS), cefoperazone sodium and sulbactam sodium (CSSS), and meropenem (P<0.01). There are several reports which state that PSTS can induce renal dysfunction (11,12).

Neither the univariate analysis nor the final model of our study found a significant difference with regards to the effect of vancomycin, which was thought to be nephrotoxic, on AKI patients. This might be because there were only a few patients who were treated with vancomycin to prevent infection in the first 7 days after admission, and physicians preferred to use other less nephrotoxic drugs when there was a high risk for AKI.

Mannitol is the most commonly used dehydration drug in the NICU, and it is nephrotoxic. Interestingly, mannitol was not admitted into our final model. However, diuretics were analyzed as a risk factor. Diuretics are used by physicians and surgeons as a replacement treatment for intravenous injection of mannitol, in cases when AKI occurs or when the baseline creatinine exceeds the upper limit value. However, it has been proven that the use of diuretics may increase the risk of AKI, especially loop diuretics (13-15).

Norepinephrine and dopamine, which are used to treat hypotension, were key risk factors in our model. Norepinephrine was thought to decrease the blood flow of visceral organs, like the kidney, when vascular beds constrict under normal conditions. Yet, the latest research has indicated that, under fluid-resuscitated endotoxemic conditions, renal oxygen delivery, gross filtration rate (GFR), and renal oxygen supply can be improved by using norepinephrine to restore blood pressure in cases of vasodilatory shock and AKI (16). Low dose dopamine (LDD) has been used for its renal blood flow and urine output improvement benefits, but lately, its use has become controversial. Some researchers have concluded that LDD plays no role in improving renal function or preventing acute renal insufficiency (17,18). KIDGO has no recommendations concerning the use of dopamine in its new guidelines (8). Based on this knowledge, we considered that, although these are risk factors, the probable explanation relates principally to hypotension, and thus norepinephrine can be first chosen over dopamine to maintain blood pressure.

In addition, these findings, some limitations to our study should be addressed. Firstly, this is an observational study that cannot directly draw causal conclusions. Secondly, considering the mean of AKI occurrence time was around 7 days after admission, we only collect the data for a week after the onset of admission. Thirdly, some information, such as a history of surgery or surgery type, was not input into the final analysis, and this may need to be investigated in future research. Finally, as this study was based on a single center, it will inevitably have sample selection bias, although we did adjust for various confounding factors; for the same reason, we lack external validation of the study. As such, more centers should be enrolled to verify our results.


In conclusion, this study presents a nomogram, compiled through the use of LASSO regression and logistic regression, which considers various clinical risk factors in evaluating the probability of AKI occurrence in the patients with acute brain injury in the NICU. This scale can help clinical physicians prevent the occurrence of AKI and improve the prognosis of acute brain injury patients.


We would like to thank all the staff in the NICU and medical record department for all the support they have given to this study. We would also like to thank Steven Wenham for his assistance in editing the language of the manuscript.

Funding: This work was supported by the National Natural Science Foundation of China (No. 81671221, 81671380), the Tianjin Research Program of Application Foundation and Advanced Technology (No. 14ZCZDSY00179), the Clinical Study of Tianjin Medical University (No. 2017kylc007, Rongcai Jiang), the Natural Science Foundation of Tianjin (No. 17JCZDJC35900), and the Zhao Yi-Cheng Medical Science Foundation.


Conflicts of interest: The authors have no conflicts of interest to declare.

Ethical Statement: The authors are accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved. The study was approved by The Ethical Committee of Tianjin Medical University General Hospital (No. IRB2019-WZ-123). The authors are accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved.

Open Access Statement: This is an Open Access article distributed in accordance with the Creative Commons Attribution-NonCommercial-NoDerivs 4.0 International License (CC BY-NC-ND 4.0), which permits the non-commercial replication and distribution of the article with the strict proviso that no changes or edits are made and the original work is properly cited (including links to both the formal publication through the relevant DOI and the license). See:


  1. Gruber A, Reinprecht A, Illievich UM, et al. Extracerebral organ dysfunction and neurologic outcome after aneurysmal subarachnoid hemorrhage. Crit Care Med 1999;27:505-14. [Crossref] [PubMed]
  2. Koeze J, Keus F, Dieperink W, et al. Incidence, timing and outcome of AKI in critically ill patients varies with the definition used and the addition of urine output criteria. BMC Nephrol 2017;18:70. [Crossref] [PubMed]
  3. James MT, Hemmelgarn BR, Wiebe N, et al. Glomerular filtration rate, proteinuria, and the incidence and consequences of acute kidney injury: a cohort study. Lancet 2010;376:2096-103. [Crossref] [PubMed]
  4. Han SS, Kim S, Ahn SY, et al. Duration of acute kidney injury and mortality in critically ill patients: a retrospective observational study. BMC Nephrol 2013;14:133. [Crossref] [PubMed]
  5. Büttner S, Stadler A, Mayer C, et al. Incidence, Risk Factors, and Outcome of Acute Kidney Injury in Neurocritical Care. J Intensive Care Med 2020;35:338-46. [PubMed]
  6. Coca SG, Singanamala S, Parikh CR. Chronic kidney disease after acute kidney injury: a systematic review and meta-analysis. Kidney Int 2012;81:442-8. [Crossref] [PubMed]
  7. Teasdale G, Jennett B. Assessment of coma and impaired consciousness. A practical scale. Lancet 1974;2:81-4. [Crossref] [PubMed]
  8. Khwaja A. KDIGO clinical practice guidelines for acute kidney injury. Nephron Clin Pract 2012;120:c179-84. [PubMed]
  9. Wagner M, Wanner C, Schich M, et al. Patient's and physician's awareness of kidney disease in coronary heart disease patients - a cross-sectional analysis of the German subset of the EUROASPIRE IV survey. BMC Nephrol 2017;18:321. [Crossref] [PubMed]
  10. Perera GA. Hypertensive vascular disease; description and natural history. J Chronic Dis 1955;1:33-42. [Crossref] [PubMed]
  11. Luther MK, Timbrook TT, Caffrey AR, et al. Vancomycin Plus Piperacillin-Tazobactam and Acute Kidney Injury in Adults: A Systematic Review and Meta-Analysis. Crit Care Med 2018;46:12-20. [Crossref] [PubMed]
  12. Giuliano CA, Patel CR, Kale-Pradhan PB. Is the Combination of Piperacillin-Tazobactam and Vancomycin Associated with Development of Acute Kidney Injury? A Meta-analysis. Pharmacotherapy 2016;36:1217-28. [Crossref] [PubMed]
  13. Zhang Y, Jiang L, Wang B, et al. Epidemiological characteristics of and risk factors for patients with postoperative acute kidney injury: a multicenter prospective study in 30 Chinese intensive care units. Int Urol Nephrol 2018;50:1319-28. [Crossref] [PubMed]
  14. Dreischulte T, Morales DR, Bell S, et al. Combined use of nonsteroidal anti-inflammatory drugs with diuretics and/or renin-angiotensin system inhibitors in the community increases the risk of acute kidney injury. Kidney Int 2015;88:396-403. [Crossref] [PubMed]
  15. Ejaz AA, Mohandas R. Are diuretics harmful in the management of acute kidney injury? Curr Opin Nephrol Hypertens 2014;23:155-60. [Crossref] [PubMed]
  16. Redfors B, Bragadottir G, Sellgren J, et al. Effects of norepinephrine on renal perfusion, filtration and oxygenation in vasodilatory shock and acute kidney injury. Intensive Care Med 2011;37:60-7. [Crossref] [PubMed]
  17. Connelly J, Benani DJ, Newman M, et al. Systemic effects of low-dose dopamine during administration of cytarabine. J Oncol Pharm Pract 2017;23:436-42. [Crossref] [PubMed]
  18. Marik PE. Low-dose dopamine: a systematic review. Intensive Care Med 2002;28:877-83. [Crossref] [PubMed]
Cite this article as: An S, Luo H, Wang J, Gong Z, Tian Y, Liu X, Ma J, Jiang R. An acute kidney injury prediction nomogram based on neurosurgical intensive care unit profiles. Ann Transl Med 2020;8(5):194. doi: 10.21037/atm.2020.01.60