22 June 2020: Database Analysis
Predictive Nomogram for Midterm to Long-Term Prognosis in Patients with Papillary Renal Cell Carcinoma Based on Data from the Surveillance, Epidemiology, and End Results (SEER) Program
Haosheng Wang1BCDF, Xueliang Chen1G, Jianwu Zhao1F, Mingyang Kang1BF, Rongpeng Dong1BC, Kai Wang1B, Yang Qu1AEFG*DOI: 10.12659/MSM.921859
Med Sci Monit 2020; 26:e921859
Abstract
BACKGROUND: This study aimed to develop a predictive nomogram for midterm to long-term prognosis in patients with papillary renal cell carcinoma (RCC) based on data from the US Surveillance, Epidemiology, and End Results (SEER) program.
MATERIAL AND METHODS: Clinical pathology data and follow-up information were obtained from the SEER database for patients with papillary RCC between 1997–2014. Univariate and multivariate Cox regression models evaluated the independent prognostic factors, and the nomogram was constructed to predict the 3-year, 5-year, and 10-year survival rates. Multiple parameters were estimated to evaluate the predictive values, including the concordance indices (C-indices), calibration plots, area under the receiver operator characteristics (ROC) curve, net reclassification improvement (NRI), integrated discrimination improvement (IDI), and decision curve analysis (DCA).
RESULTS: The study included 13,926 patients with papillary RCC. Univariate and multivariate Cox regression analysis developed the nomogram that relied on the predictive variables of age, Fuhrman grade, TNM stage, surgery of the primary site, lymphadenectomy, and marital status. The C-indices of the novel model in the validation cohort were more satisfactory than those of the TNM classification. Accurate discrimination and calibration by the nomogram were identified in both cohorts. The NRI and IDI supported prediction improvements, and the DCA supported the nomogram’s clinical significance.
CONCLUSIONS: A nomogram was developed to evaluate the prognosis of papillary RCC and to identify the patients who required specialized treatment. However, external validation of the predictive nomogram is required that also includes patients from other countries.
Keywords: Carcinoma, Renal Cell, nomograms, SEER Program, Cohort Studies, Early Detection of Cancer, Kidney, Kidney Neoplasms, Multivariate Analysis, Proportional Hazards Models, ROC Curve, Survival Rate
Background
Among malignant tumors, renal cell carcinoma (RCC) is highly prevalent in the United States (US) [1]. The incidence of RCC has shown an increasing trend over the last 30 years worldwide [2]. Papillary (RCC) was reported as the second most common type of RCC [3]. Similar to clear cell renal carcinoma, RCC originating from proximal convoluted tubular epithelial cells, accounted for approximately 7–14% of cases of RCC cases [4–6].
The special clinical manifestations, pathological morphology, and biological behaviors of papillary RCC are different from the other types [3,7,8]. Although the prognosis of papillary RCC can be improved upon pretreatment, patients with distant metastasis and higher histopathological grade have poor prognosis and most need adjuvant therapy after surgery [9,10]. It is worth noting that the treatment of papillary RCC still remains controversial [3,9–12].
To date, the TNM staging system is a widely applied evaluation and treatment guideline used for cancer therapy worldwide. It has become the standard method for staging malignant tumors by most clinicians and medical scientists [13]. A serious weakness underlying the system, nevertheless, is that the TNM classification system only considers limited factors, namely tumor size (T), metastasis (M) and regional lymph nodes (N). According to previous studies, other clinicopathological factors, such as age, sex, tumor grade, surgical mode, lymphadenectomy, and chemotherapy, which might have a significant impact on the prognosis of papillary RCC were not included in the TNM system [13,14]. Neglecting these factors reduced the accuracy of predicting survival by the system [14–16]. Based on the clinical uniqueness of papillary RCC, a reliable and accurate prognostic model was urgently needed in clinical practice.
Nomograms are often used clinically for deciding on a patent’s tumor prognosis [17,18]. Therefore, this study aimed to develop a predictive nomogram for midterm to long-term prognosis in patients with papillary renal cell carcinoma (RCC) based on data from the US Surveillance, Epidemiology, and End Results (SEER) program.
Material and Methods
DATA SOURCE AND DATA PROCESSING:
We extracted data of patients with papillary renal cell carcinoma (RCC) (ICD-O-3 site code 8050 and 8052) data between 1997–2014 using the US Surveillance, Epidemiology, and End Results (SEER) program and SEER*Stat software. The datasets analyzed in this study are available on the SEER database (
The Fuhrman grades were as follows: grade I (well-differentiated), grade II (moderately-differentiated), grade III (poorly-differentiated), grade IV (undifferentiated), and unknown. According to the SEER Kidney Surgery Codes 2018, the operation method was categorized into three groups: non-surgery (code 0), partial nephrectomy (PN, code 10-30), and nephrectomy (code 40-90), Marital status included single and married, and chemotherapy was divided no/unknown and yes. All data from the SEER database were free, and the Second Hospital of Jilin University authorized the use of patient information. All authors signed the SEER Research Data Agreement to protect the patients’ privacy, consistent with the ethical principles. Since the SEER program’s data are anonymous, and cancer is a reportable disease in every state, the requirement for informed consent was waived.
NOMOGRAM CONSTRUCTION AND STATISTICAL ANALYSIS:
Univariate analysis by the Cox regression method was adopted to screen OS-related variables. Variables presenting P<0.05 were selected for multivariate regression. Based on a Cox proportional-hazards model, a multivariate analysis was conducted to evaluate independent risk factors of papillary RCC. The hazard ratios (HR) and the 95% confidence interval (CI) were presented for the results. A P-value <0.05 represented eligibility to be included in our prognosis model. However, individual statistical significance may not accurately reflect the significance in clinical practice. Therefore, the related clinicopathological variables should also be considered. Based on these independent risk factors, a new nomogram model was developed with a graphical tool to estimate the overall survival (OS) rates of papillary RCC at 3, 5, and 10 years, respectively.
MODEL VALIDATION AND PERFORMANCE EVALUATION:
Overall, 13,926 patients were randomly subdivided into a training cohort (n=6,964) and validation cohort (n=6,962). For performance evaluation, receiver operating characteristic (ROC) curves were constructed [19], while obtaining the area under the curve (AUC) and corrected concordance index (C-index). The nomogram was validated internally (training cohort) and externally (validation cohort), while 1000 bootstrap resamples were constructed, and a calibration curve was adopted. The accuracy and discrimination of the nomogram was inversely associated with the distance between the calibration curve and the nearest bisector. Additionally, net reclassification improvement (NRI) and relative integrated discrimination improvement (IDI) were analyzed to evaluate nomogram improvements compared with the TNM according to the AJCC (sixth edition) for the 3-year, 5-year, and 10-year prediction of overall survival (OS) [20]. Finally, the decision curve analysis (DCA) for clinical significance was conducted [21]. All statistical analysis and graphs were completed by R software version x 64 3.6.1, R studio, and SPSS version 24.0. The P-value <0.05 represented positive statistical significance in this study.
Results
DEMOGRAPHIC CLINICOPATHOLOGICAL FEATURES OF PATIENTS:
Based on our inclusion and exclusion criteria, 13,926 patients with papillary RCC in the SEER database, meeting the criteria of our study, were included. All follow-up periods of the patients were complete. The detailed findings of the descriptive analysis are shown in Table 1. The majority of patients were men (10,658; 76.53%), older than 40 years (27,264; 77.56%), married (9,163; 65.80%), and Caucasian (9,707; 69.70%). Most patients underwent nephrectomy or PN (12,489; 95.52%). Moreover, a small percentage of patients underwent lymphadenectomy (1,229; 8.83%). Most patients did not receive chemotherapy (13,492; 96.89%).
UNIVARIATE AND MULTIVARIATE COX REGRESSION ANALYSIS:
Univariate and multivariate models were established in sequence to select factors that could significantly influence OS. Hazard ratios (HR) were assessed to quantify the influence on OS (Table 2). Univariate analysis showed that age ≥60 years (HR, 1.140; 95% CI, 0.781–1.664; P<0.05), Fuhrman grade III (HR, 1.590; 95% CI, 1.335–1.894; P<0.05), IV (HR, 3.685; 95% CI, 2.925–4.643; P<0.05), unknown (HR, 1.630; 95% CI, 1.361–1.952; P<0.05), T2 (HR, 1.779; 95% CI, 1.564–2.204; P<0.05), T3 (HR, 2.737; 95% CI, 2.434–3.077; P<0.05), T4 (HR, 7.103; 95% CI, 5.139–9.817; P<0.05), TX (HR, 4.824; 95% CI, 3.491–6.666; P<0.05), M1 (HR, 11.212; 95% CI, 9.711–12.945; P<0.05), PN (HR, 0.131; 95% CI, 0.110–0.156; P<0.05), nephrectomy (HR, 0.329; 95% CI, 0.281–0.384; P<0.05), lymphadenectomy of 1–3 regional lymph nodes (HR, 1.844; 95% CI, 1.565–2.713; P<0.05), lymphadenectomy of ≥4 regional lymph nodes (HR, 2.138; 95% CI, 1.778–2.507; P<0.05), chemotherapy (HR, 7.244; 95% CI, 6.180–8.491; P<0.05) could be considered as independent OS predictors for patients with papillary RCC. The findings of multivariate analyses for the training cohort are also shown in Table 2. All variables, except race, sex, and lymphadenectomy, showed positive statistical significance. However, chemotherapy is a risk factor for survival, which is inconsistent with previous studies [22–24]. We consider that this may be due to retrospective bias, so it was not included in the model. Overall, the prognostic variables with statistical significance had the potential to predict the OS associated with papillary RCC effectively.
NOMOGRAM CONSTRUCTION FOR 3-YEAR, 5-YEAR, AND 10-YEAR OS:
The results of univariate and multivariate Cox regression analyses are presented in Table 2. Combined with clinical practice, the following variables were considered independent risk factors: age, gender, TNM classification, Fuhrman grade, surgery of primary sites, and marital status. On the basis of these factors, the nomogram was established for estimating the 3-year, 5-year, and 10-year OS for the training cohort, shown in Figure 1, where linear parallel lines show the nomogram model.
VALIDATION OF THE NOMOGRAM:
Internal validation using the training and validation cohorts showed the C-indices (0.752, 95% CI, 0.740–0.746; 0.747, 95% CI, 0.735–0.759, respectively), indicating improved predictive efficacy compared with TNM stage (0.643, 95% CI, 0.629–0.657; 0.642, 95% CI, 0.630–0.654, respectively), which specifically indicated the good discriminative ability of the nomogram (Figure 2). The calibration plots showed the nomogram’s significance in training and validation cohorts (Figure 3). The nomogram showed enhanced discrimination and accuracy in predicting values for the 3-year, 5-year, and 10-year OS.
The NRI and IDI values for the 3-year, 5-year, and 10-year OS in the training and validation cohorts were calculated, respectively. The results are listed in Table 3, Figures 4, and 5. The results suggest that the new model had significantly improved accuracy and reliability for cancer prediction compared with the TNM staging system.
POTENTIAL APPLICATION OF THE NOMOGRAM IN CLINICAL PRACTICE:
To further explore the application of the new model for decision making in clinical practice, the DCA in the training and validation cohorts were mapped based on the above analysis. For most patients, the new model provided increased net benefits relative to those provided by the TNM staging system, which is an advanced and efficient tool for decision making in clinical practice (Figure 6).
Discussion
This study developed a predictive nomogram for midterm to long-term prognosis in patients with papillary renal cell carcinoma (RCC) based on data from the US Surveillance, Epidemiology, and End Results (SEER) program and included a large number of clinical samples. A series of variables were screened by clinical significance to construct and validate the performance of the model. The new model may provide the basis for future clinical decisions. RCC accounts for about 85% of adult renal malignancies [8,15]. RCC is the most common type of renal malignancy, and papillary RCC accounts for 10–20% of all RCC cases [15]. However, compared with other types of RCC, papillary RCC lacks specific clinical manifestations and related symptoms and is also difficult to identify by preoperative imaging, and its biological behavior is still not fully understood [25,26]. According to previous studies, the prognosis of patients with papillary RCC is generally better than for other types of RCC. Patard et al. showed that the 5-year survival rates of RCC, papillary RCC, and chromophobe RCC were 73.2%, 79.4%, and 87.9%, respectively [27]. However, there is a lack of a concise and effective tool to predict prognosis in patients with papillary RCC individually in clinical practice, apart from the TNM staging system.
A nomogram is a graphic tool widely used as a predictive model that integrates biological, clinical, and social variables to estimate the risk of specific diseases [28,29]. Nevertheless, considering that numerous prognostic factors of papillary RCC have been identified in clinical practice, the high variability in sequelae observed in individual patients is not expected to be predictable based on any single factor. Compared with the conventional TNM tumor staging system, the nomogram showed enhanced accuracy in predicting survival outcomes, which benefited both clinicians and patients in counseling and personalized treatment [30,31]. Currently, no prognostic nomogram has been constructed for patients with papillary RCC. Therefore, it is necessary to construct a more reliable and precise prognostic model.
In this study, a new nomogram was established to estimate the prognosis of patients with papillary RCC, assisting in the development of therapeutic strategies for patients with papillary RCC. The annual incidence of papillary RCC was relatively rare, indicating that single-center studies were generally unable to reach reliable conclusions based on significant sample sizes [32]. Consequently, the scope of this study relied on the SEER program, a large sample database that was initially established by eight registries in 1973, with other institutes enrolling in the last few decades. At this time, the database covered 18 geographically different areas containing 26% of the US population, displaying the population’s diversity comprehensively [33,34]. For establishing reliable results, data for 13 926 patients diagnosed with papillary RCC from 1997 to 2014 were extracted from the SEER database. Among the included cases, most (61.86%) were ≥60 years old. Our sampling pool was consistent with that in the previous research, considering that most of the patients were elderly, male, white, married, and treated with surgery [2,5,35]. Also, older patients had a relatively high incidence of papillary RCC, in line with previous work, and accordingly, the prognosis was generally worse than that of younger people [7,36]. These results are shown graphically in our nomogram. As the age increased, the survival rates for papillary RCC remained quite dismal. In clinical practice, the TNM classification was the conventional method for evaluating the prognosis of cancers [26,28]. The TNM categories contributed to the prognosis and treatment of cancers. Depending on the enlarged tumor size, multiple occurrences of metastatic lymph nodes, and the onset of distant metastasis, the risk of mortality could be increased to a large extent [37], which has been supported by previous studies [8,15]. However, besides the TNM system, various risk factors for poor prognosis of cancer were also suggested. For example, the impact of mental health has garnered increasing attention in recent years [38]. Specifically, marital status significantly affected OS in this study. Married patients tended to receive more support and emotional comfort from family, which possibly led to a better prognosis [38,39].
The Fuhrman grade was another independent factor for OS, as shown by the new model presented in this stud, High-grade surgery was a protective factor, indicating better prognostic outcome; conversely, patients with lower-grade surgery tended to have worse prognostic outcomes. In contrast to previous research, tumor grade was not identified as a significant independent risk in prognosis [14,18]. In 2005, John et al. found that papillary RCC did not cause significantly different outcomes during follow-up [18]. The conflicting data may be caused by different research methodologies, differences in data sources, study duration, and inclusion and exclusion criteria. Therefore, in-depth research based on an extended sample size would be required in the future.
In line with previous studies, patients with papillary RCC were less likely to show disease-specific symptoms, compared with patients with clear cell and chromophobe RCC [28]. Benefitting from improved biological and imaging technology, patients with minimal metastatic disease had a chance to be identified early, thus improving the prognosis of papillary RCC. In this study, patients who received PN presented with increased OS compared with those who received radical nephrectomy (RN). Many retrospective studies suggest that patients undergo nephron-sparing surgery (NSS) related to RN [40,41]. Also, NSS was recommended as the standard surgical approach for T1a (TNM classification) for renal tumors [42]. RN was widely utilized for cT1b tumors, while it was also a recommended therapy for T2a (TNM classification) and other tumors with relatively large sizes [32,33]. Mir et al. considered that young patients undergoing PN had reduced masses, which might result in improved prognosis. However, patients with solitary RCC who received surgical treatment had a better prognostic outcome; this highlights the necessity of surgical treatment for better renal function outcomes [43]. A decrease in renal function could contribute to an increased risk of severe cardiovascular disease, as well as all-cause mortality [44]. In a meta-analysis, Kim et al. [45] analyzed the risk of severe chronic renal failure and all-cause mortality for patients undergoing NSS. Consequently, there were 61% and 19% reductions, respectively. Also, based on the preservation of renal function and the reduced risks of cardiovascular events and other adverse effects, such as new-onset hypertension, cerebrovascular disease, and diabetes, the prognosis of patients could be effectively improved with the surgical procedure.
However, routine lymph node dissection and the scope of cleansing in RN are still controversial. Generally, RN regional lymph node dissection should include the renal hilar lymph nodes, para-aortic and inferior vena cava, up to the level of the upper pole of the kidney, and down to the level of the infrarenal pole for enlarged lymph node dissection and the need for the aorta after the regional lymph node dissection. At the vena cava, the tissue is removed up to the angle of the diaphragm and down to the bifurcation of the abdominal aorta. In this study, although regional lymph node dissection was not significantly associated with OS, considering the clinical experiences and follow-up results, we supposed that regional lymph node dissection might have a significant impact on prognosis; thus, it was included as a crucial prognostic factor in our new model. Nevertheless, Michael et al. suggested that lymph node dissection could help patients with RCC who have only lymph node metastasis without distant metastasis, by significantly improving the patient’s 5-year survival rate [46]. For patients with both lymph nodes and distant metastases, lymph node dissection could effectively reduce tumor cells. The function, however, was reported with increased clinical significance in regional lymph node dissection and enlarged lymph node dissection. Lymph node dissection could reduce the number of tumor cells in patients with lymph nodes and distant metastases. However, more reports indicated that the 5-year survival rates associated with regional lymph node dissection and enlarged lymph node dissection were statistically indistinguishable [47]. Manohar et al. reported that the metastatic rate of T3–T4 renal cancer lymph nodes were 20%, and regional lymph node dissection was recommended [48]. For this reason, although considerable controversy was ongoing regarding the scope of lymph node dissection, there was a consensus that surgery could provide certain improvements in prognosis.
Finally, the newly constructed nomogram model in our study included multiple factors, such as age at diagnosis, gender, race, TNM classification, Fuhrman grade, surgery of the primary site, lymphadenectomy, and marital status, which were readily accessible for information collection in clinical practice. Figure 6 shows the results of DCA, indicating that the abscissa and ordinate were the threshold probability and net benefit rate, respectively [21,49,50]. So far, IDI, NRI, and DCA were adopted to verify the accuracy and predictive abilities of nomograms for papillary RCC. In conclusion, the nomogram was validated to accurately predict the 3-year, 5-year, and 10-year OS for patients with papillary RCC.
This study had several limitations. First, the nomogram relied on retrospective data from the SEER database, which could potentially lead to selection bias. Second, some candidate prognostic variables were unavailable, including subtype of papillary RCC (type I and type II), surgical margin status, vascular invasion, surgical treatment details, and other non-surgical treatments, such as radiation therapy and targeted therapy [14,51]. These unavailable data in the SEER dataset should be highlighted for the follow-up research. Furthermore, considering the retrospective nature of our research, our results should be further validated with a clinical trial or prospective cohort. Finally, although the accuracy exceeded that of the TNM classification, our nomogram was not optimized.
Conclusions
This study aimed to develop a predictive nomogram for midterm to long-term prognosis in patients with papillary renal cell carcinoma (RCC) based on data from the US Surveillance, Epidemiology, and End Results (SEER) program. The nomogram that was developed evaluated the prognosis of papillary RCC and identified the patients who required specialized treatment. However, external validation of the predictive nomogram is required that also includes patients from other countries.
Figures
Figure 1. Nomograms for 3-year, 5-year, and 10-year overall survival (OS) for patients with papillary renal cell carcinoma (RCC). OS – overall survival; RCC – renal cell carcinoma. Figure 2. Receiver operating characteristic (ROC) plots were constructed to compare the TNM classification and the newly established nomogram, by the area under the ROC curve (AUC). (A) From the training cohort. (B) From the validation cohort. A and B are based on the TNM classification. (C) From the training cohort. (D) From the validation cohort. C and D are based on the nomogram. Figure 3. The calibration curves for the 3-year, 5-year, and 10-year overall survival (OS) for the training cohort (A, C, E) and validation cohort (B, D, F). Figure 4. The net reclassification improvement (NRI) plots for the 3-year, 5-year, and 10-year overall survival (OS) for the training cohort (A, C, E) and validation cohort (B, D, F). Figure 5. The integrated discrimination improvement (IDI) plots for the 3-year, 5-year, and 10-year overall survival (OS) for the training cohort (A, C, E) and validation cohort (B, D, F). Figure 6. The decision curve analysis (DCA) for the training cohort (A, C, E) and validation cohort (B, D, F) for the 3-year, 5-year, and 10-year overall survival (OS). In the figure, the red dotted line represents the new nomogram model. The black dotted line represents the TNM classification. All – assume all patients with papillary RCC survive; None – assume no patient with papillary RCC survived; DCA – decision curve analysis.Tables
Table 1. Clinicopathological characteristics of 13,926 patients with papillary renal cell carcinoma (RCC) from the database of the Surveillance, Epidemiology, and End Results (SEER) program. Table 2. Univariate and multivariate Cox regression model analysis of overall survival (OS) in the training cohort. Table 3. NRI and IDI for 3-, 5-, and 10-year overall survival in training cohort and validation cohort.References
1. Chow WH, Devesa SS, Warren JL, Fraumeni JF, Rising incidence of renal cell cancer in the United States: JAMA, 1999; 281; 1628-31
2. Chow W-H, Devesa SS, Contemporary epidemiology of renal cell cancer: Cancer J, 2008; 14; 288-301
3. Schrader AJ, Rauer-Bruening S, Olbert PJ, Incidence and long-term prognosis of papillary renal cell carcinoma: J Cancer Res Clin Oncol, 2009; 135; 799-805
4. Novara G, Martignoni G, Artibani W, Ficarra V, Grading systems in renal cell carcinoma: J Urol, 2007; 177; 430-36
5. Amin MB, Amin MB, Tamboli P, Prognostic impact of histologic Subtyping of adult renal epithelial neoplasms – An experience of 405 cases: Am J Surg Pathol, 2002; 26; 281-91
6. Amin MB, Corless CL, Renshaw AA, Papillary (chromophil) renal cell carcinoma: Histomorphologic characteristics and evaluation of conventional pathologic prognostic parameters in 62 cases: Am J Surg Pathol, 1997; 21; 621-35
7. Cheville JC, Lohse CM, Zincke H, Comparisons of outcome and prognostic features among histologic subtypes of renal cell carcinoma: Am J Surg Pathol, 2003; 27; 612-24
8. Margulis V, Tamboli P, Matin SF, Analysis of clinicopathologic predictors of oncologic outcome provides insight into the natural history of surgically managed papillary renal cell carcinoma: Cancer, 2008; 112; 1480-88
9. Motzer RJ, Bacik J, Mariani T, Treatment outcome and survival associated with metastatic renal cell carcinoma of non-clear-cell histology: J Clin Oncol, 2002; 20; 2376-81
10. Dralle H, Musholt TJ, Schabram J, German Association of Endocrine Surgeons practice guideline for the surgical management of malignant thyroid tumors: Langenbecks Arch Surg, 2013; 398; 347-75
11. Daugherty M, Sedaghatpour D, Shapiro O, The metastatic potential of renal tumors: Influence of histologic subtypes on definition of small renal masses, risk stratification, and future active surveillance protocols: Urol Oncol, 2017; 35(4); 153.e15-20
12. Shuch B, Amin A, Armstrong AJ, Understanding pathologic variants of renal cell carcinoma: Distilling therapeutic opportunities from biologic complexity: Eur Urol, 2015; 67; 85-97
13. Gettman MT, Blute ML, Spotts B, Pathologic staging of renal cell carcinoma: Significance of tumor classification with the 1997 TNM staging system: Cancer, 2001; 91; 354-61
14. Leibovich BC, Lohse CM, Crispen PL, Histological subtype is an independent predictor of outcome for patients with renal cell carcinoma: J Urol, 2010; 183; 1309-15
15. Cairns P, Renal cell carcinoma: Cancer Biomark, 2011; 9; 461-73
16. Linehan WM, Spellman PT, Ricketts CJ, Comprehensive molecular characterization of papillary renal-cell carcinoma: N Engl J Med, 2016; 374; 135-45
17. Balachandran VP, Gonen M, Smith JJ, DeMatteo RP, Nomograms in oncology: More than meets the eye: Lancet Oncol, 2015; 16; E173-80
18. Cindolo L, Patard JJ, Chiodini P, Comparison of predictive accuracy of four prognostic models for nonmetastatic renal cell carcinoma after nephrectomy – A multicenter European study: Cancer, 2005; 104; 1362-71
19. Harrell FE, Lee KL, Mark DB, Multivariable prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors: Stat Med, 1996; 15; 361-87
20. Greenland S, The need for reorientation toward cost-effective prediction: Comments on ‘Evaluating the added predictive ability of a new marker: From area under the ROC curve to reclassification and beyond’ by M. J. Pencina et al., Statistics in Medicine: Stat Med, 2008; 27(2); 199-206
21. Vickers AJ, Elkin EB, Decision curve analysis: A novel method for evaluating prediction models: Med Decis Making, 2006; 26(6); 565-74
22. Escudier B, Pluzanska A, Koralewski P, Bevacizumab plus interferon alfa-2a for treatment of metastatic renal cell carcinoma: A randomised, double-blind phase III trial: Lancet, 2007; 370; 2103-11
23. Hudes G, Carducci M, Tomczak P, Temsirolimus, interferon alfa, or both for advanced renal-cell carcinoma: N Engl J Med, 2007; 356; 2271-81
24. Yap NY, Khoo WT, Perumal K, Practical updates in medical therapy for advanced and metastatic renal cell carcinoma: Urological Sci, 2018; 29; 120-28
25. Engels EA, Pfeiffer RM, Fraumeni JF, Spectrum of cancer risk among US solid organ transplant recipients: JAMA, 2011; 306; 1891-901
26. Motzer RJ, Escudier B, McDermott DF, Nivolumab versus everolimus in advanced renal-cell carcinoma: N Engl J Med, 2015; 373; 1803-13
27. Lu Y, Huang H, Kang M, Combined Ki67 and ERCC1 for prognosis in non-keratinizing nasopharyngeal carcinoma underwent chemoradiotherapy: Oncotarget, 2017; 8; 88552-62
28. Bianco FJ, Nomograms and medicine: Eur Urol, 2006; 50; 884-86
29. Lerner SP, Bochner B, Kibel AS, The use and abuse of data: Nomograms and talking to patients about clinical medicine: Urol Oncol-Semin Orig Investig, 2007; 25; 333-37
30. Brateanu A, Yu C, Kattan MW, A nomogram to predict the probability of passing the American Board of Internal Medicine examination: Med Educ Online, 2012; 17; 18810
31. Cao J, Yuan P, Wang L, Clinical nomogram for predicting survival of esophageal cancer patients after esophagectomy: Sci Rep, 2016; 6; 26684
32. Chow W-H, Dong LM, Devesa SS, Epidemiology and risk factors for kidney cancer: Nat Rev Urol, 2010; 7; 245-57
33. Wright JL, Dalkin BL, True LD, Positive surgical margins at radical prostatectomy predict prostate cancer specific mortality: J Urol, 2010; 183; 2213-18
34. Zhang G, Wu Y, Zhang J, Nomograms for predicting long-term overall survival and disease-specific survival of patients with clear cell renal cell carcinoma: Onco Targets Ther, 2018; 11; 5535-44
35. Fergany AF, Hafez KS, Novick AC, Long-term results of nephron sparing surgery for localized renal cell carcinoma: 10-year followup: J Urol, 2000; 163; 442-45
36. Mejean A, Hopirtean V, Bazin JP, Prognostic factors for the survival of patients with papillary renal cell carcinoma: Meaning of histological typing and multifocality: J Urol, 2003; 170; 764-67
37. Uhlman DL, Nguyen P, Manivel JC, Epidermal growth factor receptor and transforming growth factor alpha expression in papillary and nonpapillary renal cell carcinoma: Correlation with metastatic behavior and prognosis: Clin Cancer Res, 1995; 1; 913-20
38. Zhou H, Zhang Y, Song Y, Marital status is an independent prognostic factor for pancreatic neuroendocrine tumors patients: An analysis of the Surveillance, Epidemiology, and End Results (SEER) database: Clin Res Hepatol Gastroenterol, 2017; 41; 476-86
39. Zhang G, Wu Y, Zhang J, Nomograms for predicting long-term overall survival and disease-specific survival of patients with clear cell renal cell carcinoma: Onco Targets Ther, 2018; 11; 5535-44
40. Zini L, Perrotte P, Capitanio U, Radical versus partial nephrectomy: Effect on overall and noncancer mortality: Cancer, 2009; 115; 1465-71
41. Huang WC, Elkin EB, Levey AS, Partial nephrectomy versus radical nephrectomy in patients with small renal tumors – is there a difference in mortality and cardiovascular outcomes?: J Urol, 2009; 181; 55-61
42. Ljungberg B, Bensalah K, Canfield S, EAU guidelines on renal cell carcinoma: 2014 update: Eur Urol, 2015; 67; 913-24
43. Karakiewicz PI, Briganti A, Chun FK, Multi-institutional validation of a new renal cancer-specific survival nomogram: J Clin Oncol, 2007; 25; 1316-22
44. Huang WC, Levey AS, Serio AM, Chronic kidney disease after nephrectomy in patients with renal cortical tumours: A retrospective cohort study: Lancet Oncol, 2006; 7; 735-40
45. Kim SP, Murad MH, Thompson RH, Comparative effectiveness for survival and renal function of partial and radical nephrectomy for localized renal tumors: A systematic review and meta-analysis: J Urol, 2012 [Epub ahead of print]
46. Harper JD, Spencer ES, Porter MP, Gore JL, Adoption of laparoscopic radical nephrectomy in the state of Washington: Urology, 2012; 79; 326-31
47. Gabr AH, Elsayed ER, Gdor Y, Obesity and morbid obesity are associated with a greater conversion rate to open surgery for standard but not hand assisted laparoscopic radical nephrectomy: J Urol, 2008; 180; 2357-62
48. Ganpule AP, Sharma R, Thimmegowda M, Laparoscopic radical nephrectomy versus open radical nephrectomy in T1-T3 renal tumors: An outcome analysis: Indian J Urol, 2008; 24; 39-43
49. Esteve-Pastor MA, Rivera-Caravaca JM, Roldan V, Long-term bleeding risk prediction in ‘real world’ patients with atrial fibrillation: Comparison of the HAS-BLED and ABC-Bleeding risk scores. The Murcia Atrial Fibrillation Project: Thromb Haemost, 2017; 117(10); 1848-58
50. Garcia-Fernandez A, Roldan V, Rivera-Caravaca JM, Does von Willebrand factor improve the predictive ability of current risk stratification scores in patients with atrial fibrillation?: Sci Rep, 2017; 7; 41565
51. Herrmann E, Trojan L, Becker F, Prognostic factors of papillary renal cell carcinoma: Results from a multi-institutional series after pathological review: J Urol, 2010; 183; 460-66
Figures
Tables
In Press
Clinical Research
Acupuncture Enhances Quality of Life and Disease Control in Chronic Spontaneous Urticaria Patients on Omali...Med Sci Monit In Press; DOI:
Review article
Sex and Population Variations in Nasopalatine Canal Dimensions: A CBCT-Based Systematic ReviewMed Sci Monit In Press; DOI:
Clinical Research
Cold Pressor Test Induces Significant Changes in Internal Jugular Vein Flow Dynamics in Healthy Young AdultsMed Sci Monit In Press; DOI: 10.12659/MSM.946055
Clinical Research
Serum Albumin-to-Creatinine Ratio Predicts One-Year Mortality in Elderly Patients with Non-ST-Elevation Acu...Med Sci Monit In Press; DOI: 10.12659/MSM.945516
Most Viewed Current Articles
17 Jan 2024 : Review article 6,057,747
Vaccination Guidelines for Pregnant Women: Addressing COVID-19 and the Omicron VariantDOI :10.12659/MSM.942799
Med Sci Monit 2024; 30:e942799
14 Dec 2022 : Clinical Research 1,850,872
Prevalence and Variability of Allergen-Specific Immunoglobulin E in Patients with Elevated Tryptase LevelsDOI :10.12659/MSM.937990
Med Sci Monit 2022; 28:e937990
16 May 2023 : Clinical Research 694,012
Electrophysiological Testing for an Auditory Processing Disorder and Reading Performance in 54 School Stude...DOI :10.12659/MSM.940387
Med Sci Monit 2023; 29:e940387
07 Jan 2022 : Meta-Analysis 258,273
Efficacy and Safety of Light Therapy as a Home Treatment for Motor and Non-Motor Symptoms of Parkinson Dise...DOI :10.12659/MSM.935074
Med Sci Monit 2022; 28:e935074