Patient-Reported Symptoms Improve Performance of Risk Prediction Models for Emergency Department Visits Among Patients With Cancer: A Population-Wide Study in Ontario Using Administrative Data

Published: July 8, 2019
Category: Bibliography
Authors: Lisa Barbera MD, Mehdi Rostami MSc, Rinku Sutradhar PhD
Countries: Canada
Language: English
Types: Care Management, Population Health
Settings: Hospital



Prior work shows measurements of symptom severity using the Edmonton Symptom Assessment System (ESAS) which are associated with emergency department (ED) visits in patients with cancer; however, it is not known if symptom severity improves the ability to predict ED visits.


To determine whether information on symptom severity improves the ability to predict ED visits among patients with cancer.


This was a population-based study of patients who were diagnosed with cancer and had at least one ESAS assessment completed between 2007 and 2015 in Ontario, Canada. After splitting the cohort into training and test sets, two ED visit risk prediction models using logistic regression were developed on the training cohort, one without ESAS and one with ESAS. The predictive performance of each risk model was assessed on the test cohort and compared with respect to area under the curve and calibration.


The full cohort consisted of 212,615 unique patients with a total of 1,267,294 ESAS assessments. The risk prediction model including ESAS was superior in sensitivity, specificity, accuracy, and discrimination. The area under the curve was 73.7% under the model with ESAS, whereas it was 70.1% under the model without ESAS. The model with ESAS was also better calibrated. This improvement in calibration was particularly noticeable among patients in the higher deciles of predicted risk.


This study demonstrates the importance of incorporating symptom measurements when developing an ED visit risk calculator for patients with cancer. Improved predictive models for ED visits using measurements of symptom severity may serve as an important clinical tool to prompt timely interventions by the cancer care team before an ED visit is necessary.

Emergency department, Symptom severity, Risk prediction models, Logistic regression, Area under curve, Calibration

Please log in/register to access.

Log in/Register

LinkedIn Facebook Twitter

© The Johns Hopkins University, The Johns Hopkins Hospital, and Johns Hopkins Health System.
All rights reserved. Terms of Use Privacy Statement

Back to top