Combining classical and machine learning methods in Survival Analysis

Survival analysis deals with the longitudinal data and estimates both the distribution of time-to-event in a population over the observation time, and how the time-to-event depends on the risk factors. Various statistical models were developed for such analysis, including Cox proportional hazards (Cox PH) model, accelerated failure time model, parametric models, and others. With the development of machine learning, the toolset for survival analysis has further expanded with models such as survival random forest, survival xgboost and others. Although the new models are effective in dealing with large and complex data, they can be prone to overfitting and hard to interpret.
In this talk, Diana Shamsutdinova explored two different approaches combining the classical Cox PH model with tree-based algorithms, similar to the ideas presented in (1-4). The aim was not limited to boosting the predictive performance of the Cox regression with ML techniques, but also an attempt to 1) preserve interpretability of the results, 2) quantify contribution of linear and non-linear dependencies and 3) get insight into non-linear relationships. The first approach included the underlying Cox PH model, ensembled with the random forest in which survival probabilities obtained by the Cox PH model were added as a new risk factor along with the original factors. The second approach used survival tree algorithm to cluster the data, then separate Cox PH models were trained for each of the clusters.
Diana Shamsutdinova is a PhD student at Biostatistics and Health Informatics department at IoPPN, KCL and focuses on prediction modelling and survival analysis in health research. Diana graduated with Distinction from Moscow State University, with major in mathematics and applied mathematics, after which she worked for more than a decade in the financial industry. After completing a part-time MSc in Neuroscience and Psychology of Mental Health at IoPPN while working in finance, she pursued her interests in the new field. Presently she develops her PhD research at IoPPN under the supervision of Professor Daniel Stahl and Dr Angus Robert, and her main project is on predicting diabetes onset among people with severe mental illness.
Download a copy of the slides from the talk here: drive.google.com/file/d/1_2-N...
Prediction Modelling Group
The Prediction Modelling Group provides a forum for researchers at King's College London’s Institute of Psychiatry, Psychology & Neuroscience (IoPPN) and clinicians at South London and Maudsley NHS Foundation Trust, who are interested in prediction modelling applications for precision medicine.
For more information, please visit our webpages: www.maudsleybrc.nihr.ac.uk/fa...
#KingsCollegeLondon #IoPPN #NIHRMaudsleyBRC