The team of healthcare data scientists and doctors have developed and tested a system of computer-based ‘machine learning’ algorithms to predict the risk of early death due to chronic disease in a large middle-aged population.
They found this AI system was very accurate in its predictions and performed better than the current standard approach to prediction developed by human experts.
The study is published by PLOS ONE in a special collections edition of “Machine Learning in Health and Biomedicine.”
The team used health data from just over half a million people aged between 40 and 69 recruited to the UK Biobank between 2006 and 2010 and followed up until 2016.
Leading the work, Assistant Professor of Epidemiology and Data Science, Dr Stephen Weng, said:
“Preventative healthcare is a growing priority in the fight against serious diseases so we have been working for a number of years to improve the accuracy of computerised health risk assessment in the general population.
Most applications focus on a single disease area but predicting death due to several different disease outcomes is highly complex, especially given environmental and individual factors that may affect them.
“We have taken a major step forward in this field by developing a unique and holistic approach to predicting a person’s risk of premature death by machine-learning.
This uses computers to build new risk prediction models that take into account a wide range of demographic, biometric, clinical and lifestyle factors for each individual assessed, even their dietary consumption of fruit, vegetables and meat per day.
“We mapped the resulting predictions to mortality data from the cohort, using Office of National Statistics death records, the UK cancer registry and ‘hospital episodes’ statistics.
We found machine learned algorithms were significantly more accurate in predicting death than the standard prediction models developed by a human expert.”
The AI machine learning models used in the new study are known as ‘random forest’ and ‘deep learning’.
These were pitched against the traditionally-used ‘Cox regression’ prediction model based on age and gender found to be the least accurate at predicting mortality and also a multivariate Cox model which worked better but tended to over-predict risk.
Professor Joe Kai, one of the clinical academics working on the project, said:
“There is currently intense interest in the potential to use ‘AI’ or ‘machine-learning’ to better predict health outcomes. In some situations we may find it helps, in others it may not. In this particular case, we have shown that with careful tuning, these algorithms can usefully improve prediction.
“These techniques can be new to many in health research, and difficult to follow. We believe that by clearly reporting these methods in a transparent way, this could help with scientific verification and future development of this exciting field for health care.”
This new study builds on previous work by the Nottingham team which showed that four different AI algorithms, ‘random forest’, ‘logistic regression’, ‘gradient boosting’ and ‘neural networks’, were significantly better at predicting cardiovascular disease than an established algorithm used in current cardiology guidelines. This earlier study is available here.
The Nottingham researchers predict that AI will play a vital part in the development of future tools capable of delivering personalised medicine, tailoring risk management to individual patients.
Further research requires verifying and validating these AI algorithms in other population groups and exploring ways to implement these systems into routine healthcare.