Assessing predictors for new post translational modification sites: A case study on hydroxylation

by Damiano Piovesan, Andras Hatos, Giovanni Minervini, Federica Quaglia, Alexander Miguel Monzon, Silvio C. E. Tosatto

Post-translational modification (PTM) sites have become popular for predictor development. However, with the exception of phosphorylation and a handful of other examples, PTMs suffer from a limited number of available training examples and sparsity in protein sequences. Here, proline hydroxylation is taken as an example to compare different methods and evaluate their performance on new experimentally determined sites. As a guide for effective experimental design, predictors require both high specificity and sensitivity. However, the self-reported performance may often not be indicative of prediction quality and detection of new sites is not guaranteed. We have benchmarked seven published hydroxylation site predictors on two newly constructed independent datasets. The self-reported performance is found to widely overestimate the real accuracy measured on independent datasets. No predictor performs better than random on new examples, indicating the refined models do not sufficiently generalize to detect new sites. The number of false positives is high and precision low, in particular for non-collagen proteins whose motifs are not conserved. As hydroxylation site predictors do not generalize for new data, caution is advised when using PTM predictors in the absence of independent evaluations, in particular for highly specific sites involved in signalling.

Make more money selling and advertising your products and services for free on Ominy market. Click here to start selling now

Paper source
Plos Journal

READ MORE  Human exposure to zoonotic malaria vectors in village, farm and forest habitats in Sabah, Malaysian Borneo

Ominy science editory team

A team of dedicated users that search, fetch and publish research stories for Ominy science.

Enable notifications of new posts OK No thanks