Assessment of CASP7 predictions for template‐based modeling targets

@article{Kopp2007AssessmentOC,
  title={Assessment of CASP7 predictions for template‐based modeling targets},
  author={J{\"u}rgen Kopp and Lorenza Bordoli and James N D Battey and Florian Kiefer and Torsten Schwede},
  journal={Proteins: Structure},
  year={2007},
  volume={69}
}
This manuscript presents the assessment of the template‐based modeling category of the seventh Critical Assessment of Techniques for Protein Structure Prediction (CASP7). The accuracy of predicted protein models for 108 target domains was assessed based on a detailed comparison between the experimental and predicted structures. The assessment was performed using numerical measures for backbone and structural alignment accuracy, and by scoring correctly modeled hydrogen bond interactions in the… Expand
Assessment of template based protein structure predictions in CASP9
TLDR
The results of the assessment of the CASP9 predictions in the category of template based modeling are presented, documenting the state of the art and highlighting areas for future developments. Expand
Assessment of template‐based modeling of protein structure in CASP11
TLDR
The results argue for a density‐driven approach in future CASP TBM assessments that accounts for the bimodal nature of these distributions instead of Z scores, which assume a unimodal, Gaussian distribution. Expand
Assessment of template‐based protein structure predictions in CASP10
TLDR
In CASP10, some 41,740 predicted models submitted by 150 predictor groups were assessed as TBM predictions and a superimposition‐independent RPF metric was used for comparing predicted protein structure models against experimental protein structures. Expand
Domain definition and target classification for CASP7
TLDR
Experimentally determined protein structures formed the basis of the CASP7 prediction assessments and were assigned to one or more tertiary structure prediction categories and where necessary were divided into structural domains. Expand
Evaluation of the template‐based modeling in CASP12
TLDR
Compared with the last CASP, two years ago, there have been significant improvements in a number of areas, particularly the accuracy of protein backbone atoms, accuracy of sequence alignment between models and available structures, and accuracy of modeling of sub‐structures not present in the closest template. Expand
Analysis of CASP8 targets, predictions and assessment methods
TLDR
The objective is to use their unique experience as former CASP5 assessors and CASP8 predictors to offer more insights into CASP targets and predictions based on expert analysis, and develop an assessment methodology tailored towards current challenges in the field. Expand
Assessment of ligand binding site predictions in CASP10
TLDR
The accuracy of computational methods aiming to predict such binding residues was evaluated within the “function prediction (prediction of binding sites, FN)” category of the critical assessment of protein structure prediction (CASP) experiment, showing the usefulness of such methods in predicting ligand binding residues. Expand
Evaluation of CASP8 model quality predictions
TLDR
It is observed that consensus‐based methods still perform significantly better than those accepting single models, similarly to what was concluded in the previous edition of the experiment. Expand
Assessment of CASP11 contact‐assisted predictions
TLDR
An overview of contact‐assisted predictions in the eleventh round of critical assessment of protein structure prediction (CASP11), which included four categories: predicted contacts, correct contacts, simulated sparse NMR contacts, and cross‐linking contacts, highlighted a relatively poor overall performance. Expand
Evaluation of template‐based models in CASP8 with standard measures
TLDR
The detailed workflow of the procedure is described, justifications for a number of choices that are customarily made for CASP data evaluation are provided, and the results of the analysis of template‐based predictions at CASP8 are reported. Expand
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 21 REFERENCES
Assessment of predictions submitted for the CASP6 comparative modeling category
TLDR
Interestingly it was able to show that predictors were not predicting these important functional regions with any greater accuracy than the rest of the structure, and the ability of predictors to build models that improve on the structural template was investigated. Expand
Domain definition and target classification for CASP7
TLDR
Experimentally determined protein structures formed the basis of the CASP7 prediction assessments and were assigned to one or more tertiary structure prediction categories and where necessary were divided into structural domains. Expand
Assessment of CASP7 predictions in the high accuracy template‐based modeling category
Models for target domains in the high accuracy template‐based modeling category were assessed according to a number of criteria evaluating the quality of the main‐chain prediction (GDT‐HA), predictedExpand
Assessment of CASP7 structure predictions for template free targets
TLDR
There was a sense of progress in template FM relative to CASP6, but the ability to demonstrate this progress objectively was unable to be demonstrated. Expand
Assessment of fold recognition predictions in CASP6
TLDR
The Sixth Community Wide Experiment on the Critical Assessment of Techniques for Protein Structure Prediction (CASP6) held in December 2004 focused on the prediction of the structures of 90 protein domains from 64 targets, resulting in 4527 predictions from 165 groups. Expand
Assessment of homology‐based predictions in CASP5
TLDR
This report describes the assessment of the homology‐based predictions submitted to the fifth edition of the Critical Assessment of Methods for Protein Structure Prediction (CASP5) experiment and derived some general conclusions about the state of the art of comparative modeling methods and their usefulness for experimentalists. Expand
Assessment of predictions in the model quality assessment category
TLDR
Evaluation of the predictions submitted to the model quality assessment (QA) category in CASP7 demonstrates that a respectable accuracy in this task can be achieved by methods relying on the comparison of different models for the same target. Expand
MAMMOTH (Matching molecular models obtained from theory): An automated method for model comparison
TLDR
A new method for sequence‐independent structural alignment is presented that allows comparison of an experimental protein structure with an arbitrary low‐resolution protein tertiary model and finds that the new approach correlates better than other tools with the gold standard provided by a human evaluator. Expand
Assessment of progress over the CASP experiments
TLDR
Overall, these results indicate that there are still no effective methods of improving model quality beyond that obtained by successfully copying a template structure, and there is some evidence that more groups are producing top‐quality models, however. Expand
Domain definition and target classification for CASP6
Assessment of structure predictions in CASP6 was based on single domains isolated from experimentally determined structures, which were categorized into comparative modeling, fold recognition, andExpand
...
1
2
3
...