Assessment of predictions submitted for the CASP6 comparative modeling category

@article{Tress2005AssessmentOP,
  title={Assessment of predictions submitted for the CASP6 comparative modeling category},
  author={Michael L. Tress and Iakes Ezkurdia and Osvaldo Gra{\~n}a and Gonzalo L{\'o}pez and Alfonso Valencia},
  journal={Proteins: Structure},
  year={2005},
  volume={61}
}
Here we present a full overview of the Critical Assessment of Protein Structure Prediction (CASP6) comparative modeling category. Prediction accuracy for the 43 comparative modeling targets was assessed through detailed numerical comparisons between predicted and experimental structures. Assessments using standard measures for model backbone quality and structural alignment accuracy highlighted a small number of groups with stand out predictions and these findings were backed up by statistical… Expand
Assessment of CASP7 predictions for template‐based modeling targets
TLDR
The accuracy of predicted protein models for 108 target domains was assessed based on a detailed comparison between the experimental and predicted structures and it showed that the best groups produced models closer to the target structure than the best single template for a significant number of targets. Expand
Evaluation of CASP8 model quality predictions
TLDR
It is observed that consensus‐based methods still perform significantly better than those accepting single models, similarly to what was concluded in the previous edition of the experiment. Expand
Assessment of template‐based modeling of protein structure in CASP11
TLDR
The results argue for a density‐driven approach in future CASP TBM assessments that accounts for the bimodal nature of these distributions instead of Z scores, which assume a unimodal, Gaussian distribution. Expand
Protein structure prediction: challenging targets for CASP10
  • Ashish Runthala
  • Computer Science, Medicine
  • Journal of biomolecular structure & dynamics
  • 2012
TLDR
There is a great need to focus some key issues for bridging the major though considered trivial gaps, in the upcoming CASP to pave and demarcate the correct way of developing a consistently accurate prediction methodology in the near future. Expand
Evaluation of the template‐based modeling in CASP12
TLDR
Compared with the last CASP, two years ago, there have been significant improvements in a number of areas, particularly the accuracy of protein backbone atoms, accuracy of sequence alignment between models and available structures, and accuracy of modeling of sub‐structures not present in the closest template. Expand
Assessment of predictions in the model quality assessment category
TLDR
Evaluation of the predictions submitted to the model quality assessment (QA) category in CASP7 demonstrates that a respectable accuracy in this task can be achieved by methods relying on the comparison of different models for the same target. Expand
(PS)2: protein structure prediction server
TLDR
An automatic protein structure prediction server, (PS)2, which uses an effective consensus strategy both in template selection and target–template alignment integrating PSI-BLAST, IMPALA and T-Coffee, and which is considerably faster than other methods that rely on the additional structural consensus of templates. Expand
Benchmarking template selection and model quality assessment for high‐resolution comparative modeling
TLDR
It is demonstrated that if models are built and model quality is assessed in combination with the sequence‐template sequence similarity that a extra 7% of “best” models can be found. Expand
Assessment of CASP7 predictions in the high accuracy template‐based modeling category
Models for target domains in the high accuracy template‐based modeling category were assessed according to a number of criteria evaluating the quality of the main‐chain prediction (GDT‐HA), predictedExpand
Assessment of CASP10 contact‐assisted predictions
TLDR
The objective of the experiment was to measure model quality improvement resulting from the added contact information and thereby assess and help develop so‐called hybrid prediction methods—methods where some experimentally determined distance constraints are used to augment de novo computational prediction methods. Expand
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 23 REFERENCES
Analysis and assessment of comparative modeling predictions in CASP4
TLDR
Analysis of the comparative modeling predictions submitted to the fourth round of Critical Assessment of Structure Prediction (CASP4) assesses their ability to predict the overall fold correctly, the relative orientation of domains in multidomain proteins, the conformation of the side chains, the loop regions, and the biologically important residues of the targets. Expand
Assessment of homology‐based predictions in CASP5
TLDR
This report describes the assessment of the homology‐based predictions submitted to the fifth edition of the Critical Assessment of Methods for Protein Structure Prediction (CASP5) experiment and derived some general conclusions about the state of the art of comparative modeling methods and their usefulness for experimentalists. Expand
Assessment of progress over the CASP experiments
TLDR
Overall, these results indicate that there are still no effective methods of improving model quality beyond that obtained by successfully copying a template structure, and there is some evidence that more groups are producing top‐quality models, however. Expand
LiveBench‐1: Continuous benchmarking of protein structure prediction servers
TLDR
A novel, continuous approach aimed at the large‐scale assessment of the performance of available fold‐recognition servers, which found that all servers were able to find the correct answer for the vast majority of the easy targets if a structurally similar fold was present in the server's fold libraries. Expand
EVA: evaluation of protein structure prediction servers
TLDR
EVA (http://cubic.columbia.edu/eva/) is a web server for evaluation of the accuracy of automated protein structure prediction methods, and provides useful information to developers as well as users of prediction methods. Expand
Empirical limits for template‐based protein structure prediction: the CASP5 example
TLDR
It is found that even in the absence of alignment errors and using optimal templates, template‐based methods have intrinsic limitations, suggesting that other methodologies, such as ab initio procedures, must be used if accuracy is ultimately to be improved. Expand
3D-Jury: A Simple Approach to Improve Protein Structure Predictions
TLDR
The goal for the development of the 3D-Jury system is to create a simple but powerful procedure for generating meta-predictions using variable sets of models obtained from diverse sources to improve the quality of structural annotations of novel proteins. Expand
Progress over the first decade of CASP experiments
TLDR
Models of previously unknown folds again appear to have modestly improved, and several mixed α/β structures have been modeled in a topologically correct manner. Expand
Domain definition and target classification for CASP6
Assessment of structure predictions in CASP6 was based on single domains isolated from experimentally determined structures, which were categorized into comparative modeling, fold recognition, andExpand
Defrosting the frozen approximation: PROSPECTOR— A new approach to threading
TLDR
Overall, these studies show that the use of pair interactions as assessed by the improved Z‐score enhances the specificity of probe‐template matches. Expand
...
1
2
3
...