On Building Prediction Systems for Software Engineers

  title={On Building Prediction Systems for Software Engineers},
  author={Martin J. Shepperd and Michelle Cartwright and Gada F. Kadoda},
  journal={Empirical Software Engineering},
Building and evaluating predictionsystems is an important activity for software engineering researchers.Increasing numbers of techniques and datasets are now being madeavailable. Unfortunately systematic comparison is hindered bythe use of different accuracy indicators and evaluation processes.We argue that these indicators are statistics that describe propertiesof the estimation errors or residuals and that the sensible choiceof indicator is largely governed by the goals of the estimator.For… 
An analysis of Monte Carlo simulations for forecasting software projects
It is suggested that Monte Carlo simulations may be used in practice for delivery date and effort forecasting in agile projects, after a few initial sprints.
An effort prediction model for data-centred fourth-generation-language software development
The effect of developers’ productivity on effort prediction is investigated and has found that inclusion of productivity improves the models’ prediction accuracy further, however, additional studies will be required in order to establish the best productivity inclusive effort prediction model.
Sequential Model Optimization for Software Process Control
This work applies a configuration technique called ``ROME'' (Rapid Optimizing Methods for Estimation), which uses sequential model-based optimization (SMO) to find what combination of effort estimation techniques works best for a particular data set.
Imputation Techniques for Software Engineering : Case for Support
The proposed work fits with current and planned research carried out by ESERG, which has focused on improving effort prediction for software development projects, for instance, applying a variety of machine learning techniques.
Why Software Effort Estimation Needs SBSE
OIL (short for optimized learning), a novel configuration tool for effort estimation based on differential evolution, is introduced and SBSE should be a standard component of software effort estimation.
Lessons from applying experimentation in software engineering prediction systems
  • W. Afzal
  • Computer Science, Engineering
    APSEC 2008
  • 2008
It is found that the typical software engineering experimentation process in software engineering is supportive in developing prediction systems and has highlighted issues more central to the domain of software engineering prediction systems.
Software Development Effort Estimation: A Review
Software development effort estimation is the process of calculating the effort required to develop or maintain software based on the input, which is partial, tentative and/or strident. Efficient
A Generic Analogy-Centered Software Cost Estimation Based on Differential Evolution Exploration Process
A novel analogy-centered model based on differential evolution exploration process is proposed in this research study and it is suggested that the proposed model be considered as the preliminary stage of any analogy-based software estimation technique.


An empirical validation of software cost estimation models
Four of the most popular algorithmic models used to estimate software costs (SLIM, COCOMO, Function Points, and ESTIMACS) are evaluated, finding that all of the models tested failed to sufficiently reflect the underlying factors affecting productivity.
Human performance estimating with analogy and regression models: an empirical validation
  • E. Stensrud, I. Myrtveit
  • Computer Science
    Proceedings Fifth International Software Metrics Symposium. Metrics (Cat. No.98TB100262)
  • 1998
The results in terms of MMRE indicate that users benefit from both tools, however more from regression models than from analogy models as ANGEL, which is contradictory to previous studies that claim that ANGEL outperforms multiple regression.
Estimating Software Project Effort Using Analogies
It is argued that estimation by analogy is a viable technique that, at the very least, can be used by project managers to complement current estimation techniques.
The MERMAID Approach to software cost estimation
This paper presents an analysis of the problems in the field of software cost models and describes the MERMAID approach to cost estimation, which makes intensive use of local historical project data and is applicable in all sectors where project data can be collected.
Calibrating estimation tools for software development
This paper uses data collected from six commercial organisations on 112 software projects to investigate the extent to which organisations need to calibrate software cost estimation tools to their own environment.
Assessing Software Cost Estimation Models: criteria for accuracy, consistency and regression
Examination of existing measures of estimation accuracy and consistency is examined and two new ones are proposed: the weighted mean of quartiles of relative errors (WMQ) and the standard deviation of the ratios of the estimate to actual observation (SDR) as a measure of consistency.
An investigation of analysis techniques for software datasets
It is found that standard multivariate regression techniques were best if the data only exhibited skewness, however, under more extreme conditions such as severe heteroscedasticity, the nonparametric residual analysis technique performed best.
A Method of Programming Measurement and Estimation
A method of programming project productivity estimation is discussed and preliminary results of research into methods of measuring and estimating programming project duration, staff size, and computer cost are presented.