• Corpus ID: 17050661

Concerning the Feasibility of Example-driven Modelling Techniques

@article{Thorne2008ConcerningTF,
  title={Concerning the Feasibility of Example-driven Modelling Techniques},
  author={Simon Thorne and David Ball and Zoe Lawson},
  journal={ArXiv},
  year={2008},
  volume={abs/0802.3477}
}
We report on a series of experiments concerning the feasibility of example driven modelling. The main aim was to establish experimentally within an academic environment; the relationship between error and task complexity using a) Traditional spreadsheet modelling, b) example driven techniques. We report on the experimental design, sampling, research methods and the tasks set for both control and treatment groups. Analysis of the completed tasks allows comparison of several different… 

Figures and Tables from this paper

Self-Checks In Spreadsheets: A Survey Of Current Practice
TLDR
A survey of 11 spreadsheets prepared by a range of organisations shows that the amount of self-testing included in such models ranges between one formula of testing for each three formulae of calculation, down to essentially no self- testing at all.

References

SHOWING 1-10 OF 22 REFERENCES
Factors influencing risks and outcomes in end-user development
TLDR
Results indicated that subjects using the methodology showed a significant reduction in the number of "linking errors", i.e., mistakes in creating links between values that must flow from one area of the spreadsheet to another or from one worksheet to another in a common workbook.
A Novel Approach to Formulae Production and Overconfidence Measurement to Reduce Risk in Spreadsheet Modelling
TLDR
A control experiment that compares example driven modelling against traditional approaches over several progressively more difficult tests is discussed and a method for statistically analysing the problem of overconfidence in spreadsheet modellers is proposed.
Experimental and Quasi-Experimental Designs for Generalized Causal Inference
1. Experiments and Generalized Causal Inference 2. Statistical Conclusion Validity and Internal Validity 3. Construct Validity and External Validity 4. Quasi-Experimental Designs That Either Lack a
Factors Affecting the Ability to Detect Spreadsheet Errors
TLDR
The subject of spreadsheet error detection is examined in detail and an experiment designed to identify those factors influencing the error-detection capabilities of a sample of spreadsheet users is described.
Reducing Overconfidence in Spreadsheet Development
TLDR
Two experiments in overconfidence in spreadsheet development are described, including a pilot study to determine the existence of overconfidence, and a manipulation to reduce overconfidence and errors.
On the Interpretation of χ2 from Contingency Tables, and the Calculation of P
On the Interpretation of X2 from Contingency Tables, and the Calculation of P. By R. A. FISHER, M.A. 87 On the Application of the x2 Method to Association and Contingency Talles, with Experimental
What we know about spreadsheet errors
TLDR
Although spreadsheet programs are used for small "scratchpad" applications, they are also used to develop many large applications, and error rates are in line with those in programming and other human cognitive domains.
Note on the sampling error of the difference between correlated proportions or percentages
Two formulas are presented for judging the significance of the difference between correlated proportions. The chi square equivalent of one of the developed formulas is pointed out.
...
...