• Corpus ID: 17671651

The Detection of Human Spreadsheet Errors by Humans versus Inspection (Auditing) Software

@article{Aurigemma2010TheDO,
  title={The Detection of Human Spreadsheet Errors by Humans versus Inspection (Auditing) Software},
  author={Salvatore Aurigemma and Raymond R. Panko},
  journal={ArXiv},
  year={2010},
  volume={abs/1009.2785}
}
Previous spreadsheet inspection experiments have had human subjects look for seeded errors in spreadsheets. In this study, subjects attempted to find errors in human-developed spreadsheets to avoid the potential artifacts created by error seeding. Human subject success rates were compared to the successful rates for error-flagging by spreadsheet static analysis tools (SSATs) applied to the same spreadsheets. The human error detection results were comparable to those of studies using error… 

Figures from this paper

Finding errors in the Enron spreadsheet corpus
  • T. Schmitz, D. Jannach
  • Computer Science
    2016 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC)
  • 2016
TLDR
This work proposes a method and tool to identify realworld formula errors within the Enron spreadsheet corpus based on heuristics that help us identify versions of the same spreadsheet and software helps the user identify spreadsheets of which they assume that they contain error corrections.
Auditing spreadsheets: With or without a tool?
TLDR
The results of these interviews indicate that spreadsheet tools support a more effective and efficient audit of spreadsheets; the visualization feature in particular is mentioned by the auditors as being highly supportive for their audit task, whereas the risk feature was deemed of lesser value.
Smelling Faults in Spreadsheets
TLDR
A technique to automatically pinpoint potential faults in spreadsheets is proposed, which combines a catalog of spreadsheet smells that provide a first indication of a potential fault, with a generic spectrum-based fault localization strategy in order to improve on these initial results.
Automated model-based spreadsheet debugging
TLDR
Several new algorithmic enhancements of the general MBD approach are combined in this thesis to allow spreadsheet users to debug their spreadsheets and to efficiently find the reason of the observed unexpected output values.
Combining Smells and Fault Localization in Spreadsheets
TLDR
A technique to automatically pinpoint potential faults in spreadsheets is proposed, which combines a catalog of spreadsheet smells that provide a first indication of a potential fault, with a generic spectrumbased fault localization strategy in order to improve on these initial results.
How effectively can spreadsheet anomalies be detected: An empirical study
Analyzing and Visualizing Spreadsheets
TLDR
This dissertation aims at developing methods to support spreadsheet users to understand, update and improve spreadsheets and found that methods from software engineering can be applied to spreadsheets very well, and that these methods support end-users in working with spreadsheets.
Automated refactoring of nested-IF formulae in spreadsheets
TLDR
This paper proposes the first exploration of the nest-if usage status against two large-scale spreadsheet corpora containing over 80,000 industry-level spreadsheets and reveals that the approach is able to relieve the smell of over 90% of nested-IF formulae.
The Future of Spreadsheets in the Big Data Era
TLDR
The views of the participants on the reasons for the success of the spreadsheet, the trends driving change and the likely directions of change for the spreadsheet are records and key directions for further research in the evolution and use of spreadsheets are set.
...
...

References

SHOWING 1-10 OF 25 REFERENCES
Spreadsheet Auditing Software
TLDR
This paper documents and tests office software tools designed to assist in the audit of spreadsheets to identify the success of software tools in detecting different types of errors, to identify how the software tools assist the auditor and to determine the usefulness of the tools.
Applying Code Inspection to Spreadsheet Testing
  • R. Panko
  • Business
    J. Manag. Inf. Syst.
  • 1999
TLDR
Findings were that subjects were overconfident when inspecting alone, that certain types of errors are especially difficult to detect, and that the benefits of the group phase is greatest for these difficult-to-detect type of errors.
Factors Affecting the Ability to Detect Spreadsheet Errors
TLDR
The subject of spreadsheet error detection is examined in detail and an experiment designed to identify those factors influencing the error-detection capabilities of a sample of spreadsheet users is described.
Spreadsheet Presentation and Error Detection: An Experimental Study
The pervasiveness and impact of electronic spreadsheets have generated serious concerns about their integrity and validity when used in significant decision-making settings. Previous studies have
Two corpuses of spreadsheet errors
  • R. Panko
  • Education
    Proceedings of the 33rd Annual Hawaii International Conference on System Sciences
  • 2000
TLDR
This paper presents two corpora of errors seen in spreadsheet experiments, hoping these corpora will help assess the claims of spreadsheet reduction approaches and should guide theory creation and testing.
An auditing protocol for spreadsheet models
Spreadsheet End-User Behaviour Analysis
TLDR
The design and application of a novel data acquisition tool, which can be used for the unobtrusive recording of end-users mouse, keyboard and Excel specific actions during the debugging of Excel spreadsheets, and developed a "spreadsheet cell coverage feedback" debugging tool.
An Exploratory Analysis of the Impact of Named Ranges on the Debugging Performance of Novice Users
TLDR
It is suggested that novice users debug on average significantly fewer errors if the spreadsheet contains named ranges, and this paper describes an exploratory empirical study of the effect of named ranges on spreadsheet debugging performance.
Recommended Practices for Spreadsheet Testing
TLDR
This paper presents the authors recommended practices for spreadsheet testing, and logic inspection appears to be feasible for spreadsheet developers to do and safe and effective for module testing.
...
...