The Chimera of Software Quality

@article{Hatton2007TheCO,
  title={The Chimera of Software Quality},
  author={Les Hatton},
  journal={Computer},
  year={2007},
  volume={40}
}
  • L. Hatton
  • Published 1 August 2007
  • Computer Science
  • Computer
Despite years of computing progress, today's systems experience spectacular and all-too-frequent crashes, while many enormously expensive projects fail to produce anything useful. Of equal importance, and potentially more damaging, are the misleading smaller defects we tend to miss. From time to time, we must remind ourselves that the underlying quality of the software that our results and progress increasingly depend on will likely be flawed and even more dependent on independent corroboration… 

Testing for trustworthiness in scientific software

  • D. HookD. Kelly
  • Computer Science
    2009 ICSE Workshop on Software Engineering for Computational Science and Engineering
  • 2009
The current research suggests that a small number of well chosen tests may reveal a high percentage of code faults in scientific software and allow scientists to increase their trust.

Metamorphic testing techniques to detect defects in applications without test oracles

An automated approach to metamorphic testing will advance the state of the art in detecting defects in programs without test oracles, particularly in the domains of machine learning, simulation, and optimization.

Bridging the Chasm

This article reviews the research that addresses the gap, exploring how both software engineering and research practice may need to evolve to accommodate the use of software in science.

When Software Crosses a Line

The debacle with the VW "defeat device" raises some unsettling questions about whether any other companies are using software practices almost as dubious as VW's, and how to decide what's reasonable, given software's extraordinary ability to give hardware its character.

Using Code Mutation to Study Code Faults in Scientific Software

MST is based on traditional mutation testing, but—in place of a focus on mutant “killing”—MST focuses on assessing the mutation sensitivity of a test set, and two observations are of particular interest to computational scientists.

Debunking the Myth That Upfront Requirements Are Infeasible for Scientific Computing Software

This paper shows requirements are feasible with the following: i) an appropriate perspective ('faking' the final documentation as if requirements were correct and complete from the start, and gathering requirements as if for a family of programs).

Formal Methods: From Academia to Industrial Practice. A Travel Guide

This paper investigates why the gap nevertheless still exists and provides its own recommendations on what can be done by the formal-methods-research community to bridge it, and focuses on the human aspect: how to achieve impact.

Evolutionary Sampling and Software Quality Modeling of High-Assurance Systems

A novel genetic algorithm-based data sampling method, named evolutionary sampling, is presented as a solution to improving software quality modeling for high-assurance systems and is empirically shown to be significantly better than most existing data sampling techniques.

Analysis of Field Data on Web Security Vulnerabilities

A field study on two of the most widely spread and critical web application vulnerabilities: SQL Injection and XSS is presented, which analyzes the source code of security patches of widely used Web applications written in weak and strong typed languages.