Challenges for Verifying and Validating Scientific Software in Computational Materials Science

  title={Challenges for Verifying and Validating Scientific Software in Computational Materials Science},
  author={T. Vogel and Stephan Druskat and M. Scheidgen and C. Ambrosch-Draxl and L. Grunske},
  journal={2019 IEEE/ACM 14th International Workshop on Software Engineering for Science (SE4Science)},
  • T. Vogel, Stephan Druskat, +2 authors L. Grunske
  • Published 2019
  • Computer Science
  • 2019 IEEE/ACM 14th International Workshop on Software Engineering for Science (SE4Science)
Many fields of science rely on software systems to answer different research questions. For valid results researchers need to trust the results scientific software produces, and consequently quality assurance is of utmost importance. In this paper we are investigating the impact of quality assurance in the domain of computational materials science (CMS). Based on our experience in this domain we formulate challenges for validation and verification of scientific software and their results… Expand
2 Citations
An environment for sustainable research software in Germany and beyond: current state, open challenges, and call for action
Challenges for research software sustainability in Germany and beyond are identified, in terms of motivation, selection, research software engineering personnel, funding, infrastructure, and legal aspects. Expand
In-code citation practices in open research software libraries
This study investigates the availability of a systematic method that allows for the linking of references and in-code citations and indicates that only six of the libraries investigated in this study had such a method, although many did not fully implement the method. Expand


Software Engineering for Computational Science: Past, Present, Future
A literature survey on software engineering practices in computational science identified 13 recurring key characteristics of scientific software development that are the result of the nature of scientific challenges, the limitations of computers, and the cultural environment of scientificSoftware development. Expand
Testing scientific software: A systematic literature review
Cultural differences between scientist developers and software engineers, along with the characteristics of the scientific software make testing more difficult, and existing techniques such as code clone detection can help to improve the testing process. Expand
Testing for trustworthiness in scientific software
  • D. Hook, D. Kelly
  • Computer Science
  • 2009 ICSE Workshop on Software Engineering for Computational Science and Engineering
  • 2009
The current research suggests that a small number of well chosen tests may reveal a high percentage of code faults in scientific software and allow scientists to increase their trust. Expand
Some Challenges Facing Scientific Software Developers: The Case of Molecular Biology
It is claimed that the nature and practice of molecular biology is quite different from that of the physical sciences and pose different problems to software developers. Expand
How do scientists develop and use scientific software?
The main conclusions are that the knowledge required to develop and use scientific software is primarily acquired from peers and through self-study, rather than from formal education and training and there is no uniform trend of association between rank of importance of software engineering concepts and project/team size. Expand
Five Recommended Practices for Computational Scientists Who Write Software
It could be many years before a consolidated handbook of software engineering techniques and approaches is available, but computational scientists can look to the practices of other scientists who write successful software. Expand
A survey of scientific software development
The use of IDEs and version control tools among the surveyed scientific software developers has increased, and trace-ability of scientific software is not as important to scientificSoftware developers as it is to scientific software users. Expand
Design and use of reference data sets for testing scientific software
Abstract A general methodology for evaluating the accuracy of the results produced by scientific software has been developed at the National Physical Laboratory. The basis of the approach is theExpand
Software Development Environments for Scientific and Engineering Software: A Series of Case Studies
Nine lessons learned from five representative projects are presented, along with their software engineering implications, to provide insight into the software development environments in this domain. Expand
Scientific Software Testing: Analysis with Four Dimensions
By analyzing our testing exercise through the four dimensions of context, goals, techniques, and adequacy, we developed a better understanding of how to effectively test a piece of scientificExpand