Static test case prioritization using topic models

@article{Thomas2012StaticTC,
  title={Static test case prioritization using topic models},
  author={S. W. Thomas and H. Hemmati and A. Hassan and D. Blostein},
  journal={Empirical Software Engineering},
  year={2012},
  volume={19},
  pages={182-212}
}
Software development teams use test suites to test changes to their source code. In many situations, the test suites are so large that executing every test for every source code change is infeasible, due to time and resource constraints. Development teams need to prioritize their test suite so that as many distinct faults as possible are detected early in the execution of the test suite. We consider the problem of static black-box test case prioritization (TCP), where test suites are… Expand
Prioritizing Manual Test Cases in Traditional and Rapid Release Environments
TLDR
It is concluded that test suites in rapid release environments, potentially, can be very effectively prioritized for execution, based on their historical riskiness; whereas the same conclusions do not hold in the traditional software development environments. Expand
Prioritizing manual test cases in rapid release environments
TLDR
The conclusion of the paper is that test cases in rapid release environments can be very effectively prioritized for execution, based on their historical failure knowledge, rather than other changes in the process. Expand
A Survey on Different Approaches for Software Test Case Prioritization
TLDR
This is the first review with a detail report of the last 18 years of TCP techniques and framed three research questions which sum up the frequently used prioritization metrics, regularly used subject programs and the distribution of different prioritization techniques. Expand
State-based models in regression test suite prioritization
TLDR
Statistical analysis of the empirical study, which compares the effectiveness of the presented methods in terms of early fault detection, show that compared to random ordering of test cases, model-based test prioritization significantly improve the effectiveness with respect toEarly fault detection. Expand
Test Case Prioritization for Compilers: A Text-Vector Based Approach
  • Junjie Chen, Y. Bai, +4 authors B. Xie
  • Computer Science
  • 2016 IEEE International Conference on Software Testing, Verification and Validation (ICST)
  • 2016
TLDR
This paper proposes a novel text-vector based test case prioritization approach, which prioritizes test cases for C compilers without coverage information and finds that this approach is much more efficient than the existing approaches and is effective in prioritizing test cases. Expand
Implementation of Test Case Prioritization Technique Using Static Path
TLDR
A technique for test case prioritization in which test cases can be prioritized on the basis of static function call path is implemented and shows that, the algorithms can significantly reduce the size and the cost of the test suite for regression testing, and achieves good cost effectiveness. Expand
Chapter Four - Advances in Techniques for Test Prioritization
TLDR
In this chapter, some of the most common test case prioritization techniques from software testing literature as well as trends and advances in this domain are seen. Expand
Improvements to test case prioritisation considering efficiency and effectiveness on real faults
TLDR
This thesis proposes a test case prioritisation strategy, called G-Clef, that leverages defect prediction estimates to reorder test suites and investigates whether sentiments expressed in commit messages could be used to improve the defect prediction element of G- Clef. Expand
Software testing: test suite compilation and execution optimizations
TLDR
A test case scheduling algorithm is proposed which improves the load balancing between multiple devices of a heterogeneous system in an attempt to reduce the overall test suite size. Expand
How Does Regression Test Prioritization Perform in Real-World Software Evolution?
  • Y. Lu, Yiling Lou, +4 authors L. Zhang
  • Computer Science, Engineering
  • 2016 IEEE/ACM 38th International Conference on Software Engineering (ICSE)
  • 2016
TLDR
The results show that for both traditional and time-aware test prioritization, test suite augmentation significantly hampers their effectiveness, whereas source code changes alone do not influence their effectiveness much. Expand
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 69 REFERENCES
A Static Approach to Prioritizing JUnit Test Cases
TLDR
This paper proposes an approach to prioritizing test cases in the absence of coverage information that operates on Java programs tested under the JUnit framework and shows that the test suites constructed by JUPTA are more effective than those in random and untreated test orders in terms of fault-detection effectiveness. Expand
Prioritizing JUnit test cases in absence of coverage information
TLDR
An approach (named Jupta) for prioritizing JUnit test cases in absence of coverage information and experimental results indicate that Jupta is more effective and stable than the untreated orderings and is approximately as effective andstable as prioritization techniques using coverage information at the method level. Expand
Model-based test prioritization heuristic methods and their evaluation
TLDR
Several model-based test prioritization heuristics are presented and it is shown that some simple heuristic methods can be as effective in early fault detection as more complex ones. Expand
Prioritizing test cases with string distances
TLDR
The obtained results indicate that prioritisation based on string distances is more efficient in finding defects than random ordering of the test suite: the test suites prioritized using string distances are moreefficient in detecting the strongest mutants, and, on average, have a better APFD than randomly ordered test suites. Expand
Test-Suite Reduction and Prioritization for Modified Condition/Decision Coverage
TLDR
New algorithms for test-suite reduction and prioritization that can be tailored effectively for use with modified condition/decision coverage (MC/DC) adequate are presented. Expand
Empirical Investigation of the Effects of Test Suite Properties on Similarity-Based Test Case Selection
  • H. Hemmati, A. Arcuri, L. Briand
  • Computer Science
  • 2011 Fourth IEEE International Conference on Software Testing, Verification and Validation
  • 2011
TLDR
The ideal situation in which a similarity-based selection works best is identified, which is useful for devising more effective similarity functions, and a solution based on rank scaling is proposed to alleviate this problem. Expand
A study of effective regression testing in practice
TLDR
This proposed hybrid technique combines modification, minimization and prioritization-based selection using a list of source code changes and the execution traces from test cases run on previous versions to identify a representative subset of all test cases that may result in different output behavior on the new software version. Expand
Test Case Prioritization: A Family of Empirical Studies
TLDR
Several new studies are performed in which they empirically compared prioritization techniques using both controlled experiments and case studies, and found that the incorporation of measures of fault proneness into prioritize techniques improve their effectiveness. Expand
Regression testing minimization, selection and prioritization: a survey
TLDR
This paper surveys each area of minimization, selection and prioritization technique and discusses open problems and potential directions for future research. Expand
Achieving scalable model-based testing through test case diversity
TLDR
A family of similarity-based test case selection techniques for test suites generated from state machines is introduced and a method to identify optimal tradeoffs between the number of test cases to run and fault detection is proposed. Expand
...
1
2
3
4
5
...