Characteristics of Useful Code Reviews: An Empirical Study at Microsoft

@article{Bosu2015CharacteristicsOU,
  title={Characteristics of Useful Code Reviews: An Empirical Study at Microsoft},
  author={Amiangshu Bosu and Michaela Greiler and Christian Bird},
  journal={2015 IEEE/ACM 12th Working Conference on Mining Software Repositories},
  year={2015},
  pages={146-156}
}
Over the past decade, both open source and commercial software projects have adopted contemporary peer code review practices as a quality control mechanism. Prior research has shown that developers spend a large amount of time and effort performing code reviews. Therefore, identifying factors that lead to useful code reviews can benefit projects by increasing code review effectiveness and quality. In a three-stage mixed research study, we qualitatively investigated what aspects of code reviews… Expand
Contemporary peer code review practices and associated benefits
TLDR
This dissertation describes empirical studies using surveys, software repository mining, and social network analysis that suggest the primary perceived benefit of code review is knowledge sharing, relationship building, better designs, and ensuring maintainable code, as opposed to the expected result of defect detection. Expand
Studying Reviewer Selection and Involvement in Modern Code Review Processes
TLDR
RevFinder is proposed, a file location-based reviewer recommendation approach that addresses the problem of it being often difficult selecting appropriate reviewers, which can slow down MCR processes. Expand
Understanding Developer Commenting in Code Reviews
TLDR
Through a large-scale empirical analysis of over 1.1 million reviews from five OSS systems, an exploratory study is conducted to investigate the frequency, size, and evolution of reviewer commenting. Expand
Predicting Usefulness of Code Review Comments Using Textual Features and Developer Experience
  • M. M. Rahman, C. Roy, R. Kula
  • Computer Science
  • 2017 IEEE/ACM 14th International Conference on Mining Software Repositories (MSR)
  • 2017
TLDR
RevHelper is developed, a prediction model that can help the developers improve their code review comments through automatic prediction of their usefulness during review submission through a comparison between useful and non-useful review comments. Expand
Process Aspects and Social Dynamics of Contemporary Code Review: Insights from Open Source Development and Industrial Practice at Microsoft
TLDR
The findings identify the following key areas that warrant focused research: exploring the non-technical benefits of code reviews, helping developers in articulating review comments, and assisting reviewers’ program comprehension during code reviews. Expand
What makes a code change easier to review: an empirical investigation on code change reviewability
TLDR
It is found that reviewability is defined through several factors, such as the change description, size, and coherent commit history, that make a code change easier to review. Expand
Process Aspects and Social Dynamics of Contemporary Code Review : Insights from Open Source Development as well as Industrial Practice at Microsoft
Many open source and commercial developers practice contemporary code review, a lightweight, informal, tool-based code review process. To better understand this process and its benefits, we gatheredExpand
Impact of Continuous Integration on Code Reviews
  • M. M. Rahman, C. Roy
  • Computer Science
  • 2017 IEEE/ACM 14th International Conference on Mining Software Repositories (MSR)
  • 2017
TLDR
An exploratory study using 578K automated build entries suggests that successfully passed builds are more likely to encourage new code review participation in a pull request, and a proposed model can identify 64% of the builds that triggered new code reviews later. Expand
On automatically classifying software code review feedback in the context of internal quality
TLDR
This work presents a machine-learning-based approach to automatically classify the proposed code changes into its appropriate topic, and provides initial empirical evidence on the effectiveness of peer-code-review on improving internal software quality. Expand
An empirical study of design discussions in code review
TLDR
This paper studies the frequency and nature of design discussions in code reviews of the OpenStack Nova and Neutron projects to find that design-related discussion during code review is still rare. Expand
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 44 REFERENCES
Improving Code Review by Predicting Reviewers and Acceptance of Patches
TLDR
This paper observed the review processes of two open-source projects, Firefox and Mozilla Core, and proposed two improvements: predict whether a given patch is acceptable and suggest reviewers for a patch. Expand
Reducing human effort and improving quality in peer code reviews using automatic static analysis and reviewer recommendation
  • Vipin Balachandran
  • Computer Science
  • 2013 35th International Conference on Software Engineering (ICSE)
  • 2013
TLDR
Through a user study, it is shown that integrating static analysis tools with code review process can improve the quality of code review, and a tool called Review Bot is proposed for the integration of automatic static analysis with the codereview process. Expand
Expectations, outcomes, and challenges of modern code review
  • Alberto Bacchelli, C. Bird
  • Computer Science, Political Science
  • 2013 35th International Conference on Software Engineering (ICSE)
  • 2013
TLDR
This study reveals that while finding defects remains the main motivation for review, reviews are less about defects than expected and instead provide additional benefits such as knowledge transfer, increased team awareness, and creation of alternative solutions to problems. Expand
Convergent contemporary software peer review practices
TLDR
A measure of the degree to which knowledge is shared during review shows that conducting peer review increases the number of distinct files a developer knows about by 66% to 150% depending on the project. Expand
The impact of code review coverage and code review participation on software quality: a case study of the qt, VTK, and ITK projects
TLDR
The results empirically confirm the intuition that poorly reviewed code has a negative impact on software quality in large systems using modern reviewing tools. Expand
The influence of non-technical factors on code review
TLDR
An empirical study of the code review process for WebKit, a large, open source project, that replicates the impact of previously studied factors - such as patch size, priority, and component and extends these studies by investigating organizational and personal dimensions on code review response time and outcome. Expand
What Types of Defects Are Really Discovered in Code Reviews?
TLDR
It is suggested that code reviews may be most valuable for software products with long life cycles as the value of discovering evolvability defects in them is greater than for short life cycle systems. Expand
Open source software peer review practices
TLDR
It is concluded that Apache reviews can be described as early, frequent reviews of small, independent, complete contributions conducted asynchronously by a potentially large, but actually small, group of self-selected experts leading to an efficient and effective peer review technique. Expand
Understanding broadcast based peer review on open source software projects
TLDR
An empirical study is described to investigate the mechanisms and behaviours that developers use to find code changes they are competent to review and how stakeholders interact with one another during the review process. Expand
Contemporary Peer Review in Action: Lessons from Open Source Development
TLDR
The authors describe lessons from the OSS process that transfer to proprietary software development and present a selection of popular tools that support lightweight, collaborative, code review processes and nonintrusive metric collection. Expand
...
1
2
3
4
5
...