Assessing the quality of the steps to reproduce in bug reports

Type: Article

Publication Date: 2019-08-09

Citations: 52

DOI: https://doi.org/10.1145/3338906.3338947

Download PDF

Abstract

A major problem with user-written bug reports, indicated by developers and documented by researchers, is the (lack of high) quality of the reported steps to reproduce the bugs. Low-quality steps to reproduce lead to excessive manual effort spent on bug triage and resolution. This paper proposes Euler, an approach that automatically identifies and assesses the quality of the steps to reproduce in a bug report, providing feedback to the reporters, which they can use to improve the bug report. The feedback provided by Euler was assessed by external evaluators and the results indicate that Euler correctly identified 98% of the existing steps to reproduce and 58% of the missing ones, while 73% of its quality annotations are correct.

Locations

  • arXiv (Cornell University) - View - PDF

Similar Works

Action Title Year Authors
+ Assessing the Quality of the Steps to Reproduce in Bug Reports 2019 Oscar Chaparro
Carlos Bernal-Cárdenas
Jing Lü
Kevin Moran
Andrian Marcus
Massimiliano Di Penta
Denys Poshyvanyk
Vincent Ng
+ Assessing the Quality of the Steps to Reproduce in Bug Reports 2019 Oscar Chaparro
Carlos Bernal-Cárdenas
Jing Lu
Kevin Moran
Andrian Marcus
Massimiliano Di Penta
Denys Poshyvanyk
Vincent Ng
+ A literature review on different types of empirically evaluated bug localization approaches 2022 Filip Zamfirov
+ A Quick Repair Facility for Debugging 2022 Steven P. Reiss
Qi Xin
+ Can LLMs Demystify Bug Reports? 2023 Laura Plein
Tegawendé F. Bissyandé
+ Program Repair: Automated vs. Manual 2022 Quanjun Zhang
Yuan Zhao
Weisong Sun
Chunrong Fang
Ziyuan Wang
Lingming Zhang
+ PDF Chat Why are Some Bugs Non-Reproducible? : –An Empirical Investigation using Data Fusion– 2020 Mohammad Masudur Rahman
Foutse Khomh
Marco Castelluccio
+ PDF Chat Registered reports in software engineering 2023 Neil A. Ernst
María Teresa Baldassarre
+ Not All Bugs Are the Same: Understanding, Characterizing, and Classifying the Root Cause of Bugs 2019 Gemma Catolino
Fabio Palomba
Andy Zaidman
Filomena Ferrucci
+ Registered Reports in Software Engineering 2023 Neil A. Ernst
María Teresa Baldassarre
+ Critical Review of BugSwarm for Fault Localization and Program Repair 2019 Thomas Durieux
Rui Abreu
+ Empirical Evaluation of a Live Environment for Extract Method Refactoring 2023 Sara Fernandes
Ademar Aguiar
André Restivo
+ Enhancing Mobile App Bug Reporting via Real-time Understanding of Reproduction Steps 2022 Mattia Fazzini
Kevin Moran
Carlos Bernal Cardenas
Tyler Wendland
Alessandro Orso
Denys Poshyvanyk
+ PDF Chat Wayback Machine: A tool to capture the evolutionary behavior of the bug reports and their triage process in open-source software systems 2022 Hadi Jahanshahi
Mücahit Çevik
José Navas-Sú
Ayşe Bener
Antonio González-Torres
+ A Note About: Critical Review of BugSwarm for Fault Localization and Program Repair 2019 David A. Tomassi
Cindy Rubio-González
+ PDF Chat Integrating Various Software Artifacts for Better LLM-based Bug Localization and Program Repair 2024 Qiong Feng
Xiaotian Ma
Jiayi Sheng
Feng Zhao
Wei Song
Peng Liang
+ Comparing Bug Finding Tools with Reviews and Tests 2005 Stefan Wagner
Jan Jürjens
Claudia Koller
P. Trischberger
+ A Note About: Critical Review of BugSwarm for Fault Localization and Program Repair. 2019 David A. Tomassi
Cindy Rubio-González
+ PDF Chat BEARS: An Extensible Java Bug Benchmark for Automatic Program Repair Studies 2019 Fernanda Madeiral
Simon Urli
Marcelo de Almeida Maia
Martin Monperrus
+ PDF Chat Andror2: A Dataset of Manually-Reproduced Bug Reports for Android apps 2021 Tyler Wendland
Jingyang Sun
Junayed Mahmud
S. M. Hasan Mansur
Steven Huang
Kevin Moran
Julia Rubin
Mattia Fazzini

Works That Cite This (18)

Action Title Year Authors
+ Toward Rapid Bug Resolution for Android Apps 2024 Junayed Mahmud
+ PDF Chat Why are Some Bugs Non-Reproducible? : –An Empirical Investigation using Data Fusion– 2020 Mohammad Masudur Rahman
Foutse Khomh
Marco Castelluccio
+ PDF Chat Enhancing Mobile App Bug Reporting via Real-Time Understanding of Reproduction Steps 2022 Mattia Fazzini
Kevin Moran
Carlos Bernal-Cárdenas
Tyler Wendland
Alessandro Orso
Denys Poshyvanyk
+ CrashTranslator: Automatically Reproducing Mobile Application Crashes Directly from Stack Trace 2024 Yuchao Huang
Junjie Wang
Zhe Liu
Yawen Wang
Song Wang
Chunyang Chen
Y. Hu
Qing Wang
+ PDF Chat Translating Video Recordings of Complex Mobile App UI Gestures into Replayable Scenarios 2022 Carlos Bernal-Cárdenas
Nathan Cooper
Madeleine Havranek
Kevin Moran
Oscar Chaparro
Denys Poshyvanyk
Andrian Marcus
+ PDF Chat Toward interactive bug reporting for (android app) end-users 2022 Yang Song
Junayed Mahmud
Ying Zhou
Oscar Chaparro
Kevin Moran
Andrian Marcus
Denys Poshyvanyk
+ PDF Chat Andror2: A Dataset of Manually-Reproduced Bug Reports for Android apps 2021 Tyler Wendland
Jingyang Sun
Junayed Mahmud
S. M. Hasan Mansur
Steven Huang
Kevin Moran
Julia Rubin
Mattia Fazzini
+ PDF Chat Translating video recordings of mobile app usages into replayable scenarios 2020 Carlos Bernal-Cárdenas
Nathan Cooper
Kevin Moran
Oscar Chaparro
Andrian Marcus
Denys Poshyvanyk
+ PDF Chat An Empirical Investigation into the Reproduction of Bug Reports for Android Apps 2022 Jack L. Johnson
Junayed Mahmud
Tyler Wendland
Kevin Moran
Julia Rubin
Mattia Fazzini
+ PDF Chat V2S: A Tool for Translating Video Recordings of Mobile App Usages into Replayable Scenarios 2021 Madeleine Havranek
Carlos Bernal-Cárdenas
Nathan Cooper
Oscar Chaparro
Denys Poshyvanyk
Kevin Moran