Feedback-Driven Automated Whole Bug Report Reproduction for Android Apps

Type: Preprint

Publication Date: 2024-09-11

Citations: 0

DOI: https://doi.org/10.1145/3650212.3680341

Download PDF

Abstract

In software development, bug report reproduction is a challenging task. This paper introduces ReBL, a novel feedback-driven approach that leverages GPT-4, a large-scale language model (LLM), to automatically reproduce Android bug reports. Unlike traditional methods, ReBL bypasses the use of Step to Reproduce (S2R) entities. Instead, it leverages the entire textual bug report and employs innovative prompts to enhance GPT's contextual reasoning. This approach is more flexible and context-aware than the traditional step-by-step entity matching approach, resulting in improved accuracy and effectiveness. In addition to handling crash reports, ReBL has the capability of handling non-crash functional bug reports. Our evaluation of 96 Android bug reports (73 crash and 23 non-crash) demonstrates that ReBL successfully reproduced 90.63% of these reports, averaging only 74.98 seconds per bug report. Additionally, ReBL outperformed three existing tools in both success rate and speed.

Locations

  • arXiv (Cornell University) - View - PDF

Similar Works

Action Title Year Authors
+ Enhancing Mobile App Bug Reporting via Real-time Understanding of Reproduction Steps 2022 Mattia Fazzini
Kevin Moran
Carlos Bernal Cardenas
Tyler Wendland
Alessandro Orso
Denys Poshyvanyk
+ Prompting Is All You Need: Automated Android Bug Replay with Large Language Models 2024 Sidong Feng
Chunyang Chen
+ Prompting Is All You Need: Automated Android Bug Replay with Large Language Models 2023 Sidong Feng
Chunyang Chen
+ Automatically Reproducing Android Bug Reports Using Natural Language Processing and Reinforcement Learning 2023 Zhaoxu Zhang
Robert A. Winn
Yu Zhao
Tingting Yu
William G. J. Halfond
+ Automatically Reproducing Android Bug Reports using Natural Language Processing and Reinforcement Learning 2023 Zhaoxu Zhang
Robert A. Winn
Yu Zhao
Tingting Yu
William G. J. Halfond
+ PDF Chat An Empirical Investigation into the Reproduction of Bug Reports for Android Apps 2022 Jack L. Johnson
Junayed Mahmud
Tyler Wendland
Kevin Moran
Julia Rubin
Mattia Fazzini
+ CrashTranslator: Automatically Reproducing Mobile Application Crashes Directly from Stack Trace 2024 Yuchao Huang
Junjie Wang
Zhe Liu
Yawen Wang
Song Wang
Chunyang Chen
Y. Hu
Qing Wang
+ CrashTranslator: Automatically Reproducing Mobile Application Crashes Directly from Stack Trace 2023 Yuchao Huang
Junjie Wang
Zhe Liu
Yawen Wang
Song Wang
Chunyang Chen
Yuanzhe Hu
Qing Wang
+ PDF Chat Andror2: A Dataset of Manually-Reproduced Bug Reports for Android apps 2021 Tyler Wendland
Jingyang Sun
Junayed Mahmud
S. M. Hasan Mansur
Steven Huang
Kevin Moran
Julia Rubin
Mattia Fazzini
+ PDF Chat Redefining Crowdsourced Test Report Prioritization: An Innovative Approach with Large Language Model 2024 Yuchen Ling
Shengcheng Yu
Chunrong Fang
Guoqing Pan
Jun Wang
Jia Liu
+ Toward Rapid Bug Resolution for Android Apps 2023 Junayed Mahmud
+ Toward Rapid Bug Resolution for Android Apps 2024 Junayed Mahmud
+ PDF Chat Toward interactive bug reporting for (android app) end-users 2022 Yang Song
Junayed Mahmud
Ying Zhou
Oscar Chaparro
Kevin Moran
Andrian Marcus
Denys Poshyvanyk
+ PDF Chat Auto-completing bug reports for Android applications 2015 Kevin Moran
Mario Linares‐Vásquez
Carlos Bernal-Cárdenas
Denys Poshyvanyk
+ BURT: A Chatbot for Interactive Bug Reporting 2023 Yang Song
Junayed Mahmud
Nadeeshan De Silva
Ying Zhou
Oscar Chaparro
Kevin Moran
Andrian Marcus
Denys Poshyvanyk
+ FUSION: A Tool for Facilitating and Augmenting Android Bug Reporting 2018 Kevin Moran
Mario Linares‐Vásquez
Carlos Bernal-Cárdenas
Denys Poshyvanyk
+ PDF Chat Enhancing Mobile App Bug Reporting via Real-Time Understanding of Reproduction Steps 2022 Mattia Fazzini
Kevin Moran
Carlos Bernal-Cárdenas
Tyler Wendland
Alessandro Orso
Denys Poshyvanyk
+ PDF Chat Enhancing Android application bug reporting 2015 Kevin Moran
+ PDF Chat A Study of Using Multimodal LLMs for Non-Crash Functional Bug Detection in Android Apps 2024 Bangyan Ju
Jin Yang
Tingting Yu
Tamerlan Abdullayev
Yuanyuan Wu
Dingbang Wang
Yu Zhao
+ Enhancing Bug Reports for Mobile Apps 2018 Kevin Moran

Works That Cite This (0)

Action Title Year Authors

Works Cited by This (11)

Action Title Year Authors
+ PDF Chat Auto-completing bug reports for Android applications 2015 Kevin Moran
Mario Linares‐Vásquez
Carlos Bernal-Cárdenas
Denys Poshyvanyk
+ PDF Chat Assessing the quality of the steps to reproduce in bug reports 2019 Oscar Chaparro
Carlos Bernal-Cárdenas
Jing Lu
Kevin Moran
Andrian Marcus
Massimiliano Di Penta
Denys Poshyvanyk
Vincent Ng
+ PDF Chat Translating video recordings of mobile app usages into replayable scenarios 2020 Carlos Bernal-Cárdenas
Nathan Cooper
Kevin Moran
Oscar Chaparro
Andrian Marcus
Denys Poshyvanyk
+ PaLM: Scaling Language Modeling with Pathways 2022 Aakanksha Chowdhery
Sharan Narang
Jacob Devlin
Maarten Bosma
Gaurav Mishra
Adam Roberts
Paul Barham
Hyung Won Chung
Charles Sutton
Sebastian Gehrmann
+ Training language models to follow instructions with human feedback 2022 Long Ouyang
Jeff Wu
Xu Jiang
Diogo Almeida
Carroll L. Wainwright
Pamela Mishkin
Chong Zhang
Sandhini Agarwal
Katarina Slama
Alex Ray
+ PDF Chat Psychologically-inspired, unsupervised inference of perceptual groups of GUI widgets from GUI images 2022 Mulong Xie
Zhenchang Xing
Sidong Feng
Xiwei Xu
Liming Zhu
Chunyang Chen
+ PDF Chat Enhancing Mobile App Bug Reporting via Real-Time Understanding of Reproduction Steps 2022 Mattia Fazzini
Kevin Moran
Carlos Bernal-Cárdenas
Tyler Wendland
Alessandro Orso
Denys Poshyvanyk
+ PDF Chat An Empirical Investigation into the Reproduction of Bug Reports for Android Apps 2022 Jack L. Johnson
Junayed Mahmud
Tyler Wendland
Kevin Moran
Julia Rubin
Mattia Fazzini
+ PDF Chat Toward interactive bug reporting for (android app) end-users 2022 Yang Song
Junayed Mahmud
Ying Zhou
Oscar Chaparro
Kevin Moran
Andrian Marcus
Denys Poshyvanyk
+ Automatically Reproducing Android Bug Reports using Natural Language Processing and Reinforcement Learning 2023 Zhaoxu Zhang
Robert A. Winn
Yu Zhao
Tingting Yu
William G. J. Halfond