(2017) How Developers Debug Software- The DBGBENCH Dataset.
|
Text
p244-bohme.pdf Download (91kB) | Preview |
Abstract
How do professional software engineers debug computer programs? In an experiment with 27 real bugs that existed in several widely used programs, we invited 12 professional software engineers, who together spent one month on localizing, explaining, and fixing these bugs. This did not only allow us to study the various tools and strategies used to debug the same set of errors. We could also determine exactly which statements a developer would localize as faults, how a developer would diagnose and explain an error, and how a developer would fix an error --- all of which software engineering researchers seek to automate. Until now, it has been difficult to evaluate the effectiveness and utility of automated debugging techniques without a user study. We publish the collected data, called DbgBench, to facilitate the effective evaluation of automated fault localization, diagnosis, and repair techniques w.r.t. the judgement of human experts.
| Item Type: | Conference or Workshop Item (A Paper) (Poster) |
|---|---|
| Uncontrolled Keywords: | fault diagnosis;program debugging;software maintenance;DBGBENCH dataset;automated debugging techniques;automated fault diagnosis;automated fault localization;automated repair techniques;computer program debugging;human expert judgement;professional software engineers;software debugging;Computer bugs;Conferences;Debugging;Maintenance engineering;Software;Software engineering;Tools;Bug Diagnosis;Debugging in Practice;Fault Localization;Software Repair;Tool Evaluation;User as Tool Benchmark |
| Divisions: | Andreas Zeller (Software Engineering, ST) |
| Conference: | ICSE International Conference on Software Engineering |
| Depositing User: | Ezekiel Soremekun |
| Date Deposited: | 15 Feb 2018 08:08 |
| Last Modified: | 14 Apr 2020 10:40 |
| Primary Research Area: | NRA5: Empirical & Behavioral Security |
| URI: | https://publications.cispa.saarland/id/eprint/1479 |
Actions
Actions (login required)
 |
View Item |