Spectral debugging

how much better can we do?

Lee Naish*, Hua Jie Lee, Kotagiri Ramamohanarao

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference proceeding contribution

6 Citations (Scopus)

Abstract

This paper investigates software fault localization methods which are based on program spectra - data on execution profiles from passed and failed tests. We examine a standard method of spectral fault localization: for each statement we determine the number of passed and failed tests in which the statement was/wasn't executed and a function, or metric, of these four values is used to rank statements according to how likely they are to be buggy. Many different metrics have been used. Here our main focus is to determine how much improvement in performance could be achieved by finding better metrics. We define the cost of fault localization using a given metric and the unavoidable cost, which is independent of the choice of metric. We define a class of strictly rational metrics and argue that is reasonable to restrict attention to these metrics. We show that every single bug optimal metric performs as well as any strictly rational metric for single bug programs, and the resulting cost is the unavoidable cost. We also show how any metric can be adapted so it is single bug optimal, and give results of empirical experiments using single- and two-bug programs.

Original languageEnglish
Title of host publicationComputer Science 2012
Subtitle of host publicationProceedings of the 35th Australasian Computer Science Conference (ACSC 2012)
EditorsMark Reynolds, Bruce Thomas
Place of PublicationSydney, Australia
Pages99-106
Number of pages8
Volume122
Publication statusPublished - 2012
Externally publishedYes
Event35th Australasian Computer Science Conference, ACSC 2012 - Melbourne, VIC, Australia
Duration: 30 Jan 20123 Feb 2012

Publication series

NameConferences in Research and Practice in Information Technology
PublisherAustralian Computer Society Inc.
Volume122
ISSN (Print)1445-1336

Other

Other35th Australasian Computer Science Conference, ACSC 2012
CountryAustralia
CityMelbourne, VIC
Period30/01/123/02/12

Fingerprint Dive into the research topics of 'Spectral debugging: how much better can we do?'. Together they form a unique fingerprint.

  • Cite this

    Naish, L., Lee, H. J., & Ramamohanarao, K. (2012). Spectral debugging: how much better can we do? In M. Reynolds, & B. Thomas (Eds.), Computer Science 2012: Proceedings of the 35th Australasian Computer Science Conference (ACSC 2012) (Vol. 122, pp. 99-106). (Conferences in Research and Practice in Information Technology; Vol. 122). Sydney, Australia.