Study of the relationship of bug consistency with respect to performance of spectra metrics

Hua Jie Lee, Lee Naish, Kotagiri Ramamohanarao

Research output: Chapter in Book/Report/Conference proceedingConference proceeding contribution

22 Citations (Scopus)

Abstract

In practice, manual debugging to locate bugs is a daunting and time-consuming task. By using software fault localization, we can reduce this time substantially. The technique of software fault localization can be performed using execution profiles of the software under several test inputs. Such profiles, known as program spectra, consist of the coverage of correct and incorrect executions statement from a given test suite. We have performed a systematic evaluation of several metrics that make use of measurement obtained from program spectra on Siemens Test Suite. In this paper, we discuss how the effectiveness of various metrics degrade in determining buggy statements as the bug consistency (error detection accuracy, qe) of a statement approaches zero. Bug consistency of a statement refers to the ratio of the number of failed tests executing the statement over the total number of tests executing the statement. We proposed Effect(M) as to measure the effectiveness of these metrics as qe value varies. We also demonstrate that the qe (previously not considered as a metric), is just as effective as some of the metrics proposed. We also formally prove that qe is identical to the metric that Tarantula system uses for bug localization.

Original languageEnglish
Title of host publicationProceedings - 2009 2nd IEEE International Conference on Computer Science and Information Technology, ICCSIT 2009
Place of PublicationPiscataway, NJ
PublisherInstitute of Electrical and Electronics Engineers (IEEE)
Pages501-508
Number of pages8
ISBN (Print)9781424445196
DOIs
Publication statusPublished - 2009
Externally publishedYes
Event2009 2nd IEEE International Conference on Computer Science and Information Technology, ICCSIT 2009 - Beijing, China
Duration: 8 Aug 200911 Aug 2009

Other

Other2009 2nd IEEE International Conference on Computer Science and Information Technology, ICCSIT 2009
CountryChina
CityBeijing
Period8/08/0911/08/09

Fingerprint Dive into the research topics of 'Study of the relationship of bug consistency with respect to performance of spectra metrics'. Together they form a unique fingerprint.

  • Cite this

    Lee, H. J., Naish, L., & Ramamohanarao, K. (2009). Study of the relationship of bug consistency with respect to performance of spectra metrics. In Proceedings - 2009 2nd IEEE International Conference on Computer Science and Information Technology, ICCSIT 2009 (pp. 501-508). [5234512] Piscataway, NJ: Institute of Electrical and Electronics Engineers (IEEE). https://doi.org/10.1109/ICCSIT.2009.5234512