W. E. Wong, R. Gao, Y. Li, R. Abreu, and F. Wotawa, "A survey on software fault localization, " IEEE Transactions on Software Engineering, p. preprint, 2016.
C. Le Goues, T. Nguyen, S. Forrest, and W. Weimer, "Genprog: A generic method for automatic software repair, " IEEE Transactions on Software Engineering, vol. 38, no. 1, pp. 54-72, Jan. 2012.
H. D. T. Nguyen, D. Qi, A. Roychoudhury, and S. Chandra, "Semfix: Program repair via semantic analysis, " in Proceedings of the 2013 International Conference on Software Engineering, ser. ICSE '13, 2013, pp. 772-781.
D. Kim, J. Nam, J. Song, and S. Kim, "Automatic patch generation learned from human-written patches, " in Proceedings of the 2013 International Conference on Software Engineering, ser. ICSE '13, 2013, pp. 802-811.
Y. Qi, X. Mao, Y. Lei, Z. Dai, and C. Wang, "The strength of random search on automated program repair, " in Proceedings of the 36th International Conference on Software Engineering, ser. ICSE 2014, 2014, pp. 254-265.
W. E. Wong, V. Debroy, R. Gao, and Y. Li, "The dstar method for effective software fault localization, " IEEE Transactions on Reliability, vol. 63, no. 1, pp. 290-308, 2013.
W. E. Wong, V. Debroy, Y. Li, and R. Gao, "Software fault localization using dstar (d), " in 2012 IEEE Sixth International Conference on Software Security and Reliability. IEEE, 2012, pp. 21-30.
H. Cleve and A. Zeller, "Locating causes of program failures, " in Proceedings of the 27th International Conference on Software Engineering, ser. ICSE '05, 2005, pp. 342-351.
S. Pearson, J. Campos, R. Just, G. Fraser, R. Abreu, M. D. Ernst, D. Pang, and B. Keller, "Evaluating and improving fault localization, " in 2017 IEEE/ACM 39th International Conference on Software Engineering (ICSE). IEEE, 2017, pp. 609-620.
W. E. Wong, Y. Qi, L. Zhao, and K.-Y. Cai, "Effective fault localization using code coverage, " in Computer Software and Applications Conference, 2007. COMPSAC 2007. 31st Annual International, vol. 1. IEEE, 2007, pp. 449-456.
C. Parnin and A. Orso, "Are automated debugging techniques actually helping programmers?" in Proceedings of the 2011 International Symposium on Software Testing and Analysis, ser. ISSTA '11. New York, NY, USA: ACM, 2011, pp. 199-209.
M. Beller, N. Spruit, D. Spinellis, and A. Zaidman, "On the dichotomy of debugging behavior among programmers, " in Proceedings of the 40th International Conference on Software Engineering, 2018, pp. 572-583.
M. Böhme, E. O. Soremekun, S. Chattopadhyay, E. Ugherughe, and A. Zeller, "Where is the bug and how is it fixed? an experiment with practitioners, " in Proceedings of the 2017 11th Joint Meeting on Foundations of Software Engineering, 2017, pp. 117-128.
Y. Li, S. Wang, and T. Nguyen, "Fault localization with code coverage representation learning, " in 2021 IEEE/ACM 43rd International Conference on Software Engineering (ICSE). IEEE, 2021, pp. 661-673.
Y. Küçük, T. A. Henderson, and A. Podgurski, "Improving fault localization by integrating value and predicate based causal inference techniques, " in 2021 IEEE/ACM 43rd International Conference on Software Engineering (ICSE). IEEE, 2021, pp. 649-660.
S. Yoo, X. Xie, F.-C. Kuo, T. Y. Chen, and M. Harman, "Human competitiveness of genetic programming in spectrum-based fault localisation: Theoretical and empirical analysis, " ACM Transactions on Software Engineering and Methodology (TOSEM), vol. 26, no. 1, pp. 1-30, 2017.
J. Jiang, R. Wang, Y. Xiong, X. Chen, and L. Zhang, "Combining spectrum-based fault localization and statistical debugging: An empirical study, " in 2019 34th IEEE/ACM International Conference on Automated Software Engineering (ASE). IEEE, 2019, pp. 502-514.
A. Nikanjam, H. B. Braiek, M. M. Morovati, and F. Khomh, "Automatic fault detection for deep learning programs using graph transformations, " ACM Transactions on Software Engineering and Methodology (TOSEM), vol. 31, no. 1, pp. 1-27, 2021.
M. Wen, J. Chen, Y. Tian, R. Wu, D. Hao, S. Han, and S.-C. Cheung, "Historical spectrum based fault localization, " IEEE Transactions on Software Engineering, vol. 47, no. 11, pp. 2348-2368, 2019.
R. Kohavi, A. Deng, R. Longbotham, and Y. Xu, "Seven rules of thumb for web site experimenters, " in Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining, 2014, pp. 1857-1866.
R. Kohavi, A. Deng, B. Frasca, T. Walker, Y. Xu, and N. Pohlmann, "Online controlled experiments at large scale, " in Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining, 2013, pp. 1168-1176.
Z. Ren, H. Jiang, J. Xuan, and Z. Yang, "Automated localization for unreproducible builds, " in Proceedings of the 40th International Conference on Software Engineering, 2018, pp. 71-81.
Z. He, Y. Chen, E. Huang, Q. Wang, Y. Pei, and H. Yuan, "A system identification based oracle for control-cps software fault localization, " in 2019 IEEE/ACM 41st International Conference on Software Engineering (ICSE). IEEE, 2019, pp. 116-127.
H. V. Pham, T. Lutellier, W. Qi, and L. Tan, "Cradle: cross-backend validation to detect and localize bugs in deep learning libraries, " in 2019 IEEE/ACM 41st International Conference on Software Engineering (ICSE). IEEE, 2019, pp. 1027-1038.
A. Amar and P. C. Rigby, "Mining historical test logs to predict bugs and localize faults in the test logs, " in 2019 IEEE/ACM 41st International Conference on Software Engineering (ICSE). IEEE, 2019, pp. 140-151.
M. Zhang, X. Li, L. Zhang, and S. Khurshid, "Boosting spectrum-based fault localization using pagerank, " in Proceedings of the 26th ACM SIGSOFT International Symposium on Software Testing and Analysis, 2017, pp. 261-272.
M. M. Rahman and C. K. Roy, "Improving ir-based bug localization with context-aware query reformulation, " in Proceedings of the 2018 26th ACM joint meeting on European software engineering conference and symposium on the foundations of software engineering, 2018, pp. 621-632.
Y. Lin, J. Sun, L. Tran, G. Bai, H. Wang, and J. Dong, "Break the dead end of dynamic slicing: localizing data and control omission bug, " in Proceedings of the 33rd ACM/IEEE International Conference on Automated Software Engineering, 2018, pp. 509-519.
M. Maamar, N. Lazaar, S. Loudni, and Y. Lebbah, "Fault localization using itemset mining under constraints, " Automated Software Engineering, vol. 24, no. 2, pp. 341-368, 2017.
T. S. Zaman, X. Han, and T. Yu, "Scminer: Localizing system-level concurrency faults from large system call traces, " in 2019 34th IEEE/ACM International Conference on Automated Software Engineering (ASE). IEEE, 2019, pp. 515-526.
M. Rath, D. Lo, and P. Mäder, "Analyzing requirements and traceability information to improve bug localization, " in Proceedings of the 15th International Conference on Mining Software Repositories, 2018, pp. 442-453.
S. A. Akbar and A. C. Kak, "A large-scale comparative evaluation of irbased tools for bug localization, " in Proceedings of the 17th international conference on mining software repositories, 2020, pp. 21-31.
X. Ma, S. Wu, E. Pobee, X. Mei, H. Zhang, B. Jiang, and W.-K. Chan, "Regiontrack: A trace-based sound and complete checker to debug transactional atomicity violations and non-serializable traces, " ACM Transactions on Software Engineering and Methodology (TOSEM), vol. 30, no. 1, pp. 1-49, 2020.
J. Troya, S. Segura, J. A. Parejo, and A. Ruiz-Cortés, "Spectrumbased fault localization in model transformations, " ACM Transactions on Software Engineering and Methodology (TOSEM), vol. 27, no. 3, pp. 1-50, 2018.
Y. Kim, S. Mun, S. Yoo, and M. Kim, "Precise learn-to-rank fault localization using dynamic and static features of target programs, " ACM Transactions on Software Engineering and Methodology (TOSEM), vol. 28, no. 4, pp. 1-34, 2019.
X. Li, W. E. Wong, R. Gao, L. Hu, and S. Hosono, "Genetic algorithmbased test generation for software product line with the integration of fault localization techniques, " Empirical Software Engineering, vol. 23, no. 1, pp. 1-51, 2018.
F. Feyzi, "Cgt-fl: using cooperative game theory to effective fault localization in presence of coincidental correctness, " Empirical Software Engineering, vol. 25, no. 5, pp. 3873-3927, 2020.
N. Bayati Chaleshtari and S. Parsa, "Smbfl: slice-based cost reduction of mutation-based fault localization, " Empirical Software Engineering, vol. 25, no. 5, pp. 4282-4314, 2020.
B. Liu, S. Nejati, L. C. Briand et al., "Effective fault localization of automotive simulink models: Achieving the trade-off between test oracle effort and fault localization accuracy, " Empirical Software Engineering, vol. 24, no. 1, pp. 444-490, 2019.
D. Zou, J. Liang, Y. Xiong, M. D. Ernst, and L. Zhang, "An empirical study of fault localization families and their combinations, " IEEE Transactions on Software Engineering, 2019.
S. Benton, X. Li, Y. Lou, and L. Zhang, "Evaluating and improving unified debugging, " IEEE Transactions on Software Engineering, 2021.
T. T. Nguyen, K.-T. Ngo, S. Nguyen, and H. Vo, "A variability fault localization approach for software product lines, " IEEE Transactions on Software Engineering, 2021.
D. Jarman, J. Berry, R. Smith, F. Thung, and D. Lo, "Legion: Massively composing rankers for improved bug localization at adobe, " IEEE Transactions on Software Engineering, 2021.
M. Böhme and A. Roychoudhury, "Corebench: Studying complexity of regression errors, " in Proceedings of the 23rd ACM/SIGSOFT International Symposium on Software Testing and Analysis, ser. ISSTA, 2014, pp. 105-115.
M. Hutchins, H. Foster, T. Goradia, and T. Ostrand, "Experiments on the effectiveness of dataflow-and control-flow-based test adequacy criteria, " in Proceedings of 16th International conference on Software engineering. IEEE, 1994, pp. 191-200.
C. Le Goues, N. Holtschulte, E. K. Smith, Y. Brun, P. Devanbu, S. Forrest, and W. Weimer, "The manybugs and introclass benchmarks for automated repair of c programs, " IEEE Transactions on Software Engineering, vol. 41, no. 12, pp. 1236-1256, 2015.
S. H. Tan, J. Yi, S. Mechtaev, A. Roychoudhury et al., "Codeflaws: A programming competition benchmark for evaluating automated program repair tools, " in 2017 IEEE/ACM 39th International Conference on Software Engineering Companion (ICSE-C). IEEE, 2017, pp. 180-182.
W. E. Wong and V. Debroy, "A survey of software fault localization, " Department of Computer Science, University of Texas at Dallas, Tech. Rep. UTDCS-45, vol. 9, 2009.
E. Soremekun, L. Kirschner, M. Böhme, and M. Papadakis, "Artifact for Evaluating the Impact of Experimental Assumptions in Automated Fault Localization, " 1 2023. [Online]. Available: https://figshare. com/articles/conference contribution/Debugging Assumptions Artifact/21786743
H. Gui, Y. Xu, A. Bhasin, and J. Han, "Network a/b testing: From sampling to estimation, " in Proceedings of the 24th International Conference on World Wide Web, 2015, pp. 399-409.
B. Korel and J. Laski, "Dynamic program slicing, " Inf. Process. Lett., vol. 29, no. 3, pp. 155-163, Oct. 1988.
H. Agrawal and J. R. Horgan, "Dynamic program slicing, " in Proceedings of the ACM SIGPLAN 1990 Conference on Programming Language Design and Implementation, ser. PLDI '90, 1990, pp. 246-256.
A. X. Zheng, M. I. Jordan, B. Liblit, and A. Aiken, "Statistical debugging of sampled programs, " in Advances in Neural Information Processing Systems, 2003, pp. 9-11.
B. Liblit, M. Naik, A. X. Zheng, A. Aiken, and M. I. Jordan, "Scalable statistical bug isolation, " in Proceedings of the 2005 ACM SIGPLAN Conference on Programming Language Design and Implementation, ser. PLDI '05, 2005, pp. 15-26.
J. A. Jones, M. J. Harrold, and J. Stasko, "Visualization of test information to assist fault localization, " in Proceedings of the 24th International Conference on Software Engineering, ser. ICSE '02, 2002, pp. 467-477.
P. F. Russel, T. R. Rao et al., "On habitat and association of species of anopheline larvae in south-eastern madras. " Journal of the Malaria Institute of India, vol. 3, no. 1, 1940.
L. Naish, H. J. Lee, and K. Ramamohanarao, "A model for spectrabased software diagnosis, " ACM Transactions on software engineering and methodology (TOSEM), vol. 20, no. 3, p. 11, 2011.
J. A. Jones and M. J. Harrold, "Empirical evaluation of the tarantula automatic fault-localization technique, " in Proceedings of the 20th IEEE/ACM International Conference on Automated Software Engineering, ser. ASE '05, 2005, pp. 273-282.
R. Abreu, P. Zoeteweij, and A. J. c. Van Gemund, "An evaluation of similarity coefficients for software fault localization, " in Proceedings of the 12th Pacific Rim International Symposium on Dependable Computing, ser. PRDC'06, 2006, pp. 39-46.
M. Y. Chen, E. Kiciman, E. Fratkin, A. Fox, and E. Brewer, "Pinpoint: Problem determination in large, dynamic internet services, " in Proceedings of the 2002 International Conference on Dependable Systems and Networks, ser. DSN '02, 2002, pp. 595-604.
R. Abreu, P. Zoeteweij, and A. J. C. van Gemund, "On the accuracy of spectrum-based fault localization, " in Proceedings of the Testing: Academic and Industrial Conference Practice and Research Techniques-MUTATION, ser. TAICPART-MUTATION '07, 2007, pp. 89-98.
S. Yoo, "Evolving human competitive spectra-based fault localisation techniques, " in International Symposium on Search Based Software Engineering. Springer, 2012, pp. 244-258.
X. Xie, T. Y. Chen, F.-C. Kuo, and B. Xu, "A theoretical analysis of the risk evaluation formulas for spectrum-based fault localization, " ACM Transactions on Software Engineering and Methodology (TOSEM), vol. 22, no. 4, p. 31, 2013.
X. Xie, F.-C. Kuo, T. Y. Chen, S. Yoo, and M. Harman, "Provably optimal and human-competitive results in sbse for spectrum based fault localisation, " in International Symposium on Search Based Software Engineering. Springer, 2013, pp. 224-238.
D. Landsberg, "Methods and measures for statistical fault localisation, " Ph. D. dissertation, University of Oxford, 2016.
D. Landsberg, H. Chockler, D. Kroening, and M. Lewis, "Evaluation of measures for statistical fault localisation and an optimising scheme, " in International Conference on Fundamental Approaches to Software Engineering. Springer, 2015, pp. 115-129.
E. Soremekun, L. Kirschner, M. Böhme, and A. Zeller, "Locating faults with program slicing: An empirical analysis, " Empirical Software Engineering, vol. 26, no. 3, pp. 1-45, 2021.
F. Y. Assiri and J. M. Bieman, "Fault localization for automated program repair: effectiveness, performance, repair correctness, " Software Quality Journal, pp. 1-29, 2016.
F. Steimann, M. Frenkel, and R. Abreu, "Threats to the validity and value of empirical assessments of the accuracy of coverage-based fault locators, " in Proceedings of the 2013 International Symposium on Software Testing and Analysis, ser. ISSTA 2013, 2013, pp. 314-324.
Frama-C. (2007) Frama-c-framework for modular analysis of c programs. [Online]. Available: https://frama-c. com/
P. Developers. (2014) Pygraphviz. [Online]. Available: https://pygraphviz. github. io/
N. developers. (2014) Networkx-network analysis in python. [Online]. Available: https://networkx. org/
T. M. development team. (2012) Matplotlib-visualization with python. [Online]. Available: https://matplotlib. org/
I. Free Software Foundation. (1987) gcov-a test coverage program. [Online]. Available: https://gcc. gnu. org/onlinedocs/gcc/Gcov. html
T. G. community. (2005) git-diff. [Online]. Available: https://git-scm. com/docs/git-diff
I. Free Software Foundation. (1986) Gdb: The gnu project debugger. [Online]. Available: https://www. sourceware. org/gdb
S. Mechtaev, J. Yi, and A. Roychoudhury, "Angelix: Scalable multiline program patch synthesis via symbolic analysis, " in Proceedings of the 38th international conference on software engineering, 2016, pp. 691-701.
X.-B. D. Le, D. Lo, and C. Le Goues, "Empirical study on synthesis engines for semantics-based program repair, " in 2016 IEEE International Conference on Software Maintenance and Evolution (ICSME). IEEE, 2016, pp. 423-427.
Y. Noller, R. Shariffdeen, X. Gao, and A. Roychoudhury, "Trust enhancement issues in program repair, " in Proceedings of the ACM/IEEE 44th International Conference on Software Engineering, 2022.
M. Jiang, T. Y. Chen, Z. Q. Zhou, and Z. Ding, "Input test suites for program repair: A novel construction method based on metamorphic relations, " IEEE Transactions on Reliability, vol. 70, no. 1, pp. 285-303, 2020.
K. Charmaz, Constructing grounded theory: A practical guide through qualitative analysis. sage, 2006.
R. Just, D. Jalali, and M. D. Ernst, "Defects4j: A database of existing faults to enable controlled testing studies for java programs, " in Proceedings of the 2014 International Symposium on Software Testing and Analysis, 2014, pp. 437-440.
P. Rao, Z. Zheng, T. Y. Chen, N. Wang, and K. Cai, "Impacts of test suite's class imbalance on spectrum-based fault localization techniques, " in 2013 13th International Conference on Quality Software. IEEE, 2013, pp. 260-267.
B. Baudry, F. Fleurey, and Y. Le Traon, "Improving test suites for efficient fault localization, " in Proceedings of the 28th international conference on Software engineering, 2006, pp. 82-91.
K. Liu, A. Koyuncu, T. F. Bissyandé, D. Kim, J. Klein, and Y. Le Traon, "You cannot fix what you cannot find! an investigation of fault localization bias in benchmarking automated program repair systems, " in 2019 12th IEEE conference on software testing, validation and verification (ICST). IEEE, 2019, pp. 102-113.
