M. Tufano, C.Watson, G. Bavota, M. Di Penta, M. White, and D. Poshyvanyk, "Learning How to Mutate Source Code from Bug-Fixes," arXiv preprint arXiv:1812.10772, 2018.
D. B. Brown, M. Vaughn, B. Liblit, and T. Reps, "The care and feeding of wild-caught mutants," in Proc. ESEC/FSE. ACM, 2017, pp. 511-522.
H. Zhong and Z. Su, "An empirical study on real bug fixes," in Proc. ICSE. IEEE, 2015, pp. 913-923.
M. Soto, F. Thung, C.-P.Wong, C. Le Goues, and D. Lo, "A deeper look into bug fixes: patterns, replacements, deletions, and additions," in Proc. Intl. Conf. MSR. ACM, 2016, pp. 512-515.
A. Koyuncu, K. Liu, T. F. Bissyande, D. Kim, J. Klein, M. Monperrus, and Y. L. Traon, "Fixminer: Mining relevant fix patterns for automated program repair," arXiv preprint arXiv:1810.01791, 2018.
W. Lin, Z. Chen, W. Ma, L. Chen, L. Xu, and B. Xu, "An empirical study on the characteristics of Python fine-grained source code change types," in Proc. ICSME. IEEE, 2016, pp. 188-199.
P. Musavi, B. Adams, and F. Khomh, "Experience report: An empirical study of API failures in OpenStack cloud environments," in Proc. ISSRE. IEEE, 2016, pp. 424-434.
H. Osman, M. Lungu, and O. Nierstrasz, "Mining frequent bug-fix code changes," in Proc. CSMR-WCRE. IEEE, 2014, pp. 343-347.
K. Pan, S. Kim, and E. J. Whitehead, "Toward an understanding of bug fix patterns," Springer Empirical Software Engineering, vol. 14, no. 3, pp. 286-315, 2009.
M. Martinez, L. Duchien, and M. Monperrus, "Automatically extracting instances of code change patterns with ast analysis," in Proc. ICSM. IEEE, 2013, pp. 388-391.
B. Fluri, E. Giger, and H. C. Gall, "Discovering patterns of change types," in Proc. Intl. Conf. ASE. IEEE Computer Society, 2008, pp. 463-466.
J. A. Duraes and H. S. Madeira, "Emulation of software faults: A field data study and a practical approach," IEEE Transactions on Software Engineering, vol. 32, no. 11, pp. 849-867, 2006.
T. Basso, R. Moraes, B. P. Sanches, and M. Jino, "An investigation of Java faults operators derived from a field data study on Java software faults," in Workshop de Testes e Tolerancia a Falhas, 2009, pp. 1-13.
I. Neamtiu, J. S. Foster, and M. Hicks, "Understanding source code evolution using abstract syntax tree matching," ACM SIGSOFT Software Engineering Notes, vol. 30, no. 4, pp. 1-5, 2005.
D. Silva and M. T. Valente, "RefDiff: detecting refactorings in version histories," in Proc. Intl. Conf. MSR. IEEE Press, 2017, pp. 269-279.
A. Hora, D. Silva, M. T. Valente, and R. Robbes, "Assessing the threat of untracked changes in software evolution," in Proc. ICSE. IEEE, 2018, pp. 1102-1113.
-, "The OpenStack marketplace," 2018. [Online] . Available: https://www.openstack.org/marketplace/distros/
-, "User stories showing how the world #RunsOnOpenStack," 2018. [Online] . Available: https://www.openstack.org/user-stories/
The OpenStack Foundation, "OPENSTACK USER SURVEY: A snapshot of OpenStack users' attitudes and deployments," 2015. [Online] . Available: https://www.openstack.org/assets/survey/Public-User-Survey-Report.pdf
Y. Jia and M. Harman, "An analysis and survey of the development of mutation testing," IEEE Transactions on Software Engineering, vol. 37, no. 5, pp. 649-678, 2011.
X. Yao, M. Harman, and Y. Jia, "A study of equivalent and stubborn mutation operators using human analysis of equivalence," in Proc. ICSE. ACM, 2014, pp. 919-930.
M. Martinez and M. Monperrus, "Mining software repair models for reasoning on the search space of automated program fixing," Springer Empirical Software Engineering, vol. 20, no. 1, pp. 176-205, 2015.
K. Herzig, S. Just, and A. Zeller, "It's not a bug, it's a feature: how misclassification impacts bug prediction," in Proc. ICSE. IEEE Press, 2013, pp. 392-401.
K. Prete, N. Rachatasumrit, N. Sudan, and M. Kim, "Template-based reconstruction of complex refactorings," in Proc. ICSM. IEEE, 2010, pp. 1-10.
D. Cotroneo, L. De Simone, and R. Natella, "NFV-Bench: A Dependability Benchmark for Network Function Virtualization Systems," IEEE Transactions on Network and Service Management, vol. 14, no. 4, pp. 934-948, Dec 2017.
R. Natella, D. Cotroneo, J. A. Duraes, and H. S. Madeira, "On fault representativeness of software fault injection," IEEE Transactions on Software Engineering, vol. 39, no. 1, pp. 80-96, 2013.
R. Chillarege et al., "Orthogonal defect classification," Handbook of Software Reliability Engineering, pp. 359-399, 1996.
S. Kim, E. J. Whitehead Jr, and Y. Zhang, "Classifying software changes: Clean or buggy?" IEEE Transactions on Software Engineering, vol. 34, no. 2, pp. 181-196, 2008.
Y. Kamei, E. Shihab, B. Adams, A. E. Hassan, A. Mockus, A. Sinha, and N. Ubayashi, "A large-scale empirical study of just-in-time quality assurance," IEEE Transactions on Software Engineering, vol. 39, no. 6, pp. 757-773, 2013.
B. Fluri, M. Wuersch, M. PInzger, and H. Gall, "Change distilling: Tree differencing for fine-grained source code change extraction," IEEE Transactions on software engineering, vol. 33, no. 11, pp. 725-743, 2007.
J.-R. Falleri, F. Morandat, X. Blanc, M. Martinez, and M. Monperrus, "Fine-grained and accurate source code differencing," in Proc. Intl. Conf. ASE. ACM, 2014, pp. 313-324.
R. R. Sokal and F. J. Rohlf, "The comparison of dendrograms by objective methods," Wiley Taxon, pp. 33-40, 1962.
A. K. Jain and R. C. Dubes, "Algorithms for clustering data," 1988.
O. J. Dunn, "Multiple comparisons using rank sums," Technometrics, vol. 6, no. 3, pp. 241-252, 1964.
Statistics How To. Dunn's test. [Online] . Available: https://www.statisticshowto.datasciencecentral.com/dunns-test/
X. B. D. Le, D. Lo, and C. Le Goues, "History driven program repair," in Proc. Intl. Conf. SANER, vol. 1. IEEE, 2016, pp. 213-224.
J. Jiang, Y. Xiong, H. Zhang, Q. Gao, and X. Chen, "Shaping program repair space with existing patches and similar code," in Proc. ISSTA. ACM, 2018, pp. 298-309.
