Combining Evolutionary Mutation Testing with Random Selection

Lorena Gutierrez-Madronal, Antonio Garcia-Dominguez, Inmaculada Medina-Bulo

Research output: Chapter in Book/Published conference outputConference publication

Abstract

Mutation testing is a well-known fault-based technique that has been applied to different domains as new technologies have appeared. Evolutionary Mutation Testing (EMT) finds mutants that are useful to produce new test cases. It uses evolutionary algorithms to reduce the number of mutants that are generated, keeping as many difficult to kill and stubborn mutants (strong mutants) as possible in the reduced set. Given the popularity of real-time systems, the MuEPL mutation system was developed for the Esper Event Processing Language (EPL), a query language aimed at the Internet of Things (IoT). In past work, EMT was integrated into MuEPL, and it reduced the cost of finding strong mutants in some EPL queries but not in others. This study takes a step forward by proposing and evaluating two metaheuristics for EMT that combine EMT and random selection: one which bootstraps the hall of fame with a random subset (Bootstrapped EMT), and one which falls back to random selection after a certain point (Inverse EMT). While BEMT is shown to outperform IEMT in most cases, BEMT has not managed to outperform EMT. An additional experiment studies the impact of low-quality mutation operators in the relative performance of BEMT, IEMT and plain EMT. Results suggest that the MuEPL RRO operator was the reason for the poor performance of EMT in some scenarios.

Original languageEnglish
Title of host publication2020 IEEE Congress on Evolutionary Computation, CEC 2020 - Conference Proceedings
PublisherIEEE
ISBN (Electronic)9781728169293
ISBN (Print)978-1-7281-6930-9
DOIs
Publication statusPublished - 3 Sep 2020
Event2020 IEEE Congress on Evolutionary Computation, CEC 2020 - Virtual, Glasgow, United Kingdom
Duration: 19 Jul 202024 Jul 2020

Publication series

Name2020 IEEE Congress on Evolutionary Computation, CEC 2020 - Conference Proceedings

Conference

Conference2020 IEEE Congress on Evolutionary Computation, CEC 2020
CountryUnited Kingdom
CityVirtual, Glasgow
Period19/07/2024/07/20

Fingerprint

Dive into the research topics of 'Combining Evolutionary Mutation Testing with Random Selection'. Together they form a unique fingerprint.

Cite this