Research Article

Mutation Testing for Container Orchestration Declarative Configurations: An Empirical Evaluation on Kubernetes

148 reads
SCI J Softw Eng Cloud Comp, 2026, 1 (1), 21-26, ISSN

Abstract

As cloud-native software architectures increasingly rely on declarative Infrastructure as Code (IaC) paradigms, ensuring the correctness and resilience of container orchestration configurations has become critical. Misconfigurations in Kubernetes manifests frequently lead to severe runtime outages, security vulnerabilities, and deployment failures. While traditional software engineering employs mutation testing to evaluate the effectiveness of test suites, its application to declarative container orchestration remains largely unexplored. In this paper, we propose a domain-specific mutation testing framework tailored for Kubernetes declarative configurations. We define a comprehensive taxonomy of mutation operators targeting pod resource specifications, health probes, networking definitions, deployment strategies, and security contexts. We conduct an empirical evaluation across 25 production-grade open-source cloud repositories, generating and executing over 4,500 mutants against existing static linters and dynamic validation suites. Our findings reveal that conventional static analysis tools achieve an average mutation score of only 38.4%, whereas dynamic cluster integration testing reaches 64.2%. Combining static analysis with automated dynamic assertion suites yields an overall mutation score of 88.7%. These results highlight significant diagnostic blind spots in modern DevOps pipelines and demonstrate the viability of mutation testing for elevating the reliability of cloud deployment manifests.

Keywords Container Orchestration Mutation Testing Kubernetes Infrastructure as Code DevOps
Authors 3

The team behind this paper

3 authors, 3 institutions.

This paper Tokyo Institute of Technology — Japan Tokyo Institute of Tech… 1 author Technical University of Munich — Germany Technical University of… 1 author University of São Paulo — Brazil University of São Paulo 1 author Prof. Hiroshi Tanaka — corresponding author HT Prof. Hiroshi Tanaka ✉ Dr. Elena Rostova ER Dr. Elena Rostova Dr. Mateo Silva MS Dr. Mateo Silva

Readership

148 reads over 4 months.

#5 most read in this journal this month
August 2026 November 2026

Bibliographic Information

Prof. Hiroshi Tanaka, Dr. Elena Rostova, Dr. Mateo Silva, (2026). Mutation Testing for Container Orchestration Declarative Configurations: An Empirical Evaluation on Kubernetes, SCI Journal of Software Engineering and Cloud Computing, 1(1): 21-26
Bibtex Citation
@article{prof._hiroshi_tanaka2026sjsecc,
author = {Prof. Hiroshi Tanaka and Dr. Elena Rostova and Dr. Mateo Silva},
title = {Mutation Testing for Container Orchestration Declarative Configurations: An Empirical Evaluation on Kubernetes},
journal = {SCI Journal of Software Engineering and Cloud Computing},
year = {2026},
volume = {1},
number = {1},
pages = {21-26},
doi = {},
url = {https://scimatic.org/show_manuscript/9148}
}
APA Citation
Tanaka, P.H., Rostova, D.E., Silva, D.M., (2026). Mutation Testing for Container Orchestration Declarative Configurations: An Empirical Evaluation on Kubernetes. SCI Journal of Software Engineering and Cloud Computing, 1(1), 21-26. https://doi.org/

Author Information

  • To change your profile photo, login to scimatic.org, go to your profile and change the photo.
  • Any photo that shows your face will do: we crop it to your head and shoulders and give it a plain background automatically.
  • To sign in, go to Sign in and enter the e-mail address registered with the article: we e-mail you a one-time sign-in link (there is no password).
  • In case of any other problem, contact your editor directly or write to us at info @ scimatic.org