Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Combinatorial Testing

Published

Author(s)

David R. Kuhn, Raghu N. Kacker, Yu Lei

Abstract

Combinatorial testing is a method that can reduce cost and improve test effectiveness significantly for many applications. The key insight underlying this form of testing is that not every parameter contributes to every failure, and empirical data suggest that nearly all software failures are caused by interactions between relatively few parameters. This finding has important implications for testing because it suggests that testing combinations of parameters can provide highly effective fault detection. This article introduces combinatorial testing and how it evolved from statistical Design of Experiments approaches,explains its mathematical basis, where this approach can be used in software testing, and measurements of combinatorial coverage for existing test data.
Citation
Encyclopedia of Software Engineering

Keywords

combinatorial testing, covering arrays, design of experiments, pairwise testing, pseudoexhaustive testing, software assurance, software testing, verification

Citation

Kuhn, D. , Kacker, R. and Lei, Y. (2012), Combinatorial Testing, Encyclopedia of Software Engineering, [online], https://tsapps.nist.gov/publication/get_pdf.cfm?pub_id=910001 (Accessed October 31, 2024)

Issues

If you have any questions about this publication or are having problems accessing it, please contact reflib@nist.gov.

Created June 24, 2012, Updated February 19, 2017