Combinatorial testing with Cucumber

Question

I have a scenario outline that has two different variables. One variable has about 20 different values and the other has 3.

I need to be able to test every single combination and I need each in a separate scenario since they must be tested independently.

Currently, I just write it out by hand(they are integers in the example but not in my test):

Scenario Outline: Test my stuff
Given first var is <var_a>
And second var is <var_b>
When I do stuff
Then good stuff should happen

Examples:
| var_a | var_b |
| 1     | 1     |
| 1     | 2     |
| 1     | 3     |
| 2     | 1     |
| 2     | 2     |
etc...

Question: Is there a way to run this where every combination doesn't have to be written out? The variables are bound to change in size and content later on and I would prefer to have a single data structure to deal with.

Answer 1

Scenario: Test my stuff
Given first var combinations is @var_a_combos
Given second var combinations is @var_b_combos
When I run every combination
Then good stuff should happen

• @var_a_combos and @var_b_combos are an Enumerable that contains every different possibility for that type.
• The When I run every combination will iterate over both variables and test every single combination. Instead of using an assertion, it will instead create a @results(String) variable that will list any failures and their required debugging data.
• The Then good stuff should happen will run the code @results.should eql "" to determine whether the test case passed/failed.

The purpose of using a String variable to hold the results(instead of an assertion) is to ensure that testing does not stop when the first failure is encountered.

I really don't like this solution but it is the best I could come up with so far. I appreciate the other answers but this testing really is integration testing and I really do need to test every combination.

If anyone posts further answers I will review them and change the accepted answer if I think it is better.