Page 1 of 1

Counting passed/failed test cases correctly

Posted: Fri May 24, 2013 2:19 pm
by atam
Hi,

We use Ranorex for GUI tests an our setup is the following (one solution):

TestSuite - > This is the entire scope (This is actually the entire regression suite)
-->Suite1 (Test Case Module)
-----> TestCase (Test Case Module)
----> Test Case Sub Module (Test Case Module)
----> Recordings come here...
-->Suite 2
-----> TestCase (Test Case Module)
----> Test Case Sub Module (Test Case Module)
----> Recordings come here...

etc...

Problem is that, we have say 40 test cases, but because Ranorex counts each "Ranorex Test Case module" as a seperate test case, our "Pass/Failed/Blocked" counts are incorrect.

Is there a way to solve this issue? Hope I have explained it in a good way. If not I can further elaborate.

Thanks!

Re: Counting passed/failed test cases correctly

Posted: Mon May 27, 2013 3:06 pm
by Support Team
Hello,

I am not sure if I understand your issue correctly.
Could you give me more information about the issue please. It would be helpful to get the Ranorex Report file in order to understand what's going on.
Thank you!

Regards,
Bernhard

Re: Counting passed/failed test cases correctly

Posted: Wed May 29, 2013 9:01 am
by atam
Hi,

One test case can consist of multiple sub-test cases in our solution in Ranorex. If 3/4 sub test cases fail, we want this to count as one fail (for the entire test case a as whole and not 3 fail counts).

Re: Counting passed/failed test cases correctly

Posted: Fri May 31, 2013 2:04 pm
by Support Team
Hello,

Thank you for the additional description.
This is a design decision in Ranorex. Every test case which fails will increase the counter of failed test cases.
It doesn't depend on if the test case is nested or not.
Sorry!

Regards,
Bernhard