Counting passed/failed test cases correctly

Ranorex Studio, Spy, Recorder, and Driver.
atam
Posts: 15
Joined: Wed Jan 16, 2013 2:58 pm
Contact:

Counting passed/failed test cases correctly

Post by atam » Fri May 24, 2013 2:19 pm

Hi,

We use Ranorex for GUI tests an our setup is the following (one solution):

TestSuite - > This is the entire scope (This is actually the entire regression suite)
-->Suite1 (Test Case Module)
-----> TestCase (Test Case Module)
----> Test Case Sub Module (Test Case Module)
----> Recordings come here...
-->Suite 2
-----> TestCase (Test Case Module)
----> Test Case Sub Module (Test Case Module)
----> Recordings come here...

etc...

Problem is that, we have say 40 test cases, but because Ranorex counts each "Ranorex Test Case module" as a seperate test case, our "Pass/Failed/Blocked" counts are incorrect.

Is there a way to solve this issue? Hope I have explained it in a good way. If not I can further elaborate.

Thanks!

User avatar
Support Team
Site Admin
Site Admin
Posts: 12145
Joined: Fri Jul 07, 2006 4:30 pm
Location: Houston, Texas, USA
Contact:

Re: Counting passed/failed test cases correctly

Post by Support Team » Mon May 27, 2013 3:06 pm

Hello,

I am not sure if I understand your issue correctly.
Could you give me more information about the issue please. It would be helpful to get the Ranorex Report file in order to understand what's going on.
Thank you!

Regards,
Bernhard

atam
Posts: 15
Joined: Wed Jan 16, 2013 2:58 pm
Contact:

Re: Counting passed/failed test cases correctly

Post by atam » Wed May 29, 2013 9:01 am

Hi,

One test case can consist of multiple sub-test cases in our solution in Ranorex. If 3/4 sub test cases fail, we want this to count as one fail (for the entire test case a as whole and not 3 fail counts).

User avatar
Support Team
Site Admin
Site Admin
Posts: 12145
Joined: Fri Jul 07, 2006 4:30 pm
Location: Houston, Texas, USA
Contact:

Re: Counting passed/failed test cases correctly

Post by Support Team » Fri May 31, 2013 2:04 pm

Hello,

Thank you for the additional description.
This is a design decision in Ranorex. Every test case which fails will increase the counter of failed test cases.
It doesn't depend on if the test case is nested or not.
Sorry!

Regards,
Bernhard