Multiple Test Suites : General Questions

Multiple Test Suites

Ask general questions here.

Multiple Test Suites

Postby tallahassee101 » Mon May 07, 2012 6:39 pm

Hi,

We are currently using Ranorex to test a large scale product and our test suite which we are constantly adding to currently runs for 4.5 hrs. We are planning on splitting this into a few smaller test suites, however the problem I am seeing looking through the forums is that there does not seem to be a solution for combining test reports. Is there any planned fix/feature for this issue as I see there are a few people in the forums experiencing the same issue?

Thank you.
tallahassee101
 
Posts: 169
Joined: Thu Jan 13, 2011 3:06 pm

Re: Multiple Test Suites

Postby Support Team » Tue May 08, 2012 2:11 pm

Hi,

does not seem to be a solution for combining test reports.

So you want to include one test report into another, or just specific test cases or recordings?
Maybe you can give us an example? How should these combined test reports look like?

Regards,
Markus
Ranorex Support Team
User avatar
Support Team
Site Admin
 
Posts: 6853
Joined: Fri Jul 07, 2006 5:30 pm
Location: Graz, Austria

Re: Multiple Test Suites

Postby tallahassee101 » Tue May 08, 2012 4:00 pm

Hi Markus,

I would like to combine multiple test reports into one so that it looks like one test report. Each test report could just be a a different parent folder.
So as below Test Suite 1 and 2 would be individually generated test reports. The Master Suite level would be the combination and would show the coverage percentage/number and the pie graph.

Master Suite (75%)
Test Report Test Suite 1 (100%)
Test A - Pass
Test B - Pass
Test Report Test Suite 2 (50%)
Test C - Pass
Test D - Fail

Thanks for any help
tallahassee101
 
Posts: 169
Joined: Thu Jan 13, 2011 3:06 pm

Re: Multiple Test Suites

Postby Support Team » Thu May 10, 2012 11:29 am

Hi,

I will add this to our internal feature request list and we will internally discuss this if we will implement such an feature in a future release.
Thanks for this input!

Regards,
Markus
Ranorex Support Team
User avatar
Support Team
Site Admin
 
Posts: 6853
Joined: Fri Jul 07, 2006 5:30 pm
Location: Graz, Austria

Re: Multiple Test Suites

Postby tallahassee101 » Thu May 10, 2012 4:37 pm

Markus,

No problem. I played around with the XML that was generated by ranorex the other day ( we select to generate an XML file rather than an RXLOG ). It seems as if this could be done fairly easily by combining the 3rd nested activity node in the XMLs. By pulling out this node ( and all it's children ) and adding it to the second generated XML file at the same level the pie graph at the top combines the two reports. The only thing that didn't work was the duration since that is at the 2nd nested activity node level, rather than reading it from the 3rd set of nodes.
Hope this helps!

-Nick
tallahassee101
 
Posts: 169
Joined: Thu Jan 13, 2011 3:06 pm

Re: Multiple Test Suites

Postby Support Team » Fri May 11, 2012 4:08 pm

Hi Nik,

You can of course copy/manipulate the xml code, but this is not supported/recommended as it can cause side effects.
For example if you want that the total duration is shown, you have to manually set the specific duration tag to the new value.

Regards,
Markus
Ranorex Support Team
User avatar
Support Team
Site Admin
 
Posts: 6853
Joined: Fri Jul 07, 2006 5:30 pm
Location: Graz, Austria

Re: Multiple Test Suites

Postby tallahassee101 » Tue May 15, 2012 5:06 pm

Markus,

It was actually fairly easy to do with a Python script. I was able to combine our 4 new test reports into one and show the pie chart and combined run time based on the xml that was generated from Ranorex.

I attached the script I wrote if anyone is interested in using it. Place this python script in the folder where the multiple XML files are generated and run it once to get a singular XML file.

Thanks,
-Nick
Attachments
CombineTests.py
Place this python script in the folder where the multiple XML files are generated and run it once to get a singular XML file.
(2.36 KiB) Downloaded 54 times
tallahassee101
 
Posts: 169
Joined: Thu Jan 13, 2011 3:06 pm


Return to General Questions

Who is online

Users browsing this forum: No registered users and 0 guests