Feature Request: Rerun Failed testcases

Bug reports.
gcushman
Posts: 10
Joined: Fri Dec 27, 2013 8:16 pm

Feature Request: Rerun Failed testcases

Post by gcushman » Thu May 01, 2014 6:52 pm

I've read various posts in this forum about re-running failed testcases and none of the solutions/suggestions are very helpful/time efficient. Unexpected failures can be caused by a multitude of unpredictable (and often uncontrollable) factors such as:
Temporary Cloud/network outages (we are testing in a SQL Azure environment)
Expired passwords (Saleforce dev account expire every 90 days)
User accidentally interferes with a test running in an RDP session.

It would make for a much better user experience if there was a menu option that allowed one to rerun just the failed testcases. Currently we have to scroll down through the details of the entire log and write down the numbers of the failures and then plug those into the Data Range field. What makes it even more tedious is that we cannot use the "Test Case Filter" = "Failed" option because it is always "disabled for performance" reasons. Also, if the second run still has some failures you then need to correlate the failed testcase number with the original testcase number. For example:
You run your testsuite of 200 testcases and #'s 2-4, 73-75 and 140-142 fail (9 total failures).
You then re-run those 9 by adding them to the Data Range field and test #'s 4 and 8 fail.
You then need to equate #4 -> 73 and #8 -> 141 in the Data Range field.

SilkTest has had this feature for at least 15 years now. The other functionality that goes along with that is the ability to merge the subsequent results file with the previous one.

I would think this would be a very beneficial feature to me and many other users out there.

Regards,
Greg

Mayra
Posts: 68
Joined: Mon Dec 16, 2013 5:27 am

Re: Feature Request: Rerun Failed testcases

Post by Mayra » Tue May 06, 2014 1:51 am

I also vote for this too. I currently have issues with the tool were at some times the path is not found. However there can be other circumstances like the ones you are mentioning.
There is no way in Ranorex to fo a re-run if the test case fails, some logic that I used in the past allowed me to just put a warning for the first failure, immediate re-run of failed test case and then really log an error if the test case fails in second execution. Also, the case that you are raising is important as well.

User avatar
Support Team
Site Admin
Site Admin
Posts: 11709
Joined: Fri Jul 07, 2006 4:30 pm
Location: Graz, Austria

Re: Feature Request: Rerun Failed testcases

Post by Support Team » Fri May 09, 2014 2:42 pm

Hello,

In order to raise and discuss your feature request may I ask you to send it to [email protected]? We want to handle feature request via Email since we want to avoid misunderstandings and want to handle each feature request with care.

Regards,
Robert
.
Image