Long test runs intermittently fail with no indication why
Posted: Sat Feb 01, 2014 6:15 pm
I have a regression suite that consists of about 1100 testcases which take 25-26 hours to run using the TestSuite Runner. Ever since upgrading from 4.0.4 to 4.1.4, the suite intermittently fails (approx 10%). The failure is always at different spots and the report viewer doesn't display any information except for the following text:
"Data file (<filename>.rxlog.data) or transformation file is missing."
In Windows explorer I do see a tmp version of the file:
<filename>.rxlog.data_tmp
Examining the file, I can see that it just stopped writing to the file in mid-stream. I have plenty of free disk space on this box (10 gig free). I also checked event viewer around the time of the failure and no errors or warnings to indicate a problem. Also doesn't see any obvious signs of memory leaks and the overall health of the image when this happens appears to be fine.
Is this a known bug in 4.1?
Does Ranorex have a limitation with number of testcases per test suite? I'd prefer to not have to break them up into smaller test runs but if this keeps happening I will have to as it is frustrating to lose 24 hours. Searching through the partial log file for result="Failed" to determine failures combined with re-running the suite at the failure point is also an option but not a very user friendly one.
Any feedback greatly appreciated.
Thanks,
Greg
P.S. I attached screenshot of report viewer as well as zipped folder containing the partial report files.
"Data file (<filename>.rxlog.data) or transformation file is missing."
In Windows explorer I do see a tmp version of the file:
<filename>.rxlog.data_tmp
Examining the file, I can see that it just stopped writing to the file in mid-stream. I have plenty of free disk space on this box (10 gig free). I also checked event viewer around the time of the failure and no errors or warnings to indicate a problem. Also doesn't see any obvious signs of memory leaks and the overall health of the image when this happens appears to be fine.
Is this a known bug in 4.1?
Does Ranorex have a limitation with number of testcases per test suite? I'd prefer to not have to break them up into smaller test runs but if this keeps happening I will have to as it is frustrating to lose 24 hours. Searching through the partial log file for result="Failed" to determine failures combined with re-running the suite at the failure point is also an option but not a very user friendly one.
Any feedback greatly appreciated.
Thanks,
Greg
P.S. I attached screenshot of report viewer as well as zipped folder containing the partial report files.