Not stable work of the Ranorex with mobile applications

Mobile Testing, Android App Testing.
Oksana
Posts: 64
Joined: Tue Jan 15, 2013 10:20 am

Not stable work of the Ranorex with mobile applications

Post by Oksana » Wed Dec 25, 2013 4:06 pm

Hello!

I've encountered with not stable work of the Ranorex, when running the bunch of tests on the mobile devices (both iOs and Android).

In this case appear such errors:
- Cannot perform XML-RPC calls with this endpoint, becasue the underlying network channel is not in the connectd state.
- Device communication timed out. Either no instrumented application is running on the device or the device was not able to process the request within the specified timeout of '00:00:10'. Check that an instrumented application is running on the device or try to increase the timeout.

Additionally, for Android: when we try to find some element in Ranorex, application closes. Looks like, that application is closed each time, when the element, which is searched (using TryFindSingle()), doesn't exist.

Also, instrumented application works too slow in comparison with not instrumented one, no matter who performs some action (Ranorex or human). And the longer we use instrumented application, the bigger is time of responce on user actions.

One more note:
iOs application crashes, when we try to select certain element in the table.
Our develpers team has investigated the crash and came to the conclusion that the Ranorex library does not correctly handle the fullScreen presentation of navigation controllers. Here’s a brief description of the problem:

We’re presenting UINavigationController with animation and UIModalPresentationFullScreen and UIModalTransitionStyleCoverVertical styles.
This results in the infinite recursive loop and stack overflow:

szone_malloc_should_clear
szone_malloc
malloc_zone_malloc
__CFAllocatorSystemAllocate
CFAllocatorAllocate
_CFRuntimeCreateInstance
CFBasicHashCreate
CFSetCreateMutable
CFRunLoopTimerCreate
-[NSCFTimer initWithFireDate:interval:target:selector:userInfo:repeats:]
+[NSTimer(NSTimer) scheduledTimerWithTimeInterval:target:selector:userInfo:repeats:]
+[RxAnimationTracker startTimer:]
+[RxAnimationTracker animationStartedWithDuration:]
+[RxAnimationTracker animationStarted]
-[UIViewController(RxAutomation) rxAutomation_viewController_ViewWillAppear:]
-[UINavigationController viewWillAppear:]
-[UIViewController(RxAutomation) rxAutomation_viewController_ViewWillAppear:]
-[UINavigationController viewWillAppear:]
-[UIViewController(RxAutomation) rxAutomation_viewController_ViewWillAppear:]
-[UINavigationController viewWillAppear:]
-[UIViewController(RxAutomation) rxAutomation_viewController_ViewWillAppear:]
-[UINavigationController viewWillAppear:]

......

-[UIViewController(RxAutomation) rxAutomation_viewController_ViewWillAppear:]
-[UINavigationController viewWillAppear:]


Investigation of the memory usage of the iOs application (performed using Instruments Activity monitor) shows that the longer we use instrumented application (without its restarting) the more real and virtual memory it uses, and these values are much greater than for not instrumented application. CPU usage and User Load values are also too big, and when application doesn't react on some user actions, these values are about 90 - 100 %.

Do you have some ideas about the reasons of such behaivor? And what can you advise?

Sincerely,
Oksana

User avatar
mebner
Posts: 61
Joined: Tue Dec 17, 2013 6:42 pm

Re: Not stable work of the Ranorex with mobile applications

Post by mebner » Mon Dec 30, 2013 4:08 pm

Hi Oksana,

We would need more additional information about the described issues.
May I ask you to answer the following questions?
Which Ranorex version are you using?
Which Android and iOS version is in use?
You wrote that the iOS application crashes when you try to select certain element in the table. Does it just crash when you try to select the elements of that table or in other situations too?
Regarding the Android problem, does this (closing of the application) always happen with each of the elements or just with specific ones?
Could you send us (to [email protected]) the specific apps? This would allow us to analyze the issues in detail.

Regards,
Markus

JToelstede
Posts: 55
Joined: Fri May 24, 2013 12:57 pm

Re: Not stable work of the Ranorex with mobile applications

Post by JToelstede » Thu Jan 23, 2014 12:29 pm

Hi together,

are there any news to this topic?

We have the same problem in our automation for an iOS app.
With out the Ranorex-Agent our app is running with out any problems. When we integrate the agent in our app and run the automated tests the app crashed with low memory.
In the activity monitor of xCode I found out that in our case the virtual memory is the problem.
With the agent the use of virtual memory of our app is over 1 GB before it crashed and with out the agent it is between 200 and 400 MB.

I use Ranorex 4.1.3 with the libRxAutomationUni_413.a.
The test device is an iPad with iOS 7.0.4.

Regards,
Joerg

User avatar
mebner
Posts: 61
Joined: Tue Dec 17, 2013 6:42 pm

Re: Not stable work of the Ranorex with mobile applications

Post by mebner » Fri Jan 24, 2014 12:00 pm

Hi Joerg,

Oksana described different problems, to which one do you refer to, just the one with the memory?

May I ask if you could send us (to [email protected]) your xCode project for further analysis?
This would be great and would allow us to analyze the issue much faster :).

Thanks,
Markus

JToelstede
Posts: 55
Joined: Fri May 24, 2013 12:57 pm

Re: Not stable work of the Ranorex with mobile applications

Post by JToelstede » Mon Jan 27, 2014 1:46 pm

Hi Markus,

I refer just to the memory problem with my post.

Sorry but I'm not allowed to send our xCode project to you.

Best regards,
Joerg

User avatar
Support Team
Site Admin
Site Admin
Posts: 11709
Joined: Fri Jul 07, 2006 4:30 pm
Location: Graz, Austria

Re: Not stable work of the Ranorex with mobile applications

Post by Support Team » Wed Feb 12, 2014 11:10 am

Hi Joerg,

I am sorry for the slow response!

We are very sorry but without the xCode project we are not able to reproduce the described issue.

We do a lot of tests and the tests also include Memory and CPU profiling in combination with our internal apps.

We try to cover as much as possible, but we know that it is not possible to cover everything in a test.
Therefore it is sometimes necessary to get the xCode project in order to be able to reproduce certain customer reported issues.

In our case we haven't seen a significant increase of the memory consumption during our tests with Ranorex 5.0.
Ranorex 5.0 should be released in the next weeks, so it is likely that your issue is also fixed with the new Ranorex version.

Regards,
Markus
.
Image

JToelstede
Posts: 55
Joined: Fri May 24, 2013 12:57 pm

Re: Not stable work of the Ranorex with mobile applications

Post by JToelstede » Fri Feb 14, 2014 9:04 am

Hi Markus,

thanks a lot for your answer.

I am very sorry that I could not send you the xCode-project but I have signed an arrangement of confidentiality at my customer that prohibits that to me.

I am trying to code an example-project where you can reproduce the problem.

We are still checking the problem on our side and if we find some evidence I will let you know.

Thanks a lot for your help.

Best regards,
Joerg

User avatar
Support Team
Site Admin
Site Admin
Posts: 11709
Joined: Fri Jul 07, 2006 4:30 pm
Location: Graz, Austria

Re: Not stable work of the Ranorex with mobile applications

Post by Support Team » Mon Feb 17, 2014 5:26 pm

Hi Joerg,

You're welcome!

It would be great if you could send us a sample project :), this would help us a lot.

I am looking forward to hearing from you.

Regards,
Markus
.
Image

User avatar
Support Team
Site Admin
Site Admin
Posts: 11709
Joined: Fri Jul 07, 2006 4:30 pm
Location: Graz, Austria

Re: Not stable work of the Ranorex with mobile applications

Post by Support Team » Thu Mar 06, 2014 5:00 pm

Hi,

The new 5.0 includes many improvements regarding iOS and Android testing.
May I ask you to check if the issue is fixed with the new Ranorex version 5.0?

Thanks,
Markus
.
Image

Oksana
Posts: 64
Joined: Tue Jan 15, 2013 10:20 am

Re: Not stable work of the Ranorex with mobile applications

Post by Oksana » Fri Mar 14, 2014 4:00 pm

Hello,

It seems that there is no such issue in Ranorex 5.0 for iOS, but for Android it became even worse.
The thing is that often in different test cases Ranorex discover Android device with instrumented application as 'MobileDevice' (status 'DeviceConnected') instead of the 'MobileApplication' (even trying in Spy to reconnect device and refresh elements tree doesn't help). Although during running the same test cases on the same device but with Ranorex 4.1.5 such issue doesn't appear.

Can you investigate this problem? What could cause it? What can you advise to solve it?

Tanks in advance,
Oksana

User avatar
Support Team
Site Admin
Site Admin
Posts: 11709
Joined: Fri Jul 07, 2006 4:30 pm
Location: Graz, Austria

Re: Not stable work of the Ranorex with mobile applications

Post by Support Team » Wed Mar 19, 2014 2:00 pm

Hi Oksana,

Are you sure you have instrumented your apps using Ranorex 5.0?
If not, please instrument them with the current Ranorex version.

Regards,
Markus
.
Image

Oksana
Posts: 64
Joined: Tue Jan 15, 2013 10:20 am

Re: Not stable work of the Ranorex with mobile applications

Post by Oksana » Wed Mar 19, 2014 2:03 pm

Hello,

I've instrumented application with Ranorex 5.0.

User avatar
Support Team
Site Admin
Site Admin
Posts: 11709
Joined: Fri Jul 07, 2006 4:30 pm
Location: Graz, Austria

Re: Not stable work of the Ranorex with mobile applications

Post by Support Team » Thu Mar 20, 2014 3:13 pm

Hello Oksana,

Additionally please ensure that you have updated your Ranorex service app on your mobile device.

Regards,
Robert
.
Image

Oksana
Posts: 64
Joined: Tue Jan 15, 2013 10:20 am

Re: Not stable work of the Ranorex with mobile applications

Post by Oksana » Thu Mar 20, 2014 3:49 pm

Hello,

Yes, I've updated Ranorex service on the device (downloaded from http://www.ranorex.com/download/mobile/500.apk)

Sincerely,
Oksana

User avatar
Support Team
Site Admin
Site Admin
Posts: 11709
Joined: Fri Jul 07, 2006 4:30 pm
Location: Graz, Austria

Re: Not stable work of the Ranorex with mobile applications

Post by Support Team » Fri Mar 21, 2014 3:00 pm

Hello Oksana,

Unfortunately we are currently not aware of such an issue. Would it be possible that you provide your APK-file to us? That would help us in analyzing your issue since we are out of ideas right now.
If yes, please send the file to: [email protected]

Regards,
Robert
.
Image