Export test results - API -TestRail

Ask general questions here.
wlijo
Posts: 25
Joined: Thu May 07, 2015 8:50 pm

Export test results - API -TestRail

Post by wlijo » Mon Jan 04, 2016 1:55 pm

Hi to all,

Happy new year!

I'm using TestRail as test case manager and I'd like to find a way to obtain a relationship between Ranorex and TestRail when I perform a regresion.

At this moment I only have an JSON API for TestRail, and i think i have two options:

1. Find a way to execute test cases from TestRail in Ranorex and after finish that Ranorex send the result to TestRail
2. Execute test case from Ranorex, obtain the result from an API or text plain and convert the information to send to TestRail through JSON API (I have it)

I searched information but I wasn't able to find something that could help me.

I hope some can help me or give me an another idea.

Best regards.

Walter.-

dmitry.abramov
Posts: 10
Joined: Wed Jan 28, 2015 3:41 pm

Re: Export test results - API -TestRail

Post by dmitry.abramov » Sun May 15, 2016 6:35 pm

Hello,

May be my answer is late for you but it can help someone else.

Common schema of solution placed in attachement.
At the first we added two custom fields in TestRail to store name of Ranorex test suite and configuration corresponding to test. This fields help map TestRail tests to Ranorex tests. Then UI Scripts was used to extend TestRail UI with button to start test running. Clicking on it makes request to Test Execution Server. Request contains data to identificate Ranorex test for execution(in our case it was name of Ranorex test suite and Ranorex configuration) and data to identificate test in TestRail to post result. Also there can be additional parameters like environment for execution, browser or something specific for your SUT.

Test Execution Server responsible for running tests, archiving executing artifacts(reports) and posting results. Our solution was based on Jenkis, so as API we use Jenkins REST API to start job. Executing and posting results was implemented as PowerShell script inside Jenkins job step. It launch Ranorex test via command line and make request to TestRail API to post results.

Possibly Remote Testing feature in Ranorex 6.0 will take some responsobilities of Test Execution Server in future
http://www.ranorex.com/remote-testing.html

Some other usefull links:
Ranorex Configurations
http://www.ranorex.com/support/user-gui ... html#c3019
Start Ranorex tests from command line
http://www.ranorex.com/support/user-gui ... html#c4827
Triggering tests from TestRail
http://docs.gurock.com/testrail-custom/ ... on-trigger
UI Scripts
http://docs.gurock.com/testrail-custom/ ... troduction
Posting Results to TestRail
http://docs.gurock.com/testrail-api2/re ... add_result

Regards,
Dmitry
Attachments
Schema.png
Schema of solution
Schema.png (15.56 KiB) Viewed 2262 times

SanMan
Posts: 151
Joined: Tue Apr 13, 2010 9:59 am

Re: Export test results - API -TestRail

Post by SanMan » Wed Feb 21, 2018 2:09 pm

Hi,

also setting up testing tools.

Testrail will be most like be selected as test managent tool.

I really need to know if it is possible to integrate TestRail and Ranorex and is it hard to setup this integration?

User avatar
Product Management
Certified Professional
Certified Professional
Posts: 11
Joined: Thu Sep 07, 2017 3:09 pm

Re: Export test results - API -TestRail

Post by Product Management » Thu Feb 22, 2018 8:57 am

Hello,

I am very happy to tell you that we are working on a tight integration with TestRail. There will be an import and export functionality available as well as functionality for auto-uploads of test results. The feature will be part of our upcoming version Ranorex 8.1 by the end of Q1 2018.

If you can't wait for the official release date to arrive, feel free to sign up for our Ranorex Beta Program. We plan to provide a first 8.1 beta version soon (next week).

Best regards
Ranorex Product Management Team