Page 1 of 1

Export test results - API -TestRail

Posted: Mon Jan 04, 2016 1:55 pm
by wlijo
Hi to all,

Happy new year!

I'm using TestRail as test case manager and I'd like to find a way to obtain a relationship between Ranorex and TestRail when I perform a regresion.

At this moment I only have an JSON API for TestRail, and i think i have two options:

1. Find a way to execute test cases from TestRail in Ranorex and after finish that Ranorex send the result to TestRail
2. Execute test case from Ranorex, obtain the result from an API or text plain and convert the information to send to TestRail through JSON API (I have it)

I searched information but I wasn't able to find something that could help me.

I hope some can help me or give me an another idea.

Best regards.

Walter.-

Re: Export test results - API -TestRail

Posted: Sun May 15, 2016 6:35 pm
by dmitry.abramov
Hello,

May be my answer is late for you but it can help someone else.

Common schema of solution placed in attachement.
At the first we added two custom fields in TestRail to store name of Ranorex test suite and configuration corresponding to test. This fields help map TestRail tests to Ranorex tests. Then UI Scripts was used to extend TestRail UI with button to start test running. Clicking on it makes request to Test Execution Server. Request contains data to identificate Ranorex test for execution(in our case it was name of Ranorex test suite and Ranorex configuration) and data to identificate test in TestRail to post result. Also there can be additional parameters like environment for execution, browser or something specific for your SUT.

Test Execution Server responsible for running tests, archiving executing artifacts(reports) and posting results. Our solution was based on Jenkis, so as API we use Jenkins REST API to start job. Executing and posting results was implemented as PowerShell script inside Jenkins job step. It launch Ranorex test via command line and make request to TestRail API to post results.

Possibly Remote Testing feature in Ranorex 6.0 will take some responsobilities of Test Execution Server in future
http://www.ranorex.com/remote-testing.html

Some other usefull links:
Ranorex Configurations
http://www.ranorex.com/support/user-gui ... html#c3019
Start Ranorex tests from command line
http://www.ranorex.com/support/user-gui ... html#c4827
Triggering tests from TestRail
http://docs.gurock.com/testrail-custom/ ... on-trigger
UI Scripts
http://docs.gurock.com/testrail-custom/ ... troduction
Posting Results to TestRail
http://docs.gurock.com/testrail-api2/re ... add_result

Regards,
Dmitry

Re: Export test results - API -TestRail

Posted: Wed Feb 21, 2018 2:09 pm
by SanMan
Hi,

also setting up testing tools.

Testrail will be most like be selected as test managent tool.

I really need to know if it is possible to integrate TestRail and Ranorex and is it hard to setup this integration?

Re: Export test results - API -TestRail

Posted: Thu Feb 22, 2018 8:57 am
by Product Management
Hello,

I am very happy to tell you that we are working on a tight integration with TestRail. There will be an import and export functionality available as well as functionality for auto-uploads of test results. The feature will be part of our upcoming version Ranorex 8.1 by the end of Q1 2018.

If you can't wait for the official release date to arrive, feel free to sign up for our Ranorex Beta Program. We plan to provide a first 8.1 beta version soon (next week).

Best regards
Ranorex Product Management Team