Test Case Management Integrations : Automation Discussions

[atom]

Hiya People,

Have a general question about test case / test results management
Was wondering how the ranorex community generally manage the following:

- Mapping manual test cases (from a TCM system e.g. Quality Center) to automated test case .exe's
- Mapping and storing of automated results back in the TCM system

For example say you have a manual tests case in your TCM management system that has Id=4320
You then develop an automated test case solution for it
At this point you need to map the manual test case id to your automation solution

You then run your automated test and output say the ranorex log file and a Pass/Fail/Error status
You then need to store the log file and the result back in the TCM system
This way your automated and manual results are in the same place

Has anyone done such integrations?

Thanks

[sdaly]

In QC this is fairly straight forward. When you create a test case in QC, instead of selecting a manual test select the vapi-xp test. Put the manual test steps in the normal steps section and in the script section add vbscript to kick off the test exe passing the name of the test as an argument. When I tried this I had trouble getting the return value from the exe but you can use the vbs instr function to find a string such as TESTPASS or TESTFAIL to determine the result. In test lab then you can easily create test cycles with instances of the tests to run (you can even use this for distributed testing too). If you want to upload the log, you can do so from the test exe using the QC OTA API - see one of my posts for some snippets.

Personally though I hate QC, mainly because of its sluggishness! Therefore in my previous role I steered clear of it and built my own auto test manager which loaded a test exe in and used reflection to display the available tests in a tree. You then selected the tests to run, they were kicked off, the result was stored in an access database and the log and screenshots were archived to a shared drive. There was then a grid which showing the tests and their tests runs which when double clicked loaded the log.

[alice135]

I'm evaluating a change of Test Management Tool. Currently we are using TestLink and have 3000 TCs on it. My main issues with it are; the lack of field customization in TC creation, not possible to call reusable TCs, HTML tags needed to format text... I have the possibility of request budget for a paid tool, but it should be worth it and affordable (Not like HP Quality Center). Of course generic cialis I will need to migrate my current suite to the new tool and it will be great if the tool could be integrated with JIRA as we use it for Bug/Req tracking. I would greatly appreciate if somebody could give me feedback and advice on this subject.

[elba23]

So basically the most important features for you are:

Custom Fields
Reusable Test Cases
HTML Tags
JIRA Integration

If you can live with Markdown syntax rather cialis than HTML (however HTML too will be available very soon), I'd suggest to try our new tool, Test Collab. All other features are available as per your requirement.
We also have migration service for new users.

As a side note, we have very cool JIRA integration - all defects can be created in background automatically as soon as test is marked failed.