Notes for the Approver
Manual tests and Tosca Tests differ in a few significant ways:
- Where Test steps and Test Sets are authored
- Where & How tests run, and
- How to approve results
Tosca Test Steps are authored in Tosca. Tosca Execution Lists – the Tosca equivalent to ALM Test Sets – are also authored in Tosca. Importantly, since Tosca tests run in Tosca, each of these must are fully dry-run tested in Tosca, before requesting official runs for final results review & approval.
The main difference and "learning curve" for new Approvers of Tosca Test Results is knowing how to read the final Run Report. For Tosca Tests, formal execution takes place at a Test Set level. After a Test Set runs, a report is returned and attached to the Test Set that contains results for each Test Case in the Test set. The Approver opens this attachment in order to review results before post-Approving the Test Set.
Note the following high-level differences between running Manual ALM tests and Automated Tosca tests using the ALM-VERA Integration:
Manual vs. | Tosca Automation |
Author Test Steps and dry run in ALM | Author steps in Tosca; In ALM create a Test and associate with a Tosca Test Case. |
Approve Test in ALM | Approve Test in ALM (No difference). But, there are no ALM Test Steps. Tosca Test Step descriptions are found in ALM's 'Test Script' tab. |
Build Test Sets by selecting individual Tests from Test Plan | Build Execution List and dry run in Tosca; In ALM, create a Test Set and associate with a Tosca Execution List |
In ALM, set Test Set status to a value that allows Execution | In ALM, set Test Set Status to a value that allows Execution. (No difference) |
Run Tests one at a time | The entire Test Set can be executed all at once or individual test instances can be selected for execution in the Tosca Adapter run dialog |
Look at Run Steps to review and approve results | Look at the Tosca Run report, attached to the Test Set, to review and approve results. |
Apply approvals and signatures to Run entities | Apply approvals and signatures to the Test Set, not to individual Runs |