Notes for the Approver

Manual tests and Tosca Tests differ in a few significant ways:

  • Where Test steps and Test Sets are authored
  • Where & How tests run, and
  • How to approve results

Tosca Test Steps are authored in Tosca. Tosca Execution Lists – the Tosca equivalent to ALM Test Sets – are also authored in Tosca. Importantly, since Tosca tests run in Tosca, each of these must are fully dry-run tested in Tosca, before requesting official runs for final results review & approval.
The main difference and "learning curve" for new Approvers of Tosca Test Results is knowing how to read the final Run Report. For Tosca Tests, formal execution takes place at a Test Set level. After a Test Set runs, a report is returned and attached to the Test Set that contains results for each Test Case in the Test set. The Approver opens this attachment in order to review results before post-Approving the Test Set.


Note the following high-level differences between running Manual ALM tests and Automated Tosca tests using the ALM-VERA Integration:

Manual vs.

Tosca Automation

Author Test Steps and dry run in ALM

Author steps in Tosca; In ALM create a Test and associate with a Tosca Test Case.

Approve Test in ALM

Approve Test in ALM (No difference). But, there are no ALM Test Steps. Tosca Test Step descriptions are found in ALM's 'Test Script' tab.

Build Test Sets by selecting individual Tests from Test Plan

Build Execution List and dry run in Tosca; In ALM, create a Test Set and associate with a Tosca Execution List

In ALM, set Test Set status to a value that allows Execution

In ALM, set Test Set Status to a value that allows Execution. (No difference)

Run Tests one at a time

The entire Test Set can be executed all at once or individual test instances can be selected for execution in the Tosca Adapter run dialog

Look at Run Steps to review and approve results

Look at the Tosca Run report, attached to the Test Set, to review and approve results.

Apply approvals and signatures to Run entities

Apply approvals and signatures to the Test Set, not to individual Runs