Understanding Certify Results
After process execution, the Result Viewer shows a log of the execution results. In the Result Viewer, you can expand the execution results to show each process and step executed.
The Navigation tree displays a log header with process details. Under the log header is a hierarchy of processes executed. Expand each hierarchy level and view information about the executed processes and steps in the Summary pane.
Result Viewer Menu
You can do the following tasks with the Result Viewer menu options.
File Menu
Option |
Description |
|
Print the Summary pane information. The document opens, and you can select to save it as a Report Document File (RDF). |
Export Step Summary |
Export the Summary pane information as a Comma-Separated Values (CSV) file. |
Close |
Close the Result Viewer. |
Actions Menu
Option |
Description |
Save Captures |
Save Captures from the process results. Select a folder to save the Captures and the Captures are saved as JPG files. |
Compress |
Helps reduce the size of your database and increase performance by removing all process step execution results. You can choose to compress the following:
For more information, see Compressing Execution Results. |
Compare to Other Results |
Compare a test result to another result with the Compare Results tool. For more information, see Comparing Results. |
Highlight First Failed Step on Start |
Highlight the first step that fails. This option makes the results load more slowly. |
Reports Menu
Option |
Description |
Results (Summary) |
Create a summary report. |
Results (Detail) |
Create a report with execution details. |
Results (Recordset) |
Create a report with values in the steps. |
Generate Report Using BPP |
Create a report using a Certify BPP templates. For more information, see Creating Reports Using Certify BPP Templates. |
Toolbar Buttons
Listed below are the Processes window toolbar buttons:
Option |
Description |
|
Export the Summary pane information as a Comma-Separated Values (CSV) file. |
|
Create a report with execution details. |
|
Create a report with values in the steps. |
|
Keep only the summary when compressing your results. Compressing results reduce the size of your database and increase performance by removing all process step execution results. For more information, see Compressing Execution Results. |
|
Keep only the summary and failed steps when compressing your results. Compressing results reduce the size of your database and increase performance by removing all process step execution results. For more information, see Compressing Execution Results. |
|
Move to the next failed or aborted step in the result. |
|
Move to the previous failed or aborted step in the result. |
Result Viewer Summary Pane
From the right-click menu in the Summary pane, you can select to do the following tasks:
Option |
Description |
Print Table |
Print the Summary pane information. The document opens, and you can select to save it as a Report Document File (RDF) or export it. |
Export Table |
Export the Summary pane information as a Comma-Separated Values (CSV) file. |
Export Step Summary |
Export the step summary as a Comma-Separated Values (CSV) file. |
Edit Step |
Edit a failed process step. For more information, see Editing Process Steps from the Result Viewer. |
Certify Results Window
The Certify Results window displays all of your process results. By right-clicking a result in the Summary pane, you can perform the following tasks:
Task |
Description |
Print Table |
Print the Summary pane information. The document opens, and you can select to save it as a Report Document File (RDF) or export it. |
Export Table |
Export the Summary pane information as a Comma-Separated Values (CSV) file. |
View |
Open the Results Viewer to view the steps of the selected result. For more information, see Viewing Results. |
Compare to Other Result |
Compare a test result to another result with the Compare Results tool. For more information, see Comparing Results. |
Delete |
Delete a result. |
Export Report Summary |
Export a summary of the execution results as an XML file. |
Save Captures |
Save Captures from the process results. Select a folder to save the Captures and the Captures are saved as JPG files. |
Promote a Result to a Result of Record |
You will see this option if you select the From Result of Record option from the Requirements Status Calculation menu in Global Settings. If you identify a result as a Result of Record, the status and execution information for each requirement linked to each process in the selected execution will be updated. For more information, see Promoting a Result to a Result of Record. |
Reset from Result of Record |
You will see this option if you select the From Result of Record option from the Requirements Status Calculation menu in Global Settings. Reset a result that already has been promoted to a Result of Record. If you reset the result, the result will no longer appear bolded in the Summary pane. Also, the Status for each requirement linked to each process in the selected execution will be updated with an Unknown value. For more information, see Promoting a Result to a Result of Record. |
Compress |
Helps reduce the size of your database and increase performance by removing all process step execution results. You can choose to compress the following:
For more information, see Compressing Execution Results. |
Reports |
Generate one of the following reports for the selected result:
|
Process Status
If a step fails execution in a process, the process also fails unless the process is aborted. If a step is aborted, the process shows aborted even though some steps may have passed, skipped, or failed execution.
If a process has more than one sub-process and the sub-process fails execution, the parent process is shown as a failed process. If a process has more than one sub-process and the sub-process is aborted, the parent process is shown as an aborted process even though some sub-processes may have passed, skipped, or failed.
Step Status Icons
The Summary pane shows the status for each step with the following icons:
Icon |
Name |
|
Passed step |
|
Skipped step |
|
Failed step |
|
Aborted step |
Each executed process or step is given one of these statuses. In some cases, a process inherits a status based on the status of another process or step. For example:
- If a process passes, then all the steps in the process passed.
- If a process fails, then at least one step in the process failed.
- If a process is skipped, then all steps in the process are skipped.
- If a step or process is aborted, then the execution is stopped.
- If a step failed execution in a process, the process also fails unless the process was aborted.
Note: If a result is locked, you can only view the result. When you select a locked result, a message opens stating the result has been locked.