Skip to main content

Manual Analysis

Manual Analysis is presented on our test report dashboard by “Make decision” modal.

“Make decision” modal feature highlights​

  • View and analyze execution context:

    • See step name and current defect type
    • Expand logs to understand failure reasons
    • Review links to bugs, comments, or special labels (AA, PA, Ignore AA)

  • Select defect type and comment manually:

    • Choose defect from “Manual selection”
    • Add a comment
    • Apply changes to one or multiple test items

  • Use Analyzer suggestions:

    • Pick similar failures based on logs (marked with red asterisk)
    • Automatically apply the same defect type, comment, and linked issue
    • Expand to apply to other items using “Apply for” section

  • Review test history:

    • Check how this step was marked in previous runs
    • Reapply defect type, comment, and BTS link
    • Extend to other similar items

  • Select other test items for bulk editing:

    • Use “Apply for” section to include more items
    • See preview in “Results will be applied for” section
    • Click “Apply” to confirm changes

  • Perform bulk updates efficiently:

    • Select multiple test items
    • Apply defect type, comment and BTS link in one action

“Make decision” modal redesign​

Redesign of the “Make decision” modal was implemented in version 5.7. This feature helps to sort out auto tests and decide: What is the problem? How can it be marked? Is it required to post issue or link issue? It became easier to use this functionality after the redesign.

The “Make decision” modal can be opened in three ways:

  1. from the Step level
  1. via Actions
  1. from the Log level

“Execution to change” section​

“Execution to change” section is displayed at the top left of the “Make decision” modal. It includes Step name, current defect type. Also it can have a log, a comment, a link to a Bug Tracking System (BTS), a label (AA, PA, Ignore AA) if exist. You can expand logs to understand why this step was failed.

How to set a defect type and type a comment​

“Select defect” section is displayed at the top right of the “Make decision” modal. It includes “Manual selection”, “Analyzer suggestions”, “History of the test”.

You can select a defect type and type a comment manually. Selected defect type and added comment will be applied to the current item (there is also a possibility to apply them to other items – please, have a look at “Apply for” section).

How to use “Analyzer suggestions”​

You also can select any step from the “Analyzer suggestions” with a similar log. Similar log is marked with a red asterisk. Then the defect type, the comment and linked BTS ticket (if exist) of the suggested step will be applied to the current item (there is also a possibility to apply them to other items – please, have a look at “Apply for” section).

“History of the test” section​

You can see the “History of the test” – which defect type this step had in previous runs. You can select any item from the “History of the test”. Then the defect type, the comment and linked BTS ticket (if exist) of the suggested step will be applied to the current item (there is also a possibility to apply them to other items – please, have a look at “Apply for” section).

How to select other steps for analysis​

The “Make decision” modal works not only with the current step. This feature allows to select other steps with “To Investigate” defect type which can be changed as well. For that, please, expand the “Apply for” section and select the needed option.

The “Results will be applied for” message is displayed at the bottom after selection. This section was added in version 5.7.

Now you can view all changes before applying. Expand the “Results will be applied for” section to see information about changes. You should click “Apply” button to apply selected changes.

Bulk update​

There is also a possibility for Bulk update, when the changes are applied to all selected test items.

As you can see, “Make decision” modal is a time-saving tool for engineers.