Automation Readiness Score

Prev Next

The Automation Readiness Score helps teams quickly evaluate which manual test cases are strong candidates for automation, based on Panaya’s automation capabilities.

  • The score is calculated using the step descriptions and metadata of each test.

  • Evaluations are based solely on technical feasibility, not business priority.

  • Supports evaluation per cycle or per folder.

  • An email notification is sent when the evaluation is complete.


How it Works

Each manual test case step is reviewed according to Panaya’s Test Automation features and capabilities.

The evaluation considers the type of action performed, the application or system under test, the expected results, and the required validations.

Steps may be fully supported, partially supported, or unsupported. The overall score reflects a clear indication of the potential for automation.

  • High scores mean the process can be automated quickly and reliably.

  • Medium scores show that parts of the process can be automated, while others may benefit from small adjustments.

  • Lower scores indicate that the process may require refinement before being a strong automation candidate.

Why It Matters

By using the score, teams can -

  • Identify which test cases can be automated most easily.

  • Accelerate automation efforts with clear priorities.

  • Maximize efficiency and consistency in test execution.

Starting the Evaluation

In order for users to see and review the automation readiness in the general tab of tests, an admin or manager must first start evaluating a cycle or a folder in the project test tree.

Important!

  • To be able to start the evaluating the the automation readiness score of cycles and folders, the user must be assigned the Test > Run Automation Readiness permission, which is on by default for the Project Manager Role.

Follow the steps below to start the evaluation.

  1. In the Test Tree, right-click on a folder or cycle in the tree and select Automation Readiness.

  2. Click on Start evaluation.

  3. Upon completion of the evaluation, you will receive an email notification.

  4. You can check the evaluation status by clicking on the Request Status button.

Reviewing the Score

Once the evaluation has been completed, users with access to the relevant project can review the automation readiness.

The automation readiness appears in the Essential section of the General tab of standard tests.