The Automation Readiness Score helps teams quickly evaluate which manual test cases are strong candidates for automation, based on Panaya’s automation capabilities.
The score is calculated using the step descriptions and metadata of each test.
Evaluations are based solely on technical feasibility, not business priority.
Supports evaluation per cycle or per folder.
An email notification is sent when the evaluation is complete.
How it Works
Each manual test case step is reviewed according to Panaya’s Test Automation features and capabilities.
The evaluation considers -
The type of action performed
The application or system under test
The expected results and required validations
Steps may be fully supported, partially supported, or unsupported. The overall score reflects a clear indication of the potential for automation.
Good to Know!
If the test involves unsupported environments (such as mobile, manual checks, or session switching), the score is significantly limited.
Certain legacy systems, like Oracle EBS, may not be supported and result in lower scores.
When key details and criteria are missing, the result appear as “Not enough information.”
Starting the Evaluation
In order for users to see and review the automation readiness in the general tab of tests, an admin or manager must first start evaluating a cycle or a folder in the project test tree.
Important!
To be able to start the evaluating the the automation readiness score of cycles and folders, the user must be assigned the Test > Run Automation Readiness permission, which is on by default for the Project Manager Role.
AI features must be enabled for your Panaya account.
Follow the steps below to start the evaluation.
In the Test Tree, right-click on a folder or cycle in the tree and select Automation Readiness.
Click on Start evaluation.
Upon completion of the evaluation, you will receive an email notification.
You can check the evaluation status by clicking on the Request Status button.
Reviewing the Score
Once the evaluation has been completed, users with access to the relevant project can review the automation readiness.
The automation readiness appears in the Essential section of the General tab of standard tests.
High
The test is a strong candidate for automation.
Medium
Some parts of the test can be automated, while others may require implementing available workarounds.Low
The test is not ideal for automation and may be considered to be kept manual.
