How to build a playlist and execute automated tests?

Panaya Test Dynamix is an end to end testing platform for both manual testing and automated testing.
Use Panaya Test Dynamix to create Playlists and automatically execute automated test cases designed in any other tool, allowing you to manage your manual and automated test cases within one centralized platform.


This article explains how to - 

  • Create a new Automation Project, or use existing
    Our recommendation is to create one Panaya project that will be the single source of truth catalog.
    The catalog project can contain all regression tests, both manual and automatic.
    We also suggest that you build a hierarchy for your catalog by grouping tests into cycles, folders, and sub-folders, according to the functional area of the tested application. Each functional area can be used to store both manual and automation tests.  

    Once your project hierarchy is set, you can import the relevant subset of automated tests from the catalog project to the actual project. 
  • Synchronize Tests to the catalog
  • Build the Playlist & schedule tests
  • Review and monitor automated test execution

Synchronize Tests

Open up your automation project, and - 

  1. Hover over the Tests tab and select Test Tree 
  2. In the Tree view, click on Add Automation Cycle > Generic Automation


    Right-click on the Project Name in the tree > Add Automation Cycle > Generic Automation

    Cannot find this option?
    Contact Panaya Support to activate automation for your account
  3. Highlight the newly created Automation Cycle in the tree and select the Sync Settings tab
  4. Select your machine from the drop-down list. Panaya displays machines where the automation connector has been successfully installed.
  5. Define the sync settings - use the table to fill all the Key-Value pairs.
    The key-value pairs should contain all required metadata from the connector.

    For example -
    Machine: automation_machine_name
    Folder: c:\my tool\regression\area A
    File_name_prefix: “reports”
    In case you want the connector to connect to this machine, navigate to that folder, to only sync the tests where the file name begin with “reports*”
  6. Click Save and then Sync.
    Your test cases will appear in the Cycle within a few minutes. 

Build Playlist & Launch Tests Executions

  1. Hover over the Tests tab and select Tree view

  2. Right-click on an entire Cycle / Folder / Business Process and then Create Playlist.
    Alternatively, you can use the List view to select one or more Automated Tests and then click on New Playlist

    You can do the same for a single Automated Test from the Tests Tree.
    Another option is to create the playlist from your Planned Runs in an Automated Test.
  3. Once created, the Playlist will be automatically executed.
    You can track and monitor the results by hovering on the Tests tab and selecting Playlists Execution.

Good to Know!
By default, all tests in an automated playlist will run randomly.

Review and Monitor Automation Activity

  1. Hover over the Tests tab and select Playlist Execution
  2. Panaya displays a list of all Playlists in the project and the current run status.
    You can drag any column header and drop it above the list, to group by field as shown below for the Status.
  3. Click on the little arrow next to the Playlist ID, to view the run status for each automated test case.
    This is also where you can view the Execution Duration, Time, and Evidence
  4. To Rerun a Playlist, highlight the Playlist and then click on Rerun.
    The Playlist will be duplicated and set to Not Run status.
  5. Use the Refresh button to retrieve the most current run statuses



Good to Know!

  • Use Dashboards and Widgets to displays both your manual and automated tests. Click on the numbers to drill down to the list of tests.
  • Automated Tests appears with the below icon