How to build a playlist and execute automated tests?

Panaya Test Dynamix is an end-to-end testing platform for both manual testing and automated testing.
Use Panaya Test Dynamix to create Playlists and automatically execute automated test cases designed in any other tool, allowing you to manage your manual and automated test cases within one centralized platform.


This article explains how to - 

  • Create a new Automation Project, or use existing
    Our recommendation is to create one Panaya project that will be the single source of truth catalog.
    The catalog project can contain all regression tests, both manual and automatic.
    We also suggest that you build a hierarchy for your catalog by grouping tests into cycles, folders, and sub-folders, according to the functional area of the tested application. Each functional area can be used to store both manual and automation tests.  

    Once your project hierarchy is set, you can import the relevant subset of automated tests from the catalog project to the actual project. 
  • Synchronize Tests to the catalog
  • Build the Playlist & schedule tests
  • Review and monitor automated test execution

Synchronize Tests

Open up your automation project, and - 

  1. Hover over the Tests tab and select Test Tree 
  2. Right-Click In the Tree view, click on Add Automation Cycle > Generic / Worksoft Automation.


    Right-click on the Project Name in the tree > Add Automation Cycle > Generic / Worksoft Automation.

    Cannot find this option?
    Contact Panaya Support to activate automation for your account
  3. Highlight the newly created Automation Cycle in the tree and select the Sync Settings tab
  4. Select your machine from the drop-down list. Panaya displays machines where the automation connector is installed successfully.
    • For Worksoft integration - type the Worksoft bookmark name to be synced with Panaya.
    • For all other automation tool integrations - use the table to fill all the Key-Value pairs required by the specific connector deployed.
      The key-value pairs should contain all required metadata from the connector.
      For example -
      Machine: automation_machine_name
      Folder: c:\my tool\regression\area A
      File_name_prefix: “reports”
      In case you want the connector to connect to this machine, navigate to that folder, and only sync the tests where the file name begin with “reports*”
  5. Click Save and then Sync.
    Your test cases will appear in the Cycle within a few minutes. 

Build Playlist & Launch Tests Executions

  1. Hover over the Tests tab and select Tree view

  2. Right-click on an entire Cycle / Folder / Business Process and then Create Playlist.

    Alternatively, you can use the List view to select one or more Automated Tests and then click on New Playlist

    You can do the same for a single Automated Test from the Tests Tree.
    Another option is to create the playlist from your Planned Runs in an Automated Test.
  3. Once created, the Playlist will be automatically executed.
    You can track and monitor the results by hovering on the Tests tab and selecting Playlists Execution.

Good to Know!

  • For playlists created from the Tree, you can define to execute tests randomly or in sequence (the order of tests in a given Cycle/Folder/Business Process).
  • Playlists that have been created using the Test List view, are executed randomly. 
  • The sequence order is displayed per playlist, in the Playlist Execution view

Review and Monitor Automation Activity

  1. Hover over the Tests tab and select Playlist Execution
  2. Panaya displays a list of all Playlists in the project and the current run status.
    You can drag any column header and drop it above the list, to group by field as shown below for the Status.
  3. Click on the little arrow next to the Playlist ID, to view the run status for each automated test case.
    This is also where you can view the Execution Duration, Time, and Evidence
  4. To Rerun a Playlist, highlight the Playlist and then click on Rerun.
    The Playlist will be duplicated and set to Not Run status.
  5. Use the Refresh button to retrieve the most current run statuses



Good to Know!

  • Use Dashboards and Widgets to displays both your manual and automated tests. Click on the numbers to drill down to the list of tests.
  • Automated Tests appears with the below icon