IN THIS SECTION
- Test Suite Details
- Activity
- Scenario Status
- Scenario Monitoring Graphs
- Customizing the Dashboard View
- Graph Display Options
Test Suite Details
To view the details of a Scenario execution, select a Scenario from the Scenario Queue on the left-hand side of the Run Dashboard. Once selected, the Run Dashboard will be populated with information and tables to help track the progress of the execution and manage resources efficiently.
TEST SUITES IN SCENARIO
A Scenario is comprised of one or more Test Suites, which can contain either QueryPairs or Staging Queries. These are listed in the center panel of the Run Dashboard.
NAME
The name reflects the name of each individual Test Suite in the Scenario.
# OF QUERY ENTITIES
The number of query entities indicates the number of QueryPairs or Staging Queries in a given Test Suite.
AGENT
The Agent is the Agent that was selected when scheduling the Scenario. If no Agent was selected, then the first available Agent will be used when running the Test Suite.
NOTE: Administrators have the ability to setup Agents to retrieve only assigned Test Suites or all Test Suites in the Administrator Dashboard.
TEST SUITE PROGRESS
Progress displays a progress bar of a Test Suite’s run progress. This entails completing all Query Pairs in the Test Suite. A QueryPair or Staging Query goes through six (6) execution states, including Ready, Queued, Executing, Query Complete, Analyzing, and Analysis Complete. All of these steps must be completed for the progress to reach 100%. These steps may be tracked by the bar and line graphs below the center panel, respectively labeled Scenario Snapshot and Scenario Status.
SCENARIO PROGRESS
The overall Scenario progress is located on the bottom of the center panel, and indicates the cumulate progress of all Test Suites in the Scenario.
NOTE: Test Suites can be filtered or sorted by all of the subcategories listed above. Click on one of the columns (Name, # of Query Entities, Agent, or Progress) to toggle the ordering (i.e., ascending or descending). Hover over a column and click the dropdown arrow on the right-hand side to access greater filtering capabilities.
NOTE: Double-click on a Test Suite to open the Results modal, where you can drill down into each QueryPair or Staging Query and view its Source, Target, and Failure data, as well as Queries and Performance metrics.
Activity
You can view the Activity grid by clicking on the Activity toggle button, located on the right-hand side of the center panel title bar
FILTERING QUERY ENTITIES
The top-left of the center panel houses four (4) checkboxes (Pass, Warning, Fail, and Error). Select one or more of these to filter the QueryPairs or Staging Queries displayed in the grid.
SCENARIO PROGRESS
The overall Scenario progress is located on the bottom of the center panel, and indicates the cumulate progress of all Test Suites in the Scenario.
NOTE: Double-click on a QueryPair or Staging Query to open the Results modal, where you can view Source, Target, and Failure data, as well as Queries and Performance metrics.
Scenario Status
The Scenario Status panel, located on the right-hand side of the Run Dashboard, provides a brief overview of the Scenario details, as well as QueryPair or Staging Query metrics.
PROPERTIES
The Scenario details consist of the following.
- Scheduled Start Time – the scheduled date and time the Scenario will start executing.
- Actual Start Time – the actual date and time the Scenario started executing.
- Owner – the creator of the Scenario.
NOTE: When a Scenario is running or queued, this panel also contains a Stop Scenario or Cancel Scenario button just above the Properties table. This allows the user to stop a running Scenario or cancel a Scenario that hasn't started yet.
QUERYPAIR METRICS
The QueryPair Metrics table is a quick overview of the QueryPairs or Staging Queries in the Scenario. The QueryPairs are tabulated according to seven (7) different factors: Queued, Running, Passed, Warnings, Failed, Errors, and Killed).
ASSET TAGS
This panel shows a collection of Asset Tags that have been assigned to the Scenario.
Scenario Monitoring Graphs
The Scenario Monitoring Graphs display the "pools of statuses" of the queries that are executing. Six (6) statuses are possible: Ready, Queued, Executing, Query Completed, Analyzing, and Pair Completed). Queries flow through these statuses during the course of execution.
All queries begin in the "Ready" pool, and then proceed through the “Queued” and “Executing” statuses. As individual queries finish, the QuerySurge Agent’s pairing engine matches up queries into Test Query Pairs. Once the pairs are matched, they enter the “Query Completed” status pool. The Agent’s matching engine then pairs the queries into QueryPairs, and the queries enter the “Analyzing” pool. Once analysis is complete, queries enter the final “Pair Completed” pool.
If a query fails (due to a query syntax error, for example) it will be marked as such, however once it’s sibling query has completed, they will be paired and will both enter the “Pair Completed” pool.
SCENARIO SNAPSHOT - QUERY STATUS
SCENARIO STATUS - QUERY ACTIVITY
Customizing the Dashboard View
QuerySurge allows you to customize the dashboard views on the Run Dashboard page. The Run Dashboard page consists of five panels.
The Scenario Queue panel on the left shows all of the Scenarios currently stored by QuerySurge by default. Using the Search button, you can filter Scenarios by name, status, or scheduled start date. The available status filters are: All, Executing, Completed, Not Started, or Killed. You can also set the number of Scenarios to display using the paginated controls at the bottom of the panel.
The Scenario panel has two different views: Test Suite Details and Activity. The Test Suite Details view shows all of the Test Suites in the Scenario. If you double-click on a Test Suite, the QueryPairs modal pops up to show a listing of all QueryPairs in the selected Scenarios. Select a QueryPair to drill down into its execution details. The panel on the upper-right will show some basic statistics from the QueryPair execution. The bottom panel will display tabs (Source, Target, Failures, Source Query, Target Query, and Query Performance) with the detailed data returned during the execution, along with the data comparison and queries.
The Activity view provides a runtime view of each QueryPair in the selected Test Suite and its outcome. At the start of execution, this list will be empty; as QueryPairs or Staging Queries execute and are analyzed by QuerySurge, they will appear in the Activity listing. If you double-click on a QueryPair, a popup will show the Source, Target, Failures, Source Query, Target Query, and Query Performance. This table can also be expanded by clicking on the arrow on the side or on the bottom of the window.
The Scenario Status panel on the top-right of the dashboard displays the status, scheduled and actual start times, owner, QueryPair metrics, and Asset Tags of the selected Scenario.
Graph Display Options
Once a Scenario is selected in the Scenario Queue, two graphs are displayed in the lower-left and lower-right sections of the page.
The Scenario Snapshot – Query Status graph is a real-time bar graph that displays the Scenario’s queries by execution status. Hovering over a bar shows the status count. Clicking the View Data button (small, list icon on the top-right) opens a popup with the data in table form.
The Scenario Status – Query Activity graph is a real-time line graph that displays the Scenario’s queries by execution status as a function of time. Each line represents a different status population as a function of time. Hovering over a line displays the number of queries at that point in time. Clicking the View Data button (small, list icon on the top-right) opens a popup with the data in table form.