IN THIS SECTION
- Test Suite Details
- QueryPair Activity
- Scenario Status
- Scenario Monitoring Graphs
- Customizing the Dashboard View
- Graph Display Options
Test Suite Details
To view the scenario run details, the user must select a scenario from the Scenario Queue panel located on the left hand side of the Run Dashboard. Upon selection, the scenario dashboard will be populated with information and tables to help the user track progress and manage resources efficiently.
TEST SUITES IN SCENARIO
Scenarios are comprised of one or more Suites which contain Query Pairs. These are listed in the center panel of the Run Dashboard.
# OF QueryPairs
The number of QueryPairs is simply the amount of QueryPairs in the respective suite.
AGENT
The Agent is the Agent chosen by the user when scheduling a Scenario. If no Agent was chosen, then the first available Agent will be used when running the Test Suite.
NOTE Administrators have the ability to setup Agents to retrieve only assigned Test Suites or all Test Suites in the Administrator Dashboard.
TEST SUITE PROGRESS
Suite Progress displays a progress bar of a Suite’s progress. This entails completing all Query Pairs in the Suite. A Query Pair goes through six states which include – Ready, Queued, Execution, Query Completion, Analysis, and Pair Completion. All of these steps must be completed for the progress to reach 100%. These steps may be tracked by the bar and line graph below the center panel labeled Scenario Snapshot and Scenario Status respectively.
SCENARIO PROGRESS
Scenario Progress is located on the bottom of the center panel and indicates the entire progress of the scenario.
NOTE Your Test Suites can be filtered/arranged by all of the subcategories listed above. Simply click on one of the columns (Name, #of QueryPairs, Agent, Progress) which toggles ascending/descending order, or by clicking the dropdown arrow (appears when your mouse hovers over the column) in the right hand side of the column which offer greater filtering capabilities.
QueryPair Activity
The QueryPair Activity Grid can be toggled by clicking on the QueryPair Activity button located on the top right hand side of the center panel.
FILTERING QUERYPAIRS
The top left of the center panel houses three check boxes (Pass, Fail, Error) to the right of Show. Selecting any of these will filter the Query Pairs displayed below.
SCENARIO PROGRESS
Scenario Progress is located on the bottom of the center panel and indicates the entire progress of the scenario.
NOTE Double Clicking on a Query Pair will bring up the Query Pair Results Window.
Scenario Status
The Scenario Status panel, located on the top right hand side of the Run Dashboard, gives the user a quick overview of QueryPair metrics as well as Scenario Details.
PROPERTIES
The Scenario details consist of:
- Start Time – The scheduled date and time for your Scenario.
- Owner – The creator of the Scenario.
QUERYPAIR METRICS
The QueryPair Metrics table is a quick overview of the QueryPairs in your scenario. The QueryPairs are tabulated according to six different factors (Queued, Running, Passed, Failed, Errors, Killed).
NOTE When a scenario is running or queued, this panel also contains a Stop Scenario or Kill Scenario button just below QueryPair Metrics table. This allows the user to stop and cancel the scenario.
Scenario Monitoring Graphs
The Scenario Monitoring Graphs display the "pools of statuses" of the queries that are executing. Eight statuses are possible (Ready, Queued, Executing, Query Completed, Analyzing, Pair Completed). Queries flow through these statuses during the course of execution.
All queries begin in the "Ready" pool, and then proceed through the “Queued” and “Executing” statuses. As individual queries finish, the QuerySurge Agent’s pairing engine matches up queries into Test Query Pairs. Once the pairs are matched, they enter the “Query Completed” status pool. The Agent’s matching engine then pairs the queries into QueryPairs, and the queries enter the “Analyzing” pool. Once analysis is complete, queries enter the final “Pair Completed” pool.
If a query fails (due to a query syntax error, for example) it will be marked as such, however once it’s sibling query has completed, they will be paired and will both enter the “Pair Completed” pool.
SCENARIO SNAPSHOT - QUERY STATUS
SCENARIO STATUS - QUERY ACTIVITY
Customizing the Dashboard View
QuerySurge allows the user to customize the dashboard views on the Run Dashboard page. The Run Dashboard page consists of five panels.
The Scenario Queue window on the left shows all of the Scenarios currently stored by QuerySurge by default. Using the Show dropdown, you can filter Scenarios by status. The available status filters are: Executing, Reserved, Completed, Not Started, or Killed. You can also set the number of Scenarios to view in the panel at the bottom right corner of the panel.
The Scenario panel has two different views: Test Suite Details and QueryPair Activity. The Test Suite Details view shows all of the Test Suites in the Scenario. If you double-click on a Test Suite, the QueryPairs window pops up to show a listing of all QueryPairs in the selected Scenarios. Select a QueryPair to drill down into its execution details. The panel on the upper right will show some basic statistics from the QueryPair execution. The bottom panel will display tabs (Source data, Target data, Failure data, Source Query, Target Query) with the detailed data returned during the execution along with the data comparison and the Queries.
The QueryPair Activity view provides a runtime view of each QueryPair in the selected Test Suite and its outcome. At the start of execution, this list will be empty; as QueryPairs execute and are analyzed by QuerySurge, they will appear in the QueryPair Activity listing. If you double-click on a QueryPair, a popup will show the Source, Target, Outcome, Source Query, and Target Query. This table can also be expanded by clicking on the arrow on the side or on the bottom of the window.
The Scenario Status panel on the top right of the dashboard displays the status, start time, owner, and QueryPair metrics of the selected Scenario.
Graph Display Options
Once a Scenario is chosen in the Run Dashboard, two graphs are displayed in the lower section of the page.
The Scenario Snapshot – Query Status graph is a real-time bar graph that displays the Scenario’s queries by execution status. Hovering over a bar shows the status count. Clicking the View Data button (small circular button on the top-right) displays the data in table form.
The Scenario Status – Query Activity graph is a real-time line graph that displays the Scenario’s queries by execution status as a function of time. Each line represents a different status population as a function of time. Hovering over a line displays the number of queries at that point in time. Clicking the View Data button (small circular button on the top-right) displays the data in table form.
Comments
0 comments
Please sign in to leave a comment.