Test Management Tool Connectors: TFS (VSTS 2013)

Versions:3.6+ 

QuerySurge Test Management Tool Connector Setup

The Scheme:

QuerySurge's Test Management Tool Connector works with TFS's Test Agent to enable you to execute QuerySurge tests from TFS, and for results from QuerySurge to flow back to TFS. The following scheme shows the relationships between these components:

Note: the steps in this section can be done with any PC on your corporate network that has Microsoft Visual Studio 2013 and Microsoft Test Manager 2013 installed. Some steps in this section refer to the install directories for the QuerySurge TFS Connector, so please make sure that you have access to a Connector installation.

1. In your Connector installation directory, open the open the properties file, which, if you chose the default options while installing QuerySurge, are found in the C:\Program Files\QuerySurge\cli folder
   
   
    
2. In the file, insert a line right after # Client API and type the UsernameYouWantToUseFromQuerySurge=PasswordOfUsernameInQuerySurge
   
   
   
   
3. Launch Visual Studio
   
   
   
   
4. Choose File->New->Project
   
   
   
   
5. Choose Unit Test Project, give the project any name you want, and press the OK button
   
   
   
   
6. Right click on the Project and choose Add->Existing Item
   
   
   
   
7. Assuming you installed the QuerySurge Connector in the default location, navigate to C:\Program Files\QuerySurge\cli\samples
   
8. Select all the .cs files and click the Add button
   
   
   
   
9. Open up the cs file and fill out the QuerySurgeInstallationPath, hostname and port values to match the machine that has QuerySurge installed and then save the file
   
   
   
   
10. Open up the cs file and fill out the username, scenarioName and suiteIdList values and then save the file
    
    
    
    
11. Right click on References and choose Add Reference
    
    
    
    
12. Type System and make sure that you see a checkbox next to System
    
    
     
13. Type Data and make sure to click the checkbox in the field and press the OK Button
    
    
    
    
14. Choose Build->Build Solution
    
    
    
    
15. In order to test locally to make sure that you set up everything properly, right click on QuerySurgeConnectionBySuiteIdTest and choose the Run Selected Tests option
    
    
    
    
16. Depending on which suite you picked the test will pass or fail (Even one querypair failing will cause the whole test to fail)
    
    
    
    
17. Click on Team Explorer
    
    
    
    
18. Click Create Team Project
    
    
    
    
19. Enter the name of the project and press Next
    
    
    
    
20. Keep the default option and press Next
    
    
    
    
21. Choose Team Foundation Version Control and press Next
    
    
    
    
22. Hit Finish (Please note that it may take a few minutes to create your project)
    
    
    
    
23. Click Close
    
    
    
    
24. Right click on the Project you created and choose Connect
    
    
    
    
25. Click Configure your workspace
    
    
    
    
26. Click Map & Get
    
    
     
27. Click on Builds
    
    
    
    
28. Click New Build Definition
    
    
    
    
29. Give the Build definition name
    
    
    
    
30. Click Process
    
    
    
    
31. Change Disabletests to True
    
    
    
    
32. Click Build Defaults
    
    
    
    
33. Type the location you want the output or log results of the test copied to
    
    
    
    
34. Click the Save button
    
    
    
    
35. Click on Solution Explorer
    
    
    
    
36. Right click on the solution and choose Add Solution to Source Control
    
    
    
    
37. Choose Team Foundation Version Control and hit the OK button
    
    
    
    
38. Choose the Team Project Location, type a name for the solution, and hit the OK button
    
    
    
    
39. Right click on the solution and choose Check In
    
    
    
    
40. Type a Comment if you wish and then press the Check In button
    
    
    
    
41. Click Yes
    
    
    
    
42. Click the Home button
    
    
    
    
43. Click Builds
    
    
    
    
44. Right click on the build definition and choose Queue New Build
    
    
    
    
45. Click the Queue button
    
    
    
    
46. Keep hitting the Refresh button until the build completes
    
    
    
    
47. Open Microsoft Test Manager
    
    
    
    
48. Click your project and then the Connect now link
    
    
    
    
49. Click the Add button
    
    
    
    
50. Enter any Plan name you want and then click the Add button
    
    
    
    
51. Click Select plan
    
    
    
    
52. Navigate to Lab Center
    
    
    
    
53. Click New
    
    
    
    
54. Give the Environment a name
    
    
    
    
55. Click Machines
    
    
    
    
56. Enter the appropriate credentials for your Machine
    
    
    
    
57. Click Verification
    
    
    
    
58. Click the Verify button
    
    
    
    
59. Click Finish
    
    
    
    
60. Keep clicking the Refresh button until ready
    
    
    
    
61. Click on Test Settings
    
    
    
    
62. Click New
    
    
    
    
63. Give the settings a name and then Choose Automated
    
    
    
    
64. Click the Next button
    
    
    
    
65. Click on the environment
    
    
    
    
66. Click the Finish button
    
    
    
    
67. Click on Testing Center
    
    
    
    
68. Click on Properties
    
    
    
    
69. Set the Test settings and Test environment and hit the Save button
    
    
    
    
70. Click the Modify link
    
    
     
71. Choose the latest build and click the Assign to plan button and hit the Close button
    
    
    
    
72. Click the Save and Close button
    
    
    
    
73. Back in Visual Studio, in Team Explorer, click on Work Items
    
    
    
    
74. Click New Work Item->Test Case
    
    
    
    
75. Enter the test case name and click Associated Automation
    
    
    
    
76. Click the Automated test name button
    
    
    
    
77. Choose your test name and click the OK button
    
    
    
    
78. Click the Save Work Item button
    
    
    
    
79. In Test Manager, click the Add button
    
    
    
    
80. Click the Run button
    
    
    
    
81. Click the test case and the Add test cases button
    
    

Running QuerySurge from TFS

Note: The steps in this section can be done with any PC on your corporate network that has Microsoft Test Manager 2013 installed and where the QuerySurge TFS Connector is already installed. The Connector can be installed from the QuerySurge installer.

1. Click Test
   
   
   
   
2. Right click and choose Run
   
   
   
   
3. Keep hitting the refresh button until the scenario finishes
   
   
   
   
4. Click on Tests
   
   
   
   
5. Right click and choose View Results to view the results of the test run
   
   
   
   
6. Right click on the Attachment and choose Open
   
   
   
   
7. Click Open and the results will open
   
   
   
   

Troubleshooting

Note: The steps in this section can be done with any PC on your corporate network that has Microsoft Test Manager 2013 installed and where the QuerySurge TFS Connector is already installed. The Connector can be installed from the QuerySurge installer.

A TEST FAILS WHEN RAN FROM MICROSOFT TEST MANAGER BUT OFFERS NO LOG SHOWING THE FAILED QUERYPAIRS

This may be related to the fact that the agent for Microsoft Test Manager is set to run as a Windows service.  To resolve this issue, have the agent locally on the machine where the agent is visible.