Search

Chosen order of Test Cases is being lost when the test is being run by Dan Wyatt

Closed
as Fixed Help for as Fixed

4
0
Sign in
 to vote
Type: Bug
ID: 719308
Opened: 1/19/2012 1:17:29 AM
Access Restriction: Public
Moderator Decision: Sent to Engineering Team for consideration
0
Workaround(s)
1
User(s) can reproduce this bug
When updating the order of Test Cases in a Test Suite, the chosen order is often lost when the test tab is selected, which means that we have to add a number to the title of the test case, and run the test cases individually as a work-around.

Running the entire suite results in test cases being presented in the incorrect order, and attempting to return to the plan tab shows the cases in the correct order.
Details (expand)

Visual Studio/Team Foundation Server/.NET Framework Tooling version

Visual Studio 2012

Steps to reproduce

Create a Test Suite
Manually add test cases
Close MTM
Re-open MTM and return to the suite.
Add test cases & update the order
Open the Test Tab & find your suite - the order chosen is lost.

Product Language

English

Operating System

Windows 7

Operating System Language

English (UK)

Actual results

Test Cases are not presented in the Test Tab in the order which they were chosen in the Plan tab

Expected results

Test Cases should reflect the order selected by the user when creating the test suite and test cases.
File Attachments
File Name Submitted By Submitted On File Size  
1.png Dan Wyatt 1/23/2012 137 KB
2.png Dan Wyatt 1/23/2012 83 KB
3.png Dan Wyatt 1/23/2012 97 KB
Sign in to post a comment.
Posted by Microsoft on 11/16/2012 at 6:07 AM
Hi Dan,

You are correct that the problem is still there when MTM 2012 is used with old Tfs server (i.e. 2010). But once you upgrade your Tfs server to Tfs 2012, then you should not observe this problem.

Please try with an upgraded server and do let us know in case it still does not work for you.

Regards
Visual Studio Product Team
Posted by Dan Wyatt on 11/8/2012 at 7:28 AM
We have installed Microsoft Test Manager 2012, but have not yet installed TFS 2012. This issue has not been fixed. The Chosen order of test cases is still being lost after updating in the plan tab and switching to the test tab.
Posted by Dan Wyatt on 2/1/2012 at 1:00 AM
Brilliant, thanks.

Do you have a date for the Beta/full release yet?
Posted by Microsoft on 1/26/2012 at 8:28 PM
Hi,

Thanks again for reporting the issue. If this is an issue in ordering the static suites, this issue has been fixed in the next major release

Thanks
Posted by Dan Wyatt on 1/23/2012 at 6:22 AM
Please see the attached files which demonstrate this bug on a collection of Suites I have been working on for a number of weeks.

The Suites are not requirements based and the test cases have been run and set back to active, amended, added to, new cases have been added and some cases removed during that time.

To work around this bug, we are prefixing the titles of our Test Cases with a code relating to the area path followed by a number to denote the order that the Test Cases should be run in.

1.png - Plant tab shows my Test Cases in the order that I need them in
2.png - Again shows my Test Cases are already in the order than I need them in. Whether I select Apply changes or Don't apply changes has no effect on the outcome
3.png - Shows the same suite in the Test Tab - Note that the order of the P11d04 and P11d02 test cases has been switched.
Posted by Microsoft on 1/23/2012 at 3:33 AM
Hello,

Thanks a lot for your feedback. It would really help us if you could provide us with some more information.

1. Could you mention in a bit more detail, the steps that you are using for ordering the tests? If you are just sorting the tests, then ordering may not follow the same. You would need to click on the order button in Plan tab, specify the ordering and apply the changes

2. also, is it a static suite or a query based suite or a requirement based suite? The order button is available only in the static suites.

For more info refer to http://msdn.microsoft.com/en-us/library/dd997699.aspx
Posted by MS-Moderator10 [Feedback Moderator] on 1/19/2012 at 9:36 PM
Thank you for submitting feedback on Visual Studio 2010 and .NET Framework. Your issue has been routed to the appropriate VS development team for investigation. We will contact you if we require any additional information.
Posted by MS-Moderator01 on 1/19/2012 at 1:43 AM
Thank you for your feedback, we are currently reviewing the issue you have submitted. If this issue is urgent, please contact support directly(http://support.microsoft.com)
Sign in to post a workaround.
© 2013 Microsoft Corporation. All rights reserved. Microsoft Connect Terms of Use | Trademarks | Privacy Statement