You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I've found a special case that when having 200+ test cases in a given test suite and the test configuration is mixed, the VSTest@3 task is only pulling up to the 201th test and leaving the rest out
Environment type (Please select at least one enviroment where you face this issue)
Self-Hosted
Microsoft Hosted
VMSS Pool
Container
Azure DevOps Server type
dev.azure.com (formerly visualstudio.com)
Azure DevOps Server Version (if applicable)
No response
Operation system
Windows
Relevant log output
no error message
Full task logs with system.debug enabled
[REPLACE THIS WITH YOUR INFORMATION]
Repro steps
1. Create 2 test suites both of 300 test cases2. let Test Suite 1 have 1 default configuration (assign to the test suite)3. let Test Suite 2 have 1 default configuration (assign to the test suite)4. pick a handful of test cases to add a **different** configuration under Test Suite 2use order for this, lets say Test Point (Test Case) of order 1Test Point (Test Case) of order 100Test Point (Test Case) of order 200Test Point (Test Case) of order 201Test Point (Test Case) of order 202Test Point (Test Case) of order 2995. Use VSTask@3 to run the above6. First run, run Test Suite 1 with the default configuration, all 300 will be executed here7. Second run, run Test Suite 2 with **different** configurationExpected: Second run with **different** configuration should run all 6 test casesActual: Second run with **different** configuration is only running the first 4 test cases on this configuration
The text was updated successfully, but these errors were encountered:
acostmig
changed the title
[BUG]:
[BUG]: TestPlan testSelector: not retrieving all test cases from the test suite
Mar 7, 2025
acostmig
changed the title
[BUG]: TestPlan testSelector: not retrieving all test cases from the test suite
[BUG]: VSTest@3 TestPlan testSelector: not retrieving all test cases from the test suite
Mar 7, 2025
New issue checklist
Task name
VSTest
Task version
3
Issue Description
I've found a special case that when having 200+ test cases in a given test suite and the test configuration is mixed, the VSTest@3 task is only pulling up to the 201th test and leaving the rest out
Environment type (Please select at least one enviroment where you face this issue)
Azure DevOps Server type
dev.azure.com (formerly visualstudio.com)
Azure DevOps Server Version (if applicable)
No response
Operation system
Windows
Relevant log output
Full task logs with system.debug enabled
Repro steps
The text was updated successfully, but these errors were encountered: