I want to use mstest.exe to run my unit test on build server, but I don't want to install Visual Studio on the build server. Can I just install MSTest without Visual Studio?
To access the MSTest tool, add the Visual Studio install directory to the path or open the Visual Studio Group from the Start menu, and then open the Tools section to access the Visual Studio command prompt. Use the command MSTest from the command prompt.
Visual Studio includes the VSTest and MSTest command-line tools for testing purposes. We can use both VSTEST and MSTEST to run automated unit and coded UI tests from a command line. 1.
MSTest is a number-one open-source test framework that is shipped along with the Visual Studio IDE. It is also referred to as the Unit Testing Framework. However, MSTest is the same within the developer community. MSTest is used to run tests.
It is possible to run mstest.exe without visual studio.
Download one of the Agents for Visual Studio ISO's below and install the Test Agent on the server:
Visual Studio 2019
Visual Studio 2017 (127MB disk space, less than that for download)
Visual Studio 2015 and older: visit https://www.visualstudio.com/vs/older-downloads/ and follow the instructions
This installs everything needed for running mstest.exe from the command line and is much lighter weight than visual studio. ~500mb download and around ~300mb to install just the test agent if I remember correctly.
This answer pertains specifically to Visual Studio 2017, and the answer is yes. Please refer to this answer as to how to locate the MSBuild.exe
and/or MSTest.exe
executables.
MSTest.TestFramework
into those project(s) and remove the reference to Microsoft.VisualStudio.QualityTools.UnitTestFramework
from them. Now all you need is to install the Visual Studio 2017 Build Tools and invoke msbuild.exe
to perform the build.MSTest.exe
and vstest.console.exe
which you can then call out to. Do note that actually figuring out where these executables reside is a pain, because they won't exist in the same directory structure as MSBuild.exe
in Build Tools.Finally, and very importantly: if you do use MSTest.TestFramework
and still need to be able to discover and run tests from within the Visual Studio IDE, you'll also need MSTest.TestAdapter
installed in your unit test project(s).
1: While VS2017 supports side-by-side installs, it uses a single registry key that only records the most recent install. Hence, if you install Test Agent last, the key will point to its install directory... but Test Agent doesn't include MSBuild.exe
, so any code that relies on this registry key to figure out that executable's path, will fail. Why Microsoft couldn't have made the Test Agent an optional part of Build Tools (so that all the EXEs live in the same directory hierarchy) is anyone's guess.
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With