TFS 2015分布式测试执行 [英] TFS 2015 Distributed Test Execution

问题描述

我们希望在Visual Studio测试框架中使用自动和分布式测试（不仅 MS测试）。

我们的自动构建/测试设置（在我们最近升级的内部部署TFS 2015上）如下：

1）我们仍然使用旧的MS Test分布式执行。

2）我们与旧的XAML构建系统挂了一段时间（因为构建过程是高度自定义的）。



我最近读过
博客文章。

此外，我已尝试在Azure VM上执行新的分布式任务，但由于时间不够，我暂时停止了设置正确的配置。 （据我所知，上面提到的博客文章尚不支持。）

根据我的理解，新的分布式测试功能仅适用于新的脚本化构建系统。



我们真的想用Visual Studio测试框架执行来替换仅MS-Test的分布式测试执行。

这对我们来说很烦人，我们还是不能使用第三方测试框架（NUnit等）进行分布式测试。

在TFS 2015问世之前，我正在开发一个C＃项目，试图以与新TFS 2015测试任务类似的方式分发测试。

但是我们不想重新发明轮子，我很高兴看到TFS 2015发布说明：
" VSTest Remote Task使用测试代理以分布式方式在远程计算机上运行测试，您可以运行功能，单元测试或UI测试。"

我已经停止了我们的特殊实施工作希望我们的项目已经过时了。

现在我担心这个假设是错误的。



现在，我很困惑并且得到了很多问题希望有人可以回复他们：



1.是否可以使用任务使用的函数
RunDistributedTests 也适用于其他地方？

2.该任务是导入模块"Microsoft.TeamFoundation.DistributedTask.Task.Common"，"Microsoft.TeamFoundation.DistributedTask.Task.Internal"，"Microsoft.TeamFoundation.DistributedTask.Task.DTA"。
导入的代码在哪里？

（我对Power Shell没有太多经验，也没有在我的本地开发人员机器上找到任何DLL。）

3.是否有计划在旧的XAML版本中提供新的分布式设施？

4.或者是否有计划在XAML版本中提供新任务？ （我知道XAML构建和新的脚本构建在不同的子系统中。）



我们的未来有一些路径：



a）我们迁移到新的构建系统。由于缺乏人力资源，这不是近期的选择。
b $ b b）我们进一步开发自己的测试分发库。我不确定，如果可行的话。

c）我们等待微软为我们实施一些东西，或者微软还有什么东西可以实现？



有人有建议吗？每一条建议都会有所帮助。

解决方案

基督徒，  

感谢您的帖子。

1. "其他地方"是什么意思？我们需要在T​​est Machine Group的测试机器上运行它，并在TFS 2015 vnext构建定义中使用此任务，我们不能在XAML构建定义中使用。
   
2. 如果VS测试代理部署任务在TFS构建期间运行RunDistributedTests.sp1脚本之前未在测试计算机上部署该dll，我认为可以从TFS 2015 Sever计算机导入模块。您可以分别在测试计算机和TFS 2015 Server计算机上搜索"Microsoft.TeamFoundation.DistributedTask.Task.Common.dll"
   。    
3. 在XAML构建定义中，我们通常使用实验室构建模板来运行分发测试，请参阅此处的信息文件：
   https://msdn.microsoft.com/en -us / library / hh191495（v = vs.120）.aspx 。

是的，Microsoft将继续改进vNext构建功能，对于vNext版本中的任何建议，请
将其提交到用户语音网站： http://visualstudio.uservoice.com/forums/121579-visual-studio ，Microsoft工程师将对其进行认真评估。

<跨度>

We want to use automated and distributed tests with the Visual Studio testing framework (not only MS Test).

Our automated build-/test-setup (on our recently upgraded on-premise TFS 2015) is the following:
1) We still using the old MS Test distributed execution.
2) We are tied to the old XAML build system for a while (since the build process is highly customized).

I've been read that recent blog post.
Also, I have been tried the new distributed task execution on Azure VMs but I stopped for now due the lack of time to set-up the correct configuration. (As I understand the mentioned blog post, that is not yet supported anyway.)
From my understanding, the new distributed test capabilities are only available for the new scripted build system.

We really want to replace the MS-Test-only distributed test execution with a Visual Studio test framework execution.
It is annoying for us, that we still cannot use 3rd party test frameworks (NUnit, etc.) for distributed tests.

Before TFS 2015 came out, I was working on a C# project which tries to distribute tests in a similar fashion like the new TFS 2015 test task.
But we do not want to reinvent the wheel and I was quite happy as I read in the TFS 2015 release notes:
"VSTest Remote Task runs tests on remote machines in a distributed fashion by using test agents, and you can run either functional, unit tests or UI tests."
I stopped the working on our special implementation, since I had the hope that our project is obsolete.
Now I am worrying that assumption was wrong.

Now, I am pretty confused and got lots of questions. Hopefully someone can answer to them:

1. Is it possible the use the functions which are used by the task RunDistributedTests on other places too?
2. That task is importing the modules "Microsoft.TeamFoundation.DistributedTask.Task.Common", "Microsoft.TeamFoundation.DistributedTask.Task.Internal", "Microsoft.TeamFoundation.DistributedTask.Task.DTA". Where is the code of that imports located?
(I do not have lot of experience with Power Shell and did not found any DLL on my local developer machine.)
3. Are there any plans to make the new distributed facilities available in the old XAML builds?
4. Or are there plans to make new tasks available in the XAML builds? (I know XAML builds and new scripted builds are in different sub systems.)

There are some paths for the future for us:

a) We migrate to the new build system. This is not option for the near future due lack of human resources.
b) We further develop our own test distribution library. I am not sure, if that is feasible.
c) We wait for Microsoft is implementing something for us or maybe there is something still implemented by Microsoft?

Does anybody have suggestions? Every single advice will be helpful.

解决方案

Hi Christian,  

Thanks for your post.

1. What’s the "other places" mean? We need run it on the test machine which in Test Machine Group, and use this task in TFS 2015 vnext build definition, we cannot use in XAML build definition.
2. If the VS Test Agent Deployment task not deploy that dlls on your test machine before run the RunDistributedTests.sp1 script during TFS build, I think that modules be imported from your TFS 2015 Sever machine. You can search the "Microsoft.TeamFoundation.DistributedTask.Task.Common.dll" on your test machine and TFS 2015 Server machine separately.   
3. In XAML build definition, we usually use the lab build template to run the distribute test, please refer to the information in this document: https://msdn.microsoft.com/en-us/library/hh191495(v=vs.120).aspx.

And yes, Microsoft will continue to improve the vNext build features, for any suggestion in vNext build, please submit it to User Voice site at: http://visualstudio.uservoice.com/forums/121579-visual-studio, Microsoft engineers will evaluate it seriously.

这篇关于TFS 2015分布式测试执行的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！