功能测试的覆盖率分析 [英] Coverage analysis for Functional Tests

问题描述

在我正在从事的项目中，我们有基于Selenium编写的功能测试。该应用程序随每个功能发行版进行功能更改。

是否有一种工具/机制可以跟踪自动化功能测试中的空白，以便至少手动测试者可以留意这些领域？ / p>

注意：我们没有做FTDD，因此即使我们确保较高的单元测试覆盖率，功能测试覆盖率也可能很差。我们使用NCover检查单元测试范围。

解决方案

据我所知，至少有两个（商业但便宜的）工具可让您将IIS进程附加到捕获IIS应用程序的覆盖率数据。

NCover：

NCover包括// iis命令行
开关。此开关在IIS中设置
覆盖环境，然后
重新启动Web服务器。您将像这样运行
NCover来分析Web应用程序的覆盖率
：

NCover.Console.exe nunit-console.exe
TestAssembly.dll // iis当您以这种方式运行
NCover时，将重新启动IIS
以允许NCover监视
您的覆盖范围，并且您的测试将以
运行。完成后，NCover将停止
IIS并自行分离。

请参阅： http://docs.ncover.com/how-to/code-coverage- of-asp-net-applications-on-iis /

jetbrains的DotCover：

Dotcover具有Visual Studio集成，它使您可以以与要跟踪IIS应用程序相同的方式附加到IIS应用程序。尽管我从未真正尝试过此操作，但也可以使用命令行dotCover工具开始。

请参见 http://www.jetbrains.com/dotcover/

我认为Rational和Microsoft Teamsystem也有解决方案但是它们要贵一些。

In the project that I am working on, we have functional tests written over Selenium. The application undergoes functional changes with each feature release.

Is there a tool / mechanism that we can keep track of the gaps in automated functional tests, so that at least the manual testers can keep an eye for these areas?

Note: we are not doing FTDD, so the functional test coverage can be quite poor, even though we ensure high unit test coverage. We use NCover to check unit test coverage.

解决方案

There are at least two (commercial but cheap) tools that I know of that allow you to attach to the IIS process to capture coverage data for IIS applications.

NCover:

NCover includes the //iis command line switch. This switch sets up the coverage environment within IIS and restarts the web server. You’ll run NCover like this to analyze coverage for your web applications:

NCover.Console.exe nunit-console.exe TestAssembly.dll //iis When you run NCover in this way, IIS will be restarted to allow NCover to monitor your coverage, and your tests will be run. Once finished, NCover will stop IIS and detach itself.

See: http://docs.ncover.com/how-to/code-coverage-of-asp-net-applications-on-iis/

DotCover by jetbrains:

Dotcover has visual studio integration which allows you to attach to an IIS application in the same way you would do if you'd want to trace your IIS application. This probably can also be started with the commandline dotCover tool although i've never actually tried this.

See http://www.jetbrains.com/dotcover/

I think Rational and Microsoft Teamsystem also have solutions but they're a bit more expensive.

这篇关于功能测试的覆盖率分析的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！