基准与基准之间在应用程序性能方面的差异 [英] difference between baseline and benchmark in performance of an application

问题描述

什么是基准，什么是基准?最好的定义是什么?如何确定一组数字的基准并确定另一组数字的基准?

what is a baseline and what is a benchmark? what is the best definition for these and how do you baseline a set of numbers and benchmark another set?

推荐答案

HI Gagneet，我在Windows性能团队工作:这是我们使用这些术语的方式.

HI Gagneet, I'm on the Windows performance team: here is how we use these terms.

基线是已知配置的度量，用作后续度量的参考.对于基线，我们表征被测物:以冷启动时间为例.在这里，我们拥有一组性能良好的机器-这意味着我们知道它们的工作方式，我们为它们提供了良好的驱动程序，并且硬件没有损坏或有缺陷.

A baseline is a measurement of a known configuration that is used as a reference for subsequent measurements. For base line, we characterize the thing being measured: lets take cold boot time for example. Here we have a set of machines that are well characterized - this means we know how they work, that we have good drivers for them, and that the hardware isn't broken or flawed.

在此硬件上，我们有多个基准"测量值，例如XP-RTM，XP-SP2，Vista-RTM，Vista-SP1，Vista-SP2等.

On this hardware, we have several "base line" measurements such as XP-RTM, XP-SP2, Vista-RTM, Vista-SP1, Vista-SP2, etc. etc.

对于每条基准线，我们都有一组特征明确且易于理解的度量，包括引导的所有阶段，CPU数量，磁盘和内存利用率，DLL加载数量等.

For each of these base lines, we have a set of well characterized and understood measurements including all the phases of boot, the amount of CPU, disk and memory utilization, the number of DLL loads, etc. etc.

在建立基线之后，我们可以进行其他测量并将其与基线进行比较.例如，我们目前正在研究 Window-7 .对于每个构建(每天)，我们运行一组启动时间测试.我们将每个Win-7版本的所有特性与基线测量值进行比较.这包括所有以前的Win-7版本.这使我们能够看到差异所在，并帮助我们深入研究问题区域. 这里有更多详细信息.

After a baseline is established, we can then take other measurements and compare them to the base line. For example, we are currently working on Window-7. For each build (daily) we run a set of boot time tests. We compare all the characteristics of each Win-7 build to the base line measurements. This includes all the previous Win-7 builds. This lets us see where the differences lie and helps us drill into the problem areas. Here are some more details.

这篇关于基准与基准之间在应用程序性能方面的差异的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！