客户验收测试应该有多详细? [英] How detailed should a customer acceptance test be?

问题描述

这是一个测试说明，测试了创建新窗口小部件"用例.

Here is a test description, testing the "Create New Widget" use-case.

• 确认您可以在系统中输入新的小部件.

这是另一个测试说明，测试了创建新窗口小部件"用例.

Here is another test description, testing the "Create New Widget" use-case.

• 启动应用程序.
  
• 使用名称"A-008"创建一个新的小部件，其描述为验收测试3-45的测试小部件".
  
• 确认该窗口小部件现在在最左侧的窗口小部件树视图中可见.
  
• 在树形视图中选择另一个窗口小部件，然后再次选择窗口小部件"A-008".确认小部件中显示的值等于您输入的值.
  
• 删除小部件"A-008"并关闭应用程序

这是另一个测试说明，测试了创建新窗口小部件"用例.

Here is another test description, testing the "Create New Widget" use-case.

• 启动应用程序.
• 调出另一个查看相同数据的应用程序实例.
  
• 在应用程序的第一个实例中，右键单击窗口小部件"节点.在随后的上下文菜单中，激活创建新窗口小部件"菜单项.
  
• 应激活新窗口小部件"窗口.将每个字段留空，然后按确定按钮.将出现一个消息框，提示请输入小部件名称".在此消息框中按确定".
  
• 在名称"字段中输入"A-008".
  
• 将描述字段设置为美洲驼(Lama glama)是南美骆驼，被印加人和安第斯山脉的其他本地人广泛用作pack类动物.在南美，美洲驼仍用作野兽一个成年的全尺寸美洲驼的头顶高5.5英尺(1.6米)至6英尺(1.8米).体重在280磅(127千克)至450磅(204千克)之间.出生时，美洲驼(叫叫小羊驼)的体重在20磅(9千克)至30磅(14千克)之间.
• 按确定"按钮.将出现一个消息框，提示说明必须少于或等于512个字符"
  
• 将描述设置为')；从小工具中删除1 = 1 ="；在说明"字段中.按下确定按钮.
• 在最左侧的树视图中，应该已经出现了一个名为"A-008"的新小部件.
  
• 在应用程序的第二个实例中激活一个窗口，并确认窗口小部件"A-008"也已自动出现在该树形视图中.
  
• 在应用程序的第一个实例中，右键单击窗口小部件"节点.在随后的上下文菜单中，激活创建新窗口小部件"菜单项.应激活新窗口小部件"窗口.
  
• 将名称设置为"A-008"，然后按OK.必须出现一个消息框，提示此名称的小部件已经存在.请选择另一个小部件名称".
  
• 按此消息框上的确定"按钮，然后按取消"按钮退出创建小部件"对话框.
• 在第二个实例中显示窗口小部件"A-008"的窗口小部件页面.
• 首先，按撤消"菜单项
• 确认第二个实例现在正在显示起始页面.
• ........ etc ..............

• Bring up the application.
• Bring up a second instance of the application viewing the same data.
  
• In the first instance of the application, right-click on the "Widgets" node. In the ensuing context menu, activate the "Create New Widget" menu item.
  
• A "New Widget" window should be activated. Leave every field blank, and press the OK button. A message box should come up saying "Please enter a Widget name". Press OK on this message box.
  
• Enter "A-008" in the "Name" field.
  
• Set the description field to "The llama (Lama glama) is a South American camelid, widely used as a pack animal by the Incas and other natives of the Andes mountains. In South America llamas are still used as beasts of burden, as well as for the production of fiber and meat. The height of a full-grown, full-size llama is between 5.5 feet (1.6 meters) to 6 feet (1.8 meters) tall at the top of the head. They can weigh between approximately 280 pounds (127 kilograms) and 450 pounds (204 kilograms). At birth, a baby llama (called a cria) can weigh between 20 pounds (9 kilograms) to 30 pounds (14 kilograms).
• Press the OK button. A message box should appear saying "The description must be 512 characters or less"
  
• Set the description to "'); DELETE FROM WIDGET WHERE 1=1;" in the "Description" field. Press the OK button.
• In the left-most tree view, a new widget by the name of "A-008" should have appeared.
  
• Activate a window in the second instance of the application, and confirm that Widget "A-008" has automatically appeared in that tree view as well.
  
• In the first instance of the application, right-click on the "Widgets" node. In the ensuing context menu, activate the "Create New Widget" menu item. A "New Widget" window should be activated.
  
• Set the name to "A-008", and press OK. A message box must come up, saying "A Widget with this name already exists. Please select another Widget name".
  
• Press the OK button on this message box, then press the Cancel Button to exit the "Create Widget" dialog box.
• Display the widget page for widget "A-008" in the second instance.
• In the first instance, press the "Undo" menu item
• Confirm that the second instance is now displaying the start page.
• .................etc..............

每个示例测试都可以创建一个新的小部件.在第三个测试中，我正在以经验丰富的程序员的身份测试该功能，然后思考确定，错误可能出现的所有地方"，然后检查所有这些地方.第三个适合于客户验收测试吗?

Each example tests that you can create a new widget. In the third test, I was testing the functionality as an experienced programmer, thinking "OK, where are all of the places a bug can appear", and checking every one of these. Is the third one appropriate for a customer acceptance test?

太全面"有多全面?

推荐答案

用户接受测试用例应该详细而简单，但不如您的第三个示例那么详细. 验收测试是关于确保客户得到他们同意的东西.如果您只是简单地说，单击此选项，然后单击该选项，等等，等等..."，它更像是功能测试.您不是在诱使用户验证功能是否符合验收测试中列出的测试用例.您只要求他们点击您可以简单地自动化的测试.

The user acceptance test cases should be detailed and simple but not as detailed as your third example. Acceptance testing is about making sure the customer gets what they agreed to. If you simply say, "click this then click that, etc, etc..." that is more like a functional test. You are not eliciting users to verify that functionality meets the test case laid out in the acceptance test. You are only asking them to click through tests that you could have simply automated.

用户接受度测试应更多地遵循创建小部件，确认其出现，删除小部件等"的思路.这也将鼓励用户查找各个功能，并(作为副作用)消除您可能忽略的任何可用性问题.

User acceptance tests should be more along the lines of "create widget, verify that it appears, delete widget, etc." This will also encourage users to seek out individual features and (as a side effect) flush out any usability problems you may have overlooked.

这篇关于客户验收测试应该有多详细?的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！