Weka:10 倍 CV 中每个折叠的结果 [英] Weka: Results of each fold in 10-fold CV

问题描述

对于 Weka Explorer (GUI)，当我们为任何给定的 ARFF 文件做一个 10 倍的 CV 时，那么 Weka Explorer 提供的(就我所见)是所有的平均结果10 折.

For Weka Explorer (GUI), when we do a 10-fold CV for any given ARFF file, then what Weka Explorer provides (as far as I can see) is the average result for all the 10 folds.

问.有什么办法可以得到每次折叠的结果?例如，我需要每个折叠的错误率(错误识别的实例).

Q. Is there any way to get the results of each fold? For instance, I need the error rates (incorrectly identified instances) for each fold.

感谢帮助.

推荐答案

我认为使用 Weka 的 GUI 可以实现这一点.您需要使用 Experimenter 而不是 Explorer.以下是步骤:

I think this is possible using Weka's GUI. You need to use the Experimenter though instead of the Explorer. Here are the steps:

1. 从 GUI 选择器中打开 Experimenter
   • 创建一个新实验(New 按钮@右上角)
   • [可选] 在 Results Destination 中输入文件名和位置以将结果保存到
   • 根据自己的喜好设置(交叉验证)折叠次数(开始尝试 2 次折叠以获得简单的结果)
   • 添加您的数据集(如果您的数据集需要预处理，那么您应该先在资源管理器中执行此操作，然后保存预处理后的数据集)
   • 设置重复次数(我建议从1开始)
   • 添加您要测试的算法(同样从简单开始，从一种算法开始)

1. Open the Experimenter from the GUI Chooser
   • Create a new experiment (New button @ top-right)
   • [optional] Enter a filename and location in the Results Destination to save the results to
   • Set the Number of (cross-validation) folds to your liking (start experimenting with 2 folds for easy results)
   • Add your dataset (if your dataset needs preprocessing then you should do this in the Explorer first and then save the preprocessed dataset)
   • Set the Number of repetitions (I recommend 1 to start of with)
   • Add the algorithm(s) you want to test (again start easy, start with one algorithm)

• 对于Row 选择:Fold
• 对于 Column 选择:Percent_incorrect 或 Number_incorrect(或您想查看的任何其他度量)
• 您现在可以看到每个折叠的指定结果

• For Row select: Fold
• For Column select: Percent_incorrect or Number_incorrect (or any other measure you want to see)
• You now see the specified results for each fold

这篇关于Weka:10 倍 CV 中每个折叠的结果的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！