Weka:10倍CV中各折的结果 [英] Weka: Results of each fold in 10-fold CV

问题描述

对于Weka Explorer(GUI)，当我们对任何给定的 ARFF 文件进行10倍CV验证时，Weka Explorer提供的数据(据我所知)是所有文件的平均结果10折.

For Weka Explorer (GUI), when we do a 10-fold CV for any given ARFF file, then what Weka Explorer provides (as far as I can see) is the average result for all the 10 folds.

问.是否有任何方法可以得出每折的结果?例如，我需要每个折叠的错误率(标识错误的实例).

Q. Is there any way to get the results of each fold? For instance, I need the error rates (incorrectly identified instances) for each fold.

帮助表示赞赏.

推荐答案

我认为使用Weka的GUI可以实现 .不过，您需要使用实验器而不是资源管理器.步骤如下:

I think this is possible using Weka's GUI. You need to use the Experimenter though instead of the Explorer. Here are the steps:

1. 从GUI选择器中打开Experimenter
   • 创建一个新实验(New按钮@右上角)
   • [可选]在Results Destination中输入文件名和位置，将结果保存到
   • 根据自己的喜好设置Number of (cross-validation) folds(开始进行2折实验以获得简单结果)
   • 添加数据集(如果数据集需要预处理，则应先在资源管理器中执行此操作，然后保存预处理的数据集)
   • 设置Number of repetitions(建议从1开始)
   • 添加要测试的算法(再次轻松开始，从一种算法开始)

1. Open the Experimenter from the GUI Chooser
   • Create a new experiment (New button @ top-right)
   • [optional] Enter a filename and location in the Results Destination to save the results to
   • Set the Number of (cross-validation) folds to your liking (start experimenting with 2 folds for easy results)
   • Add your dataset (if your dataset needs preprocessing then you should do this in the Explorer first and then save the preprocessed dataset)
   • Set the Number of repetitions (I recommend 1 to start of with)
   • Add the algorithm(s) you want to test (again start easy, start with one algorithm)

• 对于Row，选择:Fold
• 对于Column，选择:Percent_incorrect或Number_incorrect(或您要查看的任何其他度量)
• 您现在可以看到每折的指定结果

• For Row select: Fold
• For Column select: Percent_incorrect or Number_incorrect (or any other measure you want to see)
• You now see the specified results for each fold

这篇关于Weka:10倍CV中各折的结果的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！