Python sklearn 在训练期间显示损失值 [英] Python sklearn show loss values during training

问题描述

我想在训练期间检查我的损失值，以便我可以观察每次迭代的损失.到目前为止，我还没有找到一种简单的方法让 scikit 学会为我提供损失值的历史记录，也没有找到 scikit 中已有的功能来为我绘制损失图.

I want check my loss values during the training time so I can observe the loss at each iteration. So far I haven't found an easy way for scikit learn to give me a history of loss values, nor did I find a functionality already within scikit to plot the loss for me.

如果没有办法绘制这个，如果我能在classifier.fit结束时简单地获取最终的损失值就好了.

If there was no way to plot this, it'd be great if I could simply fetch the final loss values at the end of classifier.fit.

注意:我知道有些解决方案是封闭形式的.我使用了几个没有解析解的分类器，例如逻辑回归和支持向量机.

Note: I am aware of the fact that some solutions are closed form. I'm using several classifiers which do not have analytical solutions, such as logistic regression and svm.

有人有什么建议吗?

推荐答案

所以我找不到关于直接获取每次迭代的损失值的很好的文档，但我希望这会对将来的人有所帮助:

So I couldn't find very good documentation on directly fetching the loss values per iteration, but I hope this will help someone in the future:

old_stdout = sys.stdout
sys.stdout = mystdout = StringIO()
clf = SGDClassifier(**kwargs, verbose=1)
clf.fit(X_tr, y_tr)
sys.stdout = old_stdout
loss_history = mystdout.getvalue()
loss_list = []
for line in loss_history.split('
'):
    if(len(line.split("loss: ")) == 1):
        continue
    loss_list.append(float(line.split("loss: ")[-1]))
plt.figure()
plt.plot(np.arange(len(loss_list)), loss_list)
plt.savefig("warmstart_plots/pure_SGD:"+str(kwargs)+".png")
plt.xlabel("Time in epochs")
plt.ylabel("Loss")
plt.close()

此代码将采用普通的 SGDClassifier(几乎任何线性分类器)，并拦截 verbose=1 标志，然后将拆分以从详细打印中获取损失.显然这比较慢，但会给我们带来损失并打印出来.

This code will take a normal SGDClassifier(just about any linear classifier), and intercept the verbose=1 flag, and will then split to get the loss from the verbose printing. Obviously this is slower but will give us the loss and print it.

这篇关于Python sklearn 在训练期间显示损失值的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！