h2o-xgboost支持多CPU吗? [英] is multi-cpu supported by h2o-xgboost?

问题描述

是否存在允许在多线程中运行 H2OXGBoostEstimator 的配置，而不是在具有一个CPU的最低配置中运行h2o版本3.15.0.4035的 H2OXGBoostEstimator ?

Is there a configuration which allows to run H2OXGBoostEstimator in multithreading and not in the minimal config with one CPU, with h2o version 3.15.0.4035?

推荐答案

H2O上的xgboost实现是多线程的，与H2O中支持的所有其他算法一样，但是它与平台有关，在

xgboost implementation on H2O is multithreaded and like all other algorithms supported into H2O however it is platform dependent which is described into H2O documentation properly.

因此，如果您在Linux上进行尝试，并且拥有所有受支持的库，那么您将利用分布式xgboost的优势，否则像OSX一样，您可能会获得单个CPU回退运行时.因此，这完全取决于从您的操作系统加载哪个库.

So if you try it on Linux, and have all supported libraries available then you will take advantage of distributed xgboost otherwise like OSX, you might get a single CPU fall back runtime. So it's all depend on which lib is loaded from your OS.

在日志中启动H2O时，您将看到以下内容:

When H2O starts in the log you will see the following:

10-02 09:25:34.579 10.0.0.46:54321       54229  main      INFO: Registered 3 core extensions in: 57ms
10-02 09:25:34.580 10.0.0.46:54321       54229  main      INFO: Registered H2O core extensions: [Watchdog, XGBoost, KrbStandalone]
10-02 09:25:34.791 10.0.0.46:54321       54229  main      INFO: Registered: 161 REST APIs in: 211ms
10-02 09:25:34.791 10.0.0.46:54321       54229  main      INFO: Registered REST API extensions: [XGBoost, Algos, AutoML, Core V3, Core V4]

然后您将看到是否包括以下CPU/GPU:

Then you will see if CPU/GPU is included as below:

10-02 09:23:49.952 10.0.0.46:54321       54143  FJ-1-5    INFO: No GPU (gpu_id: 0) found. Using CPU backend.

如果您可以运行objdump或ldd命令来查看H2O加载的库，则可以更好地了解会丢失哪些内容，从而导致xgboost运行时成为单个CPU.

If you could run objdump or ldd command to see the libs loaded with H2O, you will have better idea what is missed which cause your xgboost runtime to be single CPU.

这篇关于h2o-xgboost支持多CPU吗?的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！