XGBoost-H2O因非法内存访问而崩溃 [英] XGBoost - H2O crashed due to an illegal memory access

查看：120
本文介绍了XGBoost-H2O因非法内存访问而崩溃的处理方法，对大家解决问题具有一定的参考价值，需要的朋友们下面随着小编来一起学习吧！

问题描述

使用XGBoost进行网格搜索时，H2O进程崩溃:

H2O process crashed when doing a Grid Search with XGBoost:

抛出'thrust :: system :: system_error'实例后调用

terminate what():/tmp/xgboost/plugin/updater_gpu/src/device_helpers.cuh(387):遇到非法的内存访问

terminate called after throwing an instance of 'thrust::system::system_error' what(): /tmp/xgboost/plugin/updater_gpu/src/device_helpers.cuh(387): an illegal memory access was encountered

在给出下面的INFO消息之后:

After giving the INFO message below:

08-17 06:44:46.672 10.0.1.89:54321 14426 FJ-1-3信息:使用对数损耗度量检查收敛性:0.04519170911104479-> 0.02811784326194906(仍在改进中) . 08-17 06:44:46.672 10.0.1.89:54321 14426 FJ-1-3信息:对于网格:建立的final_grid:90个模型.

08-17 06:44:46.672 10.0.1.89:54321 14426 FJ-1-3 INFO: Checking convergence with logloss metric: 0.04519170911104479 --> 0.02811784326194906 (still improving) . 08-17 06:44:46.672 10.0.1.89:54321 14426 FJ-1-3 INFO: For grid: final_grid built: 90 models.

Java异常转储:

08-17 06:44:46.742 10.0.1.89:54321 14426#12317-18信息:GET/99/Grids/final_grid，parms:{} 08-17 06:44:46.747 10.0.1.89:54321 14426#12317-18 ERRR:java.lang.IllegalArgumentException:找不到字段:'col_sample_rate_change_per_level/_col_sample_rate _change_per_level'on hex.tree.xgboost.XGBoostModel$XGBoostParameters@49356589 08-17 06:44:46.747 10.0.1.89:54321 14426#12317-18 ERRR:at water.util.PojoUtils.getFieldValue(PojoUtils.java:562) 08-17 06:44:46.747 10.0.1.89:54321 14426#12317-18 ERRR:at hex.grid.Grid.createSummaryTable(Grid.java:370) 08-17 06:44:46.747 10.0.1.89:54321 14426#12317-18 ERRR:at hex.schemas.GridSchemaV99.fillFromImpl(GridSchemaV99.java:158) 08-17 06:44:46.747 10.0.1.89:54321 14426#12317-18错误:在water.api.GridsHandler.fetch(GridsHandler.java:41) 08-17 06:44:46.747 10.0.1.89:54321 14426#12317-18错误:at sun.reflect.GeneratedMethodAccessor41.invoke(未知源) 08-17 06:44:46.747 10.0.1.89:54321 14426#12317-18 ERRR:at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 08-17 06:44:46.747 10.0.1.89:54321 14426#12317-18错误:at java.lang.reflect.Method.invoke(Method.java:498) 08-17 06:44:46.747 10.0.1.89:54321 14426#12317-18错误:在water.api.Handler.handle(Handler.java:63) 08-17 06:44:46.747 10.0.1.89:54321 14426#12317-18错误:at water.api.RequestServer.serve(RequestServer.java:448) 08-17 06:44:46.747 10.0.1.89:54321 14426#12317-18错误:at water.api.RequestServer.doGeneric(RequestServer.java:297) 08-17 06:44:46.747 10.0.1.89:54321 14426#12317-18错误:在water.api.RequestServer.doGet(RequestServer.java:221) 08-17 06:44:46.747 10.0.1.89:54321 14426#12317-18 ERRR:at javax.servlet.http.HttpServlet.service(HttpServlet.java:735) 08-17 06:44:46.747 10.0.1.89:54321 14426#12317-18 ERRR:at javax.servlet.http.HttpServlet.service(HttpServlet.java:848) 08-17 06:44:46.747 10.0.1.89:54321 14426#12317-18错误:在org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:684) 08-17 06:44:46.747 10.0.1.89:54321 14426#12317-18错误:在org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:503) 08-17 06:44:46.747 10.0.1.89:54321 14426#12317-18错误:在org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1086) 08-17 06:44:46.747 10.0.1.89:54321 14426#12317-18错误:在org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:429) 08-17 06:44:46.747 10.0.1.89:54321 14426#12317-18错误:在org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1020) 08-17 06:44:46.747 10.0.1.89:54321 14426#12317-18错误:在org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135) 08-17 06:44:46.747 10.0.1.89:54321 14426#12317-18错误:在org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154) 08-17 06:44:46.747 10.0.1.89:54321 14426#12317-18错误:在org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116) 08-17 06:44:46.747 10.0.1.89:54321 14426#12317-18 ERRR:at water.JettyHTTPD $ LoginHandler.handle(JettyHTTPD.java:183) 08-17 06:44:46.747 10.0.1.89:54321 14426#12317-18错误:在org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:503) 08-17 06:44:46.747 10.0.1.89:54321 14426#12317-18错误:在org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1086) 08-17 06:44:46.747 10.0.1.89:54321 14426#12317-18错误:在org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:429) 08-17 06:44:46.747 10.0.1.89:54321 14426#12317-18错误:在org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1020) 08-17 06:44:46.747 10.0.1.89:54321 14426#12317-18错误:在org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135) 08-17 06:44:46.747 10.0.1.89:54321 14426#12317-18错误:在org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154) 08-17 06:44:46.747 10.0.1.89:54321 14426#12317-18错误:在org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116) 08-17 06:44:46.747 10.0.1.89:54321 14426#12317-18 ERRR:at water.JettyHTTPD $ LoginHandler.handle(JettyHTTPD.java:183) 08-17 06:44:46.747 10.0.1.89:54321 14426#12317-18错误:在org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154) 08-17 06:44:46.747 10.0.1.89:54321 14426#12317-18错误:在org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116) 08-17 06:44:46.747 10.0.1.89:54321 14426#12317-18错误:在org.eclipse.jetty.server.Server.handle(Server.java:370) 08-17 06:44:46.747 10.0.1.89:54321 14426#12317-18错误:在org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:49 4) 08-17 06:44:46.747 10.0.1.89:54321 14426#12317-18错误:在org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53 ) 08-17 06:44:46.747 10.0.1.89:54321 14426#12317-18错误:在org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:9 71) 08-17 06:44:46.747 10.0.1.89:54321 14426#12317-18错误:在org.eclipse.jetty.server.AbstractHttpConnection $ RequestHandler.headerComplete(AbstractHttpCo nnection.java:1033) 08-17 06:44:46.747 10.0.1.89:54321 14426#12317-18错误:在org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:644) 08-17 06:44:46.747 10.0.1.89:54321 14426#12317-18错误:在org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235) 08-17 06:44:46.747 10.0.1.89:54321 14426#12317-18错误:在org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72) 08-17 06:44:46.747 10.0.1.89:54321 14426#12317-18错误:在org.eclipse.jetty.server.bio.SocketConnector $ ConnectorEndPoint.run(SocketConnector.java:264) 08-17 06:44:46.747 10.0.1.89:54321 14426#12317-18错误:在org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608) 08-17 06:44:46.747 10.0.1.89:54321 14426#12317-18错误:在org.eclipse.jetty.util.thread.QueuedThreadPool $ 3.run(QueuedThreadPool.java:543) 08-17 06:44:46.747 10.0.1.89:54321 14426#12317-18 ERRR:at java.lang.Thread.run(Thread.java:748) 08-17 06:44:46.747 10.0.1.89:54321 14426#12317-18错误:捕获的异常: 08-17 06:44:46.747 10.0.1.89:54321 14426#12317-18错误: 08-17 06:44:46.747 10.0.1.89:54321 14426#12317-18错误:错误消息: 08-17 06:44:46.747 10.0.1.89:54321 14426#12317-18错误: 08-17 06:44:46.747 10.0.1.89:54321 14426#12317-18错误:找不到字段:对象hex.tre上的'col_sample_rate_change_per_level/_col_sample_rate_change_per_level' e.xgboost.XGBoostModel$XGBoostParameters@49356589

08-17 06:44:46.742 10.0.1.89:54321 14426 #12317-18 INFO: GET /99/Grids/final_grid, parms: {} 08-17 06:44:46.747 10.0.1.89:54321 14426 #12317-18 ERRR: java.lang.IllegalArgumentException: Field not found: 'col_sample_rate_change_per_level/_col_sample_rate _change_per_level' on object hex.tree.xgboost.XGBoostModel$XGBoostParameters@49356589 08-17 06:44:46.747 10.0.1.89:54321 14426 #12317-18 ERRR: at water.util.PojoUtils.getFieldValue(PojoUtils.java:562) 08-17 06:44:46.747 10.0.1.89:54321 14426 #12317-18 ERRR: at hex.grid.Grid.createSummaryTable(Grid.java:370) 08-17 06:44:46.747 10.0.1.89:54321 14426 #12317-18 ERRR: at hex.schemas.GridSchemaV99.fillFromImpl(GridSchemaV99.java:158) 08-17 06:44:46.747 10.0.1.89:54321 14426 #12317-18 ERRR: at water.api.GridsHandler.fetch(GridsHandler.java:41) 08-17 06:44:46.747 10.0.1.89:54321 14426 #12317-18 ERRR: at sun.reflect.GeneratedMethodAccessor41.invoke(Unknown Source) 08-17 06:44:46.747 10.0.1.89:54321 14426 #12317-18 ERRR: at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 08-17 06:44:46.747 10.0.1.89:54321 14426 #12317-18 ERRR: at java.lang.reflect.Method.invoke(Method.java:498) 08-17 06:44:46.747 10.0.1.89:54321 14426 #12317-18 ERRR: at water.api.Handler.handle(Handler.java:63) 08-17 06:44:46.747 10.0.1.89:54321 14426 #12317-18 ERRR: at water.api.RequestServer.serve(RequestServer.java:448) 08-17 06:44:46.747 10.0.1.89:54321 14426 #12317-18 ERRR: at water.api.RequestServer.doGeneric(RequestServer.java:297) 08-17 06:44:46.747 10.0.1.89:54321 14426 #12317-18 ERRR: at water.api.RequestServer.doGet(RequestServer.java:221) 08-17 06:44:46.747 10.0.1.89:54321 14426 #12317-18 ERRR: at javax.servlet.http.HttpServlet.service(HttpServlet.java:735) 08-17 06:44:46.747 10.0.1.89:54321 14426 #12317-18 ERRR: at javax.servlet.http.HttpServlet.service(HttpServlet.java:848) 08-17 06:44:46.747 10.0.1.89:54321 14426 #12317-18 ERRR: at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:684) 08-17 06:44:46.747 10.0.1.89:54321 14426 #12317-18 ERRR: at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:503) 08-17 06:44:46.747 10.0.1.89:54321 14426 #12317-18 ERRR: at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1086) 08-17 06:44:46.747 10.0.1.89:54321 14426 #12317-18 ERRR: at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:429) 08-17 06:44:46.747 10.0.1.89:54321 14426 #12317-18 ERRR: at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1020) 08-17 06:44:46.747 10.0.1.89:54321 14426 #12317-18 ERRR: at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135) 08-17 06:44:46.747 10.0.1.89:54321 14426 #12317-18 ERRR: at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154) 08-17 06:44:46.747 10.0.1.89:54321 14426 #12317-18 ERRR: at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116) 08-17 06:44:46.747 10.0.1.89:54321 14426 #12317-18 ERRR: at water.JettyHTTPD$LoginHandler.handle(JettyHTTPD.java:183) 08-17 06:44:46.747 10.0.1.89:54321 14426 #12317-18 ERRR: at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:503) 08-17 06:44:46.747 10.0.1.89:54321 14426 #12317-18 ERRR: at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1086) 08-17 06:44:46.747 10.0.1.89:54321 14426 #12317-18 ERRR: at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:429) 08-17 06:44:46.747 10.0.1.89:54321 14426 #12317-18 ERRR: at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1020) 08-17 06:44:46.747 10.0.1.89:54321 14426 #12317-18 ERRR: at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135) 08-17 06:44:46.747 10.0.1.89:54321 14426 #12317-18 ERRR: at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154) 08-17 06:44:46.747 10.0.1.89:54321 14426 #12317-18 ERRR: at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116) 08-17 06:44:46.747 10.0.1.89:54321 14426 #12317-18 ERRR: at water.JettyHTTPD$LoginHandler.handle(JettyHTTPD.java:183) 08-17 06:44:46.747 10.0.1.89:54321 14426 #12317-18 ERRR: at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154) 08-17 06:44:46.747 10.0.1.89:54321 14426 #12317-18 ERRR: at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116) 08-17 06:44:46.747 10.0.1.89:54321 14426 #12317-18 ERRR: at org.eclipse.jetty.server.Server.handle(Server.java:370) 08-17 06:44:46.747 10.0.1.89:54321 14426 #12317-18 ERRR: at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:49 4) 08-17 06:44:46.747 10.0.1.89:54321 14426 #12317-18 ERRR: at org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53 ) 08-17 06:44:46.747 10.0.1.89:54321 14426 #12317-18 ERRR: at org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:9 71) 08-17 06:44:46.747 10.0.1.89:54321 14426 #12317-18 ERRR: at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpCo nnection.java:1033) 08-17 06:44:46.747 10.0.1.89:54321 14426 #12317-18 ERRR: at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:644) 08-17 06:44:46.747 10.0.1.89:54321 14426 #12317-18 ERRR: at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235) 08-17 06:44:46.747 10.0.1.89:54321 14426 #12317-18 ERRR: at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72) 08-17 06:44:46.747 10.0.1.89:54321 14426 #12317-18 ERRR: at org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264) 08-17 06:44:46.747 10.0.1.89:54321 14426 #12317-18 ERRR: at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608) 08-17 06:44:46.747 10.0.1.89:54321 14426 #12317-18 ERRR: at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543) 08-17 06:44:46.747 10.0.1.89:54321 14426 #12317-18 ERRR: at java.lang.Thread.run(Thread.java:748) 08-17 06:44:46.747 10.0.1.89:54321 14426 #12317-18 ERRR: Caught exception: 08-17 06:44:46.747 10.0.1.89:54321 14426 #12317-18 ERRR: 08-17 06:44:46.747 10.0.1.89:54321 14426 #12317-18 ERRR: ERROR MESSAGE: 08-17 06:44:46.747 10.0.1.89:54321 14426 #12317-18 ERRR: 08-17 06:44:46.747 10.0.1.89:54321 14426 #12317-18 ERRR: Field not found: 'col_sample_rate_change_per_level/_col_sample_rate_change_per_level' on object hex.tre e.xgboost.XGBoostModel$XGBoostParameters@49356589

推荐答案

col_sample_rate_per_level不支持xgboost，仅GBM和随机林支持: http://docs. h2o.ai/h2o/latest-stable/h2o-docs/data-science/algo-params/col_sample_rate_change_per_level.html

col_sample_rate_per_level is not supported for xgboost, only GBM and random forest: http://docs.h2o.ai/h2o/latest-stable/h2o-docs/data-science/algo-params/col_sample_rate_change_per_level.html

以下是您可以与xgboost网格一起使用的列表: http://docs.h2o.ai/h2o/latest-stable/h2o-docs/grid-search.html#xgboost-hyperparameters

Here is the list of what you can use with an xgboost grid: http://docs.h2o.ai/h2o/latest-stable/h2o-docs/grid-search.html#xgboost-hyperparameters

(当然，它应该告诉您，并且不会崩溃，因此绝对是一个错误！)

(Of course, it ought to be telling you that, and not crashing, so definitely a bug!)

这篇关于XGBoost-H2O因非法内存访问而崩溃的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！

查看全文
相关文章
其他开发最新文章
热门教程
热门工具
登录 关闭
扫码关注1秒登录
发送“验证码”获取 | 15天全站免登陆