码头工人映像可以使用hadoop吗? [英] Can a docker image use hadoop?

查看:128
本文介绍了码头工人映像可以使用hadoop吗?的处理方法,对大家解决问题具有一定的参考价值,需要的朋友们下面随着小编来一起学习吧!

问题描述

泊坞窗图像可以访问hadoop资源吗?例如.提交YARN作业并访问HDFS;类似于 MapR的Datasci.精炼厂,但适用于Hortonworks HDP 3.1. (可以假定该映像将在hadoop群集节点上启动.)

Can a docker image access hadoop resources? Eg. submit YARN jobs and access HDFS; something like MapR's Datasci. Refinery, but for Hortonworks HDP 3.1. (May assume that the image will be launched on a hadoop cluster node).

看到了hadoop docs 用于从hadoop节点启动docker应用程序,但对是否可以另辟way径"感兴趣(例如,能够使用常规的docker -ti ...命令启动docker映像,并使该应用程序能够运行hadoop jars等). (假设Docker映像主机本身是hadoop节点).我了解到MapR hadoop具有用于执行的docker映像,但是对使用Hortonworks HDP 3.1.最终尝试运行 h2o hadoop在docker容器中.

Saw the hadoop docs for launching docker applications from hadoop nodes, but was interested in whether could go the "other way" (ie. being able to start a docker image with the conventional docker -ti ... command and have that application be able to run hadoop jars etc. (assuming that the docker image host is a hadoop node itself)). I understand that MapR hadoop has docker images for doing this, but am interested in using Hortonworks HDP 3.1. Ultimately trying to run h2o hadoop in a docker container.

有人知道这是否可行或可以确认这是不可能的吗?

Anyone know if this is possible or can confirm that this is not possible?

推荐答案

是.只要您具有客户端jar和与容器的边缘节点相似的适当配置,它就可以正常工作.

Yes. As long as you have the client jars and appropriate configs similar to an edge node for your container it should work.

这篇关于码头工人映像可以使用hadoop吗?的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持IT屋!

查看全文
登录 关闭
扫码关注1秒登录
发送“验证码”获取 | 15天全站免登陆