从EC2上运行的Jupyter/IPython向EMR集群发送命令 [英] Sending Commands from Jupyter/IPython running on EC2 to EMR cluster

问题描述

我们可以从运行在AWS EC2上的Jupyter/IPython笔记本向具有单词计数代码的AWS EMR发送命令吗? 我已按照以下网址进行安装 在EC2上使用Jupyter. 还有另一个链接可以在EMR上安装 Jupyter并执行字数统计

但是，我想分开Jupyter来执行EC2，将字数统计功能在EMR上执行.有什么办法可以做到这一点?

解决方案

有关在连接到EMR集群的外部EC2主机上运行Zeppelin的这一AWS Big Data Blog文章可能会帮助您使用Jupyter而非Zeppelin实现类似的功能:

https://blogs.aws.amazon.com/bigdata/post/Tx2HJD3Z74J2U8U/Running-an-External-Zeppelin-Instance-using-S3-Backed-notebooks-with-Spark-on-是

Can we send commands from Jupyter/IPython notebook running on AWS EC2 to AWS EMR having our code of word count ? I have followed the following url for installation of Jupyter on EC2. There is another link which installs Jupyter on EMR and performs Word Count

However i want to seperate the Jupyter to come on EC2 and Word Count to execute on EMR. Is there any way that this could be done ?

解决方案

This AWS Big Data Blog post for running Zeppelin on an external EC2 host connected to an EMR cluster may help you with achieving something similar with Jupyter instead of Zeppelin:

https://blogs.aws.amazon.com/bigdata/post/Tx2HJD3Z74J2U8U/Running-an-External-Zeppelin-Instance-using-S3-Backed-Notebooks-with-Spark-on-Am

这篇关于从EC2上运行的Jupyter/IPython向EMR集群发送命令的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！