如何安排我的 Apache Spark 应用程序每天早上 00.30(晚上)在 IBM Bluemix 中运行? [英] How to schedule my Apache Spark application to run everyday at 00.30 AM(night) in IBM Bluemix?

问题描述

大家好&IBM Bluemix 团队，我在 IBM Bluemix 中使用 IBM Analytics for Apache Spark 服务.我开发了一个 Apache Spark 应用程序，我想每天在晚上 00.30 运行.如何安排我的 Apache Spark 应用程序在每天凌晨 00.30(晚上)在 IBM Bluemix 中运行?

Hi All & IBM Bluemix team, I am using IBM Analytics for Apache Spark service in IBM Bluemix. I have developed a Apache Spark application and I want to run everyday at 00.30 AM in the night. How to schedule my Apache Spark application to run everyday at 00.30 AM(night) in IBM Bluemix?

推荐答案

您可以使用任何调度工具，例如(Linux 上的 Crontab)，它允许您在特定时间从您的机器运行 spark-submit.sh 脚本.(在你的情况下 00:30am)

You can use any scheduling tool like (Crontab on linux) that will allow you to run spark-submit.sh script from your machine at a specific time.(in your case 00:30am)

典型的 crontab 条目如下所示

A typical crontab entry would look like this

30 0 * * * /<your-directory-where-spraksubmit.sh>/spark-submit.sh --vcap vcap.json --deploy-mode cluster --class org.apache.spark.examples.SparkPi --master https://169.54.219.20 spark-examples-1.6.0-hadoop2.6.0.jar 

参考 IBM spark-submit.shhttps://console.ng.bluemix.net/docs/services/AnalyticsforApacheSpark/index-gentopic3.html

Refrence to IBM spark-submit.sh https://console.ng.bluemix.net/docs/services/AnalyticsforApacheSpark/index-gentopic3.html

Crontab:-

http://kvz.io/blog/2007/07/29/schedule-tasks-on-linux-using-crontab/

同样，您可以使用任何您想要的工具.

Again you can use any tools of your desire.

谢谢，查尔斯.

这篇关于如何安排我的 Apache Spark 应用程序每天早上 00.30(晚上)在 IBM Bluemix 中运行?的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！