AppEngine上的数据流导致访问被拒绝 [英] Dataflow on AppEngine giving access denied

问题描述

我试图在appEngine上运行我的数据流程序，但是当我使用mvn appengine：deveserver在本地运行它时，它给出了以下访问被拒绝的异常

I am trying to run my dataflow program on appEngine but when i run it locally using mvn appengine:deveserver , it gives below access denied exception

[INFO] WARNING: Error for /AppEngineDataFlow
[INFO] org.xerial.snappy.SnappyError: [FAILED_TO_LOAD_NATIVE_LIBRARY] access denied ("java.io.FilePermission" "C:\Users\KAPIL~1.KUM\AppData\Local\Temp" "read")
[INFO]  at org.xerial.snappy.SnappyLoader.load(SnappyLoader.java:159)
[INFO]  at org.xerial.snappy.Snappy.<clinit>(Snappy.java:47)

我在org.xerial.snappy.Snappy我尝试发送管道参数如下：

I am trying to send pipeline arguments as below:

 String[] args = new String[]{"--project=adtech-core","--stagingLocation=gs://adtech-nyt-net/Ad-Delivery/test", "--runner=BlockingDataflowPipelineRunner", "--numWorkers=10", "--filesToStage=gs://adtech-nyt-net/Ad-Delivery/stage","--maxNumWorkers=15", "--inputDate=20160617_2"}

ProcessDFPLogFilesOptions options = PipelineOptionsFactory.fromArgs(args).withValidation().as(ProcessDFPLogFilesOptions.class);     
Pipeline pipeline = Pipeline.create(options);
PCollection<String> dfp_network_data_log = pipeline.apply(TextIO.Read.named("ReadLines").from(_bucket_location).withCompressionType(TextIO.CompressionType.AUTO));

推荐答案

标准AppEngine环境缺少运行数据流Java SDK。正如使用App Engine Cron服务或云计算功能调度数据流管道，您需要使用 flexible 环境在AppEngine上运行。

The standard AppEngine environment lacks the dependencies necessary to run the Dataflow Java SDK. As recommended in Scheduling Dataflow pipelines using App Engine Cron Service or Cloud Functions, you will want to use the flexible environment for running on AppEngine.

这篇关于AppEngine上的数据流导致访问被拒绝的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！