尝试在数据工厂v2中执行配置单元脚本时出错 [英] Error while trying to execute a hive script in data factory v2

问题描述

我在尝试使用数据工厂执行配置单元脚本时遇到了一些麻烦。我正在创建管道以将数据复制到数据湖并使用配置单元处理该数据。

I'm having some trouble trying to execute hive scripts using data factory. I'm creating pipelines to copy data to a data lake and process that data using hive.

这里我们在azure上有一个集群，所以我不使用和"按需HDInsight"，但我正在尝试为该特定群集配置链接服务。

Here we have a cluster on azure so I'm not using an "On-demand HDInsight", but instead I'm trying to configure a linked service for that specific cluster.

例如，我正在尝试执行"插入"命令，所以我创建一个.hql文件并将其放在存储blob上。

For example, I'm trying to execute an "Insert" command, so I create a .hql file and put it on a storage blob.

我正在尝试执行的代码是:(我更改了对象名称，但它是就像那样）我已经在hive上运行了这些代码，所以我知道它正在工作。 

The code I'm trying to execute is this: (I changed the object names, but it's exactly like that) I've already ran that code on hive so I know it's working. 

use DB_NAME;

INSERT OVERWRITE TABLE TARGET_TABLE
SELECT 
FIELD1,
FIELD2,
FIELD3,
FIELD4,
FIELD5,
FIELD6,
FIELD7
FROM
SOURCE_TABLE
WHERE FIELD1 IS NOT NULL
AND FIELD2 IS NOT NULL
AND FIELD3 IS NOT NULL
AND FIELD4 IS NOT NULL
AND FIELD5 IS NOT NULL
AND FIELD6 IS NOT NULL
AND FIELD7 IS NOT NULL;

我尝试运行管道时遇到的错误是下面的错误：

The error I get when I try to run the pipeline is the error bellow:

{
    "errorCode": "2300",
    "message": "Hadoop job submission failed. Job: 51540c3c-3e1d-4c92-b46b-c68b1039b834, Cluster: https://<clustername>.azurehdinsight.net/. Error: A task was canceled..",
    "failureType": "UserError",
    "target": "Hive1"
}

我找不到上述错误的任何参考。 

I just can't find any reference on the error above. 

Obs。：我尝试上传图片，其中包含有关我正在使用的配置和管道的更多信息，但显然我不能直到他们验证我的帐户...

Obs.: I tried uploading images with more information about the configurations and the pipeline I'm using but apparently I can't til they verify my account...

推荐答案

请在验证帐户后上传这些信息。我们有必要确定这些信息的问题。

Please upload those information once your account is verified. It will be useful for us to identify the issue with those information.

这篇关于尝试在数据工厂v2中执行配置单元脚本时出错的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！