授权超时:Azure的数据湖存储配置在Azure的数据工厂 [英] Authorization Time Out : Azure Data Lake Store Configuration in Azure Data Factory

查看:333
本文介绍了授权超时:Azure的数据湖存储配置在Azure的数据工厂的处理方法,对大家解决问题具有一定的参考价值,需要的朋友们下面随着小编来一起学习吧!

问题描述

我们用数据工厂的帮助下正从Azure的表的存储天青数据湖Store中的数据。就好像我添加了一个链接服务,连接到Azure的数据存储湖

We are moving the data from Azure Table Storage to Azure Data Lake Store with the help of Data Factory. As part of if I have added a linked service which connects to Azure Data Lake Store.

{
    "name": "AzureDataLakeStoreLinkedService",
    "properties": {
        "description": "",
        "hubName": "xxxxxxxxxxxxxxxxxxxxxx",
        "type": "AzureDataLakeStore",
        "typeProperties": {
            "dataLakeStoreUri": "https://xxxxxxxxxxxxx.azuredatalakestore.net/webhdfs/v1",
            "authorization": "**********",
            "sessionId": "**********",
            "subscriptionId": "XXXXXXXXXXXXXXXXXXXXXx",
            "resourceGroupName": "xxxxxxxxxxxxxxxx"
        }
    }
}

有关此Azure的数据存储湖链接服务有一个授权按钮。我们的授权,我们能够成功地将数据移动到Azure的数据存储湖

For this Azure Data Lake Store linked service there is an Authorize button. We Authorized and we are able to move the data successfully to Azure Data Lake Store.

但问题是一段时间发生的授权到期和要求变成非法之后。话又说回来,我需要重新授权的连接信息。

But the problem is after some time the Authorization expiry occurs and the request becomes unauthorized. Then again I need to reauthorize the connection information.

我要避免这一步,授权在超时后请求每次。如何才能做到这一点?请分享任何有用的链接

I need to avoid this step, Authorizing the requesting everytime after the timeout. How can do it? Please share any useful links

推荐答案

我使用Microsoft帐户授权链接服务。原因在于,超时是频繁发生(不到一天的时间)。我被告知使用的Azure Active Directory帐户,不会为90天超时。我跟着指令和的DataFactory目前工作正常,没有任何超时在过去的一个星期。

I was using Microsoft account to authorize the linked service. Due to that, the timeout of was happening frequently (less than a day).I was advised to use Azure Active Directory Account, which will not timeout for 90 days. I followed the instruction and the DataFactory is currently working fine without any timeout for the past one week.

我的另一个建议是使用服务主体,即具有在Azure Active Directory中,而个别用户帐户注册申请授权。我还没有尝试这种方法。

Another advice I got was to use Service Principal, ie authorize with Application registered in the Azure Active Directory rather that individual user account. I am yet to try this approach.

这篇关于授权超时:Azure的数据湖存储配置在Azure的数据工厂的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持IT屋!

查看全文
登录 关闭
扫码关注1秒登录
发送“验证码”获取 | 15天全站免登陆