带有Azure Datalake Storage Gen 2的Azure Datalake Analytics U-SQL [英] Azure Datalake Analytics U-SQL with Azure Datalake Storage Gen 2

问题描述

问题:将ADLA(U-SQL)与ADLS(Gen2)结合使用的前进方向是什么?

Question : what is the path forward for using ADLA (U-SQL) with ADLS(Gen2) ?

现在我在美国东部2一直通过Azure数据工厂(ADF v2)和Azure数据湖商店第1代来运行Azure数据湖分析(U-SQL)作业

I have been running Azure Data lake Analytics (U-SQL) jobs via Azure Data factory (ADF v2) with Azure Data lake Store Generation 1 for quite a while now in East US2

我正计划部署另一个实例来迎合加拿大客户，并希望设置Azure Data Lake Store Generation 1

I was planning to have another instance deployed to cater Canadian clients and wanted to setup Azure Data lake Store Generation 1

• 我无法在加拿大中部(或任何加拿大地区)创建Azure Datalake Storage Gen 1帐户
• 我试图迁移到Azure Datalake Storage Gen2，但是遇到一个问题，即Azure数据工厂-U-SQL活动无法与Gen2 Storage链接服务链接以获取U-SQL脚本

我偶然发现了与此主题相关的多个链接:

I stumbled upon multiple links about this topic :

• https://feedback.azure.com/forums/327234-data-lake/suggestions/36445702-add-support-for-adls-gen2-to-adla

• https://feedback.azure.com/forums/327234-data-lake/suggestions/36445702-add-support-for-adls-gen2-to-adla
• https://social.msdn.microsoft.com/Forums/en-US/5ce97eef-8940-4591-a19c-934f71825e7d/connect-data-lake-analytics-to-adls-gen-2

基本上说U-SQL/ADLA将不支持ADLS Gen2

which essentially say that U-SQL / ADLA won't be supporting ADLS Gen2

我有点困惑，因为没有关于ADLA方向的官方文件

I am a bit confused since there is no official documentation on ADLA's direction

推荐答案

更新:

这是我的u-sql活动的结构.它可以成功运行和处理:(您可以尝试创建u-sql活动的新json来替换您的u-sql活动.)

This is the structure of my u-sql activity. It can work and process successfully:(You can try to create a new json of u-sql activity to replace your u-sql activity.)

{
    "name": "pipeline4",
    "properties": {
        "activities": [
            {
                "name": "U-SQL1",
                "type": "DataLakeAnalyticsU-SQL",
                "dependsOn": [],
                "policy": {
                    "timeout": "7.00:00:00",
                    "retry": 0,
                    "retryIntervalInSeconds": 30,
                    "secureOutput": false,
                    "secureInput": false
                },
                "userProperties": [],
                "typeProperties": {
                    "scriptPath": "test1/u-sql.txt",
                    "scriptLinkedService": {
                        "referenceName": "LinkTo0730",
                        "type": "LinkedServiceReference"
                    }
                },
                "linkedServiceName": {
                    "referenceName": "AzureDataLakeAnalytics1",
                    "type": "LinkedServiceReference"
                }
            }
        ],
        "annotations": []
    }
}

原始答案:

我无法在中创建Azure Datalake Storage Gen 1帐户 加拿大中部(或任何加拿大地区)

I was not able to create an Azure Datalake Storage Gen 1 account in Central Canada (or any Canadian region for that matter)

就我而言，我也无法在加拿大中部地区创建datalake gen1.这是我的订阅限制.但是您可以检查一下资源管理器，也许可以.(Azure数据湖gen1是'Microsoft.DataLakeStore')

On my side, I also cannot create datalake gen1 on region Central Canada. This is the limit of my subscription. But you can have a check of the resource manager on your side, maybe you can.(Azure data lake gen1 is 'Microsoft.DataLakeStore')

所有区域都支持资源管理器，但是并非所有区域都支持您部署的资源.此外，您的订阅可能会受到限制，从而使您无法使用某些支持该资源的区域.资源浏览器将显示资源类型的有效位置.

请检查此文档:

https://docs.microsoft.com/zh-CN/azure/azure-resource-manager/management/resource-providers-and-types

我尝试迁移到Azure Datalake Storage Gen2，但随后遇到了 无法链接Azure数据工厂-U-SQL活动的问题 Gen2 Storage链接服务访问U-SQL脚本

I tried to move to Azure Datalake Storage Gen2 but then ran into an issue where Azure Data Factory - U-SQL activity could not be linked with Gen2 Storage linked service to pick up U-SQL script

在我这边，似乎正在读取gen2中的u-sql脚本，您遇到了一些错误吗?

On my side, seems it is reading the u-sql script in gen2, did you get some error?

这篇关于带有Azure Datalake Storage Gen 2的Azure Datalake Analytics U-SQL的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！