azure.datalake.store.AdlFileSystem在星火未找到 [英] azure.datalake.store.AdlFileSystem not found in Spark

问题描述

我想使用的火花SQL查询放置在数据存储湖csv文件。当我查询我收到抛出java.lang.ClassNotFoundException：类com.microsoft.azure.datalake.store.AdlFileSystem找不到

I am trying to use spark sql to query a csv file placed in Data Lake Store. when I query i am getting "java.lang.ClassNotFoundException: Class com.microsoft.azure.datalake.store.AdlFileSystem not found".

如何使用SQL火花查询放置在数据存储湖的文件？请帮我一个样本。

How can I use spark sql to query a file placed in Data Lake Store? Please help me with a sample.

例如CSV：

Id     Name     Designation
1      aaa      bbb
2      ccc      ddd
3      eee      fff

在此先感谢，
Sowandharya

Thanks in advance, Sowandharya

推荐答案

presently HDInsight - 星火集群是不可用的Azure数据存储湖。一旦我们的支持，将无缝地协同工作。
在平均时间，你可以尝试使用ADL分析同一个作业使用U-SQL查询ADLS。仅供参考，请访问该链接：<一个href=\"https://azure.microsoft.com/en-us/documentation/articles/data-lake-analytics-get-started-portal/\" rel=\"nofollow\">https://azure.microsoft.com/en-us/documentation/articles/data-lake-analytics-get-started-portal/
我们正在努力的支持，它是目前针对一些之前2016年夏天的时间。
希望它帮助。

Presently HDInsight-Spark Clusters are not available with Azure Data Lake Storage. Once we have the support it would work seamlessly. In the mean time you can try and use ADL Analytics to the same job on ADLS using U-SQL queries. For reference please visit the link: https://azure.microsoft.com/en-us/documentation/articles/data-lake-analytics-get-started-portal/ We are working for the support and it is currently targeted for some time prior to summer 2016. Hope it helps.

谢谢，
Sourabh。

Thanks, Sourabh.

这篇关于azure.datalake.store.AdlFileSystem在星火未找到的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！