从Azure Data Lake读取数据 [英] Reading Data from Azure Data Lake

问题描述

1)如何检查 Azure Data Lake Storage 中的文件，如何查看它们，检查它们的大小以及在门户中查看/读取它们?

1) How to check which files are in Azure Data Lake Storage, how to view them, check their size, view/read them in portal?

2)在从Premise上的Azure SQL复制数据到Azure Data Lake Storage的同时我们可以选择哪种格式存储?数据或Azure Data Lake Storage默认情况下以某种本机格式存储数据.

2) While copying Data from Azure SQL on Premise to Azure Data Lake Storage  do we have any option in which format to store  data or Azure Data Lake Storage stores data by default in some native format.

3)我已经安装了Azure Storage Explorer，可以查看文件列表，但如何读取它们.我是否需要将数据从这些文件复制到Azure SQL数据库或如何读取这些文件，还是取决于格式文件是否保存在Azure Data Lake Storage中? 需要安装其他工具才能读取该类型的文件.

3) I have installed Azure Storage Explorer and can view list of files but how to read them. Do I need to copy data from these files to Azure SQL Database or how to read these files OR depending on the format file is saved in Azure Data Lake Storage we  need to install some other tool to read that type of file.

推荐答案

Dhiraj，

Hi Dhiraj,

关于Azure Data Lake Storage Gen 1:

With reference to Azure Data Lake Storage Gen 1 :

1.在门户上，您可以导航到Data Lake Store，然后转到Data Explorer读取/写入文件，检查文件大小等.

1. On the portal, you can navigate to your Data Lake Store and go to the Data Explorer to read/write files, check their size, etc.

2.您可以使用Azure数据工厂将数据从Azure SQL复制到Azure数据湖存储，并在文件格式设置下指定文件格式.支持的格式为-文本，Avro，JSON，ORC和Parquet.您还可以使用检测文本格式功能 选择适合您的格式.

2. You can use Azure Data Factory to copy data from Azure SQL to Azure Data Lake Storage and specify the file format under the file format settings. The supported formats are - Text, Avro, JSON, ORC and Parquet. You can also use the detect text format feature to select the suitable format for you.

3.在Azure Storage Explorer的最新版本(1.6.1)中，您可以通过双击文件或单击打开"来读取文件.

3. In the latest version (1.6.1) of Azure Storage Explorer, you can read the files by double clicking on them or by clicking on "Open"

PS:Azure Data Lake Storage Gen 2是专门的 Storage帐户，因此可以像读取普通Storage帐户一样读取其内容.您必须从Azure Storage Explorer中在本地下载Blob才能查看它们.

PS : Azure Data Lake Storage Gen 2 is a specialised Storage account and hence it's contents can be read as you would do for a normal Storage account. From Azure Storage Explorer, you will have to download your blobs locally to view them.

让我们知道这是否有帮助.否则，我们可以继续进行进一步的研究.

Let us know if this helps. Else, we can continue to probe in further.

这篇关于从Azure Data Lake读取数据的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！