Databricks中U-SQL filedate的替代方法. [英] Alternative of U-SQL filedate in Databricks.

问题描述

在U-SQL中，通过给定startDate和endDate，我们可以通过给定路径: 

In U-SQL by giving startDate and endDate we can extract all the logs from folders in data lake store by giving path : 

path = "/myData/myLogs/{filedate:yyyy}.{filedate:MM}.{filedate:dd}/
        log.{filedate:yyyy}.{filedate:MM}.{filedate:dd}.{filedate:HH}.csv"

Data Lake商店中的文件夹:


/myData/myLogs/2016.01.01/2016.01.01.00.csv

/myData/myLogs/2016.01.01/2016.01.01.00.csv

.
.

/myData/myLogs/2016.11.12/2016.11.12.23.csv

如何在其中读取所有这些文件知道开始时间和结束时间每次都会不同.




推荐答案

Bilal

请查看以下文档，因为它提供了一些示例.

Please take a look at the following documentation, as it provides several examples.

Azure Databricks-DataFrames

它在DataFrame中包括加载，查看和运行SQL查询.

It includes Load, View, and Run SQL Queries in the DataFrame.

让我们知道您是否还有其他问题.

Let us know if you have additional questions.

此致

迈克

这篇关于Databricks中U-SQL filedate的替代方法.的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！