可以从Azure数据工厂读取Azure数据表吗? [英] Is possible to read an Azure Databricks table from Azure Data Factory?

问题描述

我在Azure Databricks群集中有一张表，我想将此数据复制到Azure SQL数据库中，以允许其他用户从Metabase分析此数据.

I have a table into an Azure Databricks Cluster, i would like to replicate this data into an Azure SQL Database, to let another users analyze this data from Metabase.

是否可以通过Azure数据工厂访问databricks表?

Is it possible to acess databricks tables through Azure Data factory?

推荐答案

否，不幸的是，没有. Databricks表通常是临时的，并且只要您的作业/会话正在运行就可以使用. 请参见此处.

No, unfortunately not. Databricks tables are typically temporary and last as long as your job/session is running. See here.

您需要将databricks表保存到某些存储中才能访问它.更改您的databricks作业以将表转储到Blob存储，这是它的最终操作.然后，在数据工厂作业的下一步中，您可以从存储帐户中读取转储的数据并进行进一步处理.

You would need to persist your databricks table to some storage in order to access it. Change your databricks job to dump the table to Blob storage as it's final action. In the next step of your data factory job, you can then read the dumped data from the storage account and process further.

另一个选项可能是 databricks delta ，尽管我尚未尝试过...

Another option may be databricks delta although I have not tried this yet...

这篇关于可以从Azure数据工厂读取Azure数据表吗?的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！