是否可以从adf连接到databricks deltalake表 [英] Is it possible to connect to databricks deltalake tables from adf

问题描述

我正在寻找一种能够从ADF和其他Azure服务(例如数据目录)连接到Databricks deltalake表的方法.我没有在ADF数据源中看到databricks数据存储.

I'm looking for a way to be able to connect to Databricks deltalake tables from ADF and other Azure Services(like Data Catalog). I don't see databricks data store listed in ADF data sources.

关于类似问题-可以从Azure数据工厂读取Azure Databricks表吗?

@simon_dmorias似乎建议使用ODBC连接来连接到数据砖表.

@simon_dmorias seems to have suggested using ODBC connection to connect to databricks tables.

我试图建立ODBC连接，但是需要设置IR.创建IR时，我看到2个选项.自托管和链接自托管.我尝试创建自托管IR，但它需要在本地桌面上安装，并且可能更适合于内部odbc连接.我无法在链接的服务上使用IR.

I tried to set up the ODBC connection but it requires IR to be setup. There are 2 options I see when creating the IR. Self-hosted and linked Self-hosted. I tried to create the Self-hosted IR but it requires installation on my local desktop and probably is more meant for an on-premise odbc connection. I couldn't use the IR on my linked Services.

我已经能够将powerbi与databricks deltalake表连接起来，并计划在此处使用相同的凭据.这是参考链接-

I have been able to connect powerbi with databricks deltalake tables and plan to use the same creds here. Here is the reference link -

https://docs.azuredatabricks.net/user-guide/bi/power-bi.html

任何指导都会有所帮助

推荐答案

您可以，但是它很复杂.您需要将Azure Data Factory中的ODBC连接器与自托管运行时一起使用.

You can but it is quite complex. You need to use the ODBC connector in Azure Data Factory with a self hosted runtime.

ADF可以使用ODBC( https://docs .microsoft.com/en-us/azure/data-factory/connector-odbc ).它确实需要自托管的IR.假设您安装了正确的驱动程序，则可以配置与Databricks群集的ODBC连接.

ADF can connect using ODBC (https://docs.microsoft.com/en-us/azure/data-factory/connector-odbc). It does require a self hosted IR. Assuming you have the right drivers installed you can configure the ODBC connection to a Databricks cluster.

可以在Databricks工作区的群集设置屏幕中找到ODBC设置的连接详细信息(

The connections details for the ODBC settings can be found in cluster settings screen in the Databricks workspace (https://docs.microsoft.com/en-us/azure/azure-databricks/connect-databricks-excel-python-r).

此过程与您为PowerBI发布的过程非常相似.

The process is very similar to what you posted for PowerBI.

这篇关于是否可以从adf连接到databricks deltalake表的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！