从数据湖导出CSV格式转换为Cosmos DB [英] Export from data lake .i.e. CSV to Cosmos DB in required format

问题描述

您好全部

我需要在数据湖中有.csv文件的地方.

我需要

1)将数据移动到Cosmos DB(如何将其转换为json).需要一些演示示例.

2)根据客户端的要求，将csv数据更改为cosmos db collection的格式. .IE.在Cosmos DB中自定义数据结构

任何帮助或演示示例都很好.

---

致谢，PS

解决方案

Pritam_Shetty，

能否请您详细说明源数据存储区，为什么当数据到达ADLS时不使用源格式作为` 使用Azure数据工厂将数据复制到Azure Cosmos DB(SQL API)或从中复制数据

请提供其他详细信息，以便提供更简洁的答案.

此致

麦克

Hi  All,

I have a requirement where there is .csv file in data lake. 

I need to

1) Move the data to Cosmos DB (how does it convert to json). Need some Demo Examples if any.

2) Change the csv data into a format of cosmos db collection as requested by client. .i.e. customize the data structure in Cosmos DB

Any help or demo example would be great.

---

Regards, PS

解决方案

Hi Pritam_Shetty,

Can you please detail your source data store, and why not use source format as `JsonFormat` when the data arrives to ADLS? Also, which version of the Cosmos DB API are you using with your solution? Is it possible to use Azure Data Factory without the need for ADLS? If you can export the file from the data source as Json, and keep things native to Cosmos DB, you should be able to use ADF as the only service with no (or verry little) ETL required. 

Please see the following: Copy data to or from Azure Cosmos DB (SQL API) by using Azure Data Factory

Please provide additional details so a more concise answer canbe provided.

Regards,

Mike

这篇关于从数据湖导出CSV格式转换为Cosmos DB的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！