将Hive Metastore从HDInsight群集移动到Azure SQL [英] Move Hive metastore from HDInsight cluster to Azure SQL

查看:91
本文介绍了将Hive Metastore从HDInsight群集移动到Azure SQL的处理方法,对大家解决问题具有一定的参考价值,需要的朋友们下面随着小编来一起学习吧!

问题描述

大家好,


我创建了一个新的HDInsight群集(带有Hive),只选择了默认选项。在这种情况下,我忘了选择将Hive Metastore保留在AzureSQL中的选项。


我希望能够销毁并重新创建集群(使用脚本/ Azure自动化)但是我不能在Azure SQL上拥有Hive元数据。


我有没有办法将Hive元数据从它在HDInsight集群上的当前位置备份或移动到Azure SQL?  这样我可以删除群集并使用可用的元数据重建。


谢谢,


标记

解决方案

嗨Mark,


来自Microsoft Azure的问候!


如果您想保留,我们强烈建议您使用自定义Metastore以
删除HDInsight群集之后的Hive表格将来将该Metastore附加到另一个HDInsight群集。


B默认情况下,Hive使用嵌入式Azure SQL数据库来存储此信息。当
删除集群时,嵌入式数据库无法保留元数据。


例如,如果在使用Hive Metastore创建的集群中创建Hive表,则可以看到这些表如果你删除并重新创建
具有相同Hive Metastore的集群。


有关详细信息,请参阅" 使用
a Hive / Oozie metastore
"。


并检查" HDInsight
备份和恢复配置单元
"。


 


问候,


Pradeep


 


Hello Everyone,

I created a new HDInsight cluster (with Hive) and selected just the default options. In this case, I forgot to select the option to keep the Hive metastore in AzureSQL.

I want to be able to destroy and re-create the cluster (using script/Azure Automation) but can't as I don't have the Hive metadata already on Azure SQL.

Is there a way for me to backup or move the Hive metadata from it's current spot on the HDInsight cluster to Azure SQL?  That way I can delete the cluster and rebuild with the metadata being usable.

Thanks,

Mark

解决方案

Hi Mark,

Greetings from Microsoft Azure!

We strongly recommend that you use a custom metastore if you want to keep your Hive tables after you delete your HDInsight cluster for purposes of attaching that metastore to another HDInsight cluster in the future.

By default, Hive uses an embedded Azure SQL database to store this information. The embedded database can't preserve the metadata when the cluster is deleted.

For example, if you create Hive tables in a cluster created with a Hive metastore, you can see those tables if you delete and re-create the cluster with the same Hive metastore.

For more details, see "Use a Hive/Oozie metastore".

And, check "HDInsight backup and restore hive tables".

 

Regards,

Pradeep

 


这篇关于将Hive Metastore从HDInsight群集移动到Azure SQL的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持IT屋!

查看全文
登录 关闭
扫码关注1秒登录
发送“验证码”获取 | 15天全站免登陆