使用Apache Nifi将数据从vertica传输到Redshift [英] Transfer data from vertica to Redshift using Apache Nifi

问题描述

我想使用apache nifi将数据从vertica传输到redshift. 我需要设置哪些处理器和配置?

I want to transfer data from vertica to redshift using apache nifi. which are the processors and configuration I need to set?

推荐答案

如果Vertica和Redshift具有行为良好"的JDBC驱动程序，则可以设置

If Vertica and Redshift have "well-behaved" JDBC drivers, you can set up a DBCPConnectionPool for each, then a SQL processor such as ExecuteSQL, QueryDatabaseTable, or GenerateTableFetch (the latter of which generates SQL for use in ExecuteSQL). These will get your records into Avro format, then (prior to NiFi 1.2.0) you can use ConvertAvroToJSON -> ConvertJSONToSQL -> PutSQL to get your records inserted into Redshift.

在NiFi 1.2.0中，您可以设置AvroReader以便在PutDatabaseRecord中使用.然后，您只需要SQL处理器将记录从Vertica中取出，直接记录到PutDatabaseRecord中，以将它们放入Redshift中即可.

In NiFi 1.2.0, you can use set up an AvroReader for use in PutDatabaseRecord. Then you will only need the SQL processor to get the records out of Vertica, directly to PutDatabaseRecord to put them into Redshift.

这篇关于使用Apache Nifi将数据从vertica传输到Redshift的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！