使用 python 将数据复制到 Vertica [英] Copying data to Vertica using python
本文介绍了使用 python 将数据复制到 Vertica的处理方法,对大家解决问题具有一定的参考价值,需要的朋友们下面随着小编来一起学习吧!
问题描述
我使用python
和vertica-python
库将数据COPY
到Vertica
DB
I use python
and vertica-python
library to COPY
data to Vertica
DB
connection = vertica_python.connect(**conn_info)
vsql_cur = connection.cursor()
with open("/tmp/vertica-test-insert", "rb") as fs:
vsql_cur.copy( "COPY table FROM STDIN DELIMITER ',' ", fs, buffer_size=65536)
connection.commit()
它插入数据,但只有 5 行,虽然文件包含更多.这可能与数据库设置有关还是某些客户端问题?
It inserts data, but only 5 rows, although the file contains more. Could this be related to db settings or it's some client issue?
推荐答案
这段代码对我有用:
# for json file
with open("D:/SampleCSVFile_2kb/tweets.json", "rb") as fs:
my_file = fs.read().decode('utf-8')
cur.copy( "COPY STG.unstruc_data FROM STDIN parser fjsonparser()", my_file)
connection.commit()
对于 CSV
# for csv file
with open("D:/SampleCSVFile_2kb/SampleCSVFile_2kb.csv", "rb") as fs:
my_file = fs.read().decode('utf-8','ignore')
cur.copy( "COPY STG.unstruc_data FROM STDIN PARSER FDELIMITEDPARSER (delimiter=',', header='false') ", my_file) # buffer_size=65536
connection.commit()
这篇关于使用 python 将数据复制到 Vertica的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持IT屋!
查看全文