TBLPROPERTIES('skip.header.line.count'='1')无法在SparkThrift上使用蜂巢jdbc 1.2.1从beeline连接 [英] TBLPROPERTIES('skip.header.line.count'='1') is not working on sparkThrift connected from beeline with hive jdbc 1.2.1
本文介绍了TBLPROPERTIES('skip.header.line.count'='1')无法在SparkThrift上使用蜂巢jdbc 1.2.1从beeline连接的处理方法,对大家解决问题具有一定的参考价值,需要的朋友们下面随着小编来一起学习吧!
问题描述
我正在使用spark 2.3,并将sparkThrift与beeline连接起来.
I am using spark 2.3 and connecting sparkThrift with beeline.
Hive jdbc版本1.2.1 Spark SQL版本2.3.1
Hive jdbc version 1.2.1 Spark SQL version 2.3.1
我正在尝试创建具有skip header属性的外部表,但是select命令总是返回标题为第一行的数据,以下是我的create查询
I am trying to create external table with skip header property but select command is always returning data with header as first row, below is my create query
CREATE EXTERNAL TABLE datasourcename11(
`retail_invoice_detail_sys_invoice_no` STRING,
`store_id` STRING,
`retail_invoice_detail_invoice_time` STRING,
`retail_invoice_detail_invoice_date` string,
`cust_id` STRING,
`article_code` INTEGER,
`retail_invoice_detail_base_price` INTEGER,
`retail_invoice_detail_sale_price` INTEGER,
`retail_invoice_detail_quantity` DOUBLE,
`retail_invoice_detail_total_amount` DOUBLE
)
ROW FORMAT DELIMITED FIELDS TERMINATED BY ','
LINES TERMINATED BY '\n'
LOCATION '/home/java_services/backend/demo/'
TBLPROPERTIES('skip.header.line.count'=1);
推荐答案
仅Hive支持此属性skip.header.line.count=1
.
This property skip.header.line.count=1
is supported in Hive only.
解决方法是使用过滤器
retail_invoice_detail_sys_invoice_no!=<col name in header>
这篇关于TBLPROPERTIES('skip.header.line.count'='1')无法在SparkThrift上使用蜂巢jdbc 1.2.1从beeline连接的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持IT屋!
查看全文