bq加载中的错误“无法将值转换为字符串" [英] Error in bq load "Could not convert value to string"

问题描述

我尝试通过bq命令将日志从Google云端存储加载到BigQuery并且出现了错误无法将值转换为字符串".

I tried to load logs from Google Cloud Storage to BigQuery by the bq command and I've got this error "Could not convert value to string".

我的示例数据

{"ids":"1234,5678"}
{"ids":1234}

我的示例架构

[
    { "name":"ids", "type":"string" }
]

似乎ID无法通过单引号的无引号进行转换.数据是用fluent-plugin-s3制作的，但是多个用逗号连接的ID可以用引号引起来，而不是单个ID.

It seems IDs can't convert by none quote at single ID. Data is made with fluent-plugin-s3, but more than one ID connected by a comma can be bound up with a quotation and isn't made single id.

如何将这些数据加载到BigQuery?

How can I load these data to BigQuery?

预先感谢

推荐答案

好好检查一下可以帮助您的流利的插件

Well check different fluentd plugins that can help you, maybe

• https://github.com/lob/fluent-plugin-json-transform
• https://github.com/tarom/fluent-plugin-typecast

这篇关于bq加载中的错误“无法将值转换为字符串"的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！