具有 json 架构的 Kafka jdbc 接收器连接器不起作用 [英] Kafka jdbc sink connector with json schema not working

问题描述

使用最新的 kafka 和 confluent jdbc sink 连接器.发送一条非常简单的 Json 消息:

Using the latest kafka and confluent jdbc sink connectors. Sending a really simple Json message:

{
    "schema": {
        "type": "struct",
        "fields": [
            {
                "type": "int",
                "optional": false,
                "field": "id"
            },
            {
                "type": "string",
                "optional": true,
                "field": "msg"
            }
        ],
        "optional": false,
        "name": "msgschema"
    },
    "payload": {
        "id": 222,
        "msg": "hi"
    }
}

但出现错误:

org.apache.kafka.connect.errors.DataException: JsonConverter with schemas.enable requires "schema" and "payload" fields and may not contain additional fields. If you are trying to deserialize plain JSON data, set schemas.enable=false in your converter configuration.

Jsonlint 说 Json 是有效的.我在 kafka 配置中保留了 json schemas.enable=true .有什么指点吗?

Jsonlint says the Json is valid. I have kept json schemas.enable=true in kafka configuration. Any pointers?

推荐答案

您需要告诉 Connect 您的架构是嵌入在您正在使用的 JSON 中.

You need to tell Connect that your schema is embedded in the JSON you're using.

你有:

value.converter=org.apache.kafka.connect.json.JsonConverter 

但也需要:

value.converter.schemas.enable=true

这篇关于具有 json 架构的 Kafka jdbc 接收器连接器不起作用的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！