Kafka Connect实施错误 [英] Kafka Connect implementation errors

查看:44
本文介绍了Kafka Connect实施错误的处理方法,对大家解决问题具有一定的参考价值,需要的朋友们下面随着小编来一起学习吧!

问题描述

我在这里浏览了该教程: http://kafka.apache.org/documentation.html#introduction

I was running through the tutorial here: http://kafka.apache.org/documentation.html#introduction

当我进入第7步:使用Kafka Connect导入/导出数据"并尝试启动两个连接器时,出现以下错误:

When I get to "Step 7: Use Kafka Connect to import/export data" and attempt to start two connectors I am getting the following errors:

ERROR Failed to flush WorkerSourceTask{id=local-file-source-0}, timed out while waiting for producer to flush outstanding messages, 1 left

ERROR Failed to commit offsets for WorkerSourceTask

这是本教程的一部分:

接下来,我们将启动两个以独立模式运行的连接器,这意味着它们将在单个本地专用进程中运行.我们提供了三个配置文件作为参数.第一个始终是Kafka Connect流程的配置,其中包含通用配置,例如要连接的Kafka代理和数据的序列化格式.其余配置文件均指定要创建的连接器.这些文件包括唯一的连接器名称,要实例化的连接器类,以及连接器所需的任何其他配置. bin/connect-standalone.sh config/connect-standalone.properties config/connect-file-source.properties config/connect-file-sink.properties

我花了一些时间寻找解决方案,但是找不到有用的东西.任何帮助表示赞赏.

I have spent some time looking for a solution, but was unable to find anything useful. Any help is appreciated.

谢谢!

推荐答案

我收到此错误的原因是因为我使用config/server.properties创建的第一台服务器未运行.我假设是因为它是该主题的开头,所以无法刷新消息,也无法提交偏移量.

The reason I was getting this error was because the first server I created using the config/server.properties was not running. I am assuming that because it is the lead of the topic, the messages could not be flushed and the offsets could not be committed.

使用服务器属性(config/server.properties)启动kafka服务器后,此问题已解决.

Once I started the kafka server using the server propertes (config/server.properties) This issue was resolved.

这篇关于Kafka Connect实施错误的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持IT屋!

查看全文
登录 关闭
扫码关注1秒登录
发送“验证码”获取 | 15天全站免登陆