如何将文件写入Kafka Producer [英] How to write a file to Kafka Producer

问题描述

我正在尝试在 Kafka 中加载一个简单的文本文件而不是标准输入.下载Kafka后，我执行了以下步骤:

I am trying to load a simple text file instead of standard input in Kafka. After downloading Kafka, I performed the following steps:

启动zookeeper:

Started zookeeper:

bin/zookeeper-server-start.sh config/zookeeper.properties

启动服务器

bin/kafka-server-start.sh config/server.properties

创建了一个名为test"的主题:

Created a topic named "test":

bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic test

运行制片人:

bin/kafka-console-producer.sh --broker-list localhost:9092 --topic test 
Test1
Test2

被消费者倾听:

bin/kafka-console-consumer.sh --zookeeper localhost:2181 --topic test --from-beginning
Test1
Test2

我想将一个数据文件甚至一个简单的文本文件传递给消费者可以直接看到的生产者，而不是标准输入.任何帮助将不胜感激.谢谢！

Instead of Standard input, I want to pass a data file or even a simple text file to the Producer which can be seen directly by the Consumer. Any help would really be appreciated. Thanks!

推荐答案

您可以通过管道输入:

kafka-console-producer.sh --broker-list localhost:9092 --topic my_topic
--new-producer < my_file.txt

在此处找到.

从 0.9.0 开始:

From 0.9.0:

kafka-console-producer.sh --broker-list localhost:9092 --topic my_topic < my_file.txt

这篇关于如何将文件写入Kafka Producer的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！