Kafka生产者读取数据文件 [英] Kafka producer to read data files
问题描述
我试图在循环中加载数据文件(以检查统计数据)而不是 Kafka 中的标准输入.下载Kafka后,我执行了以下步骤:
I am trying to load a data file in loop(to check stats) instead of standard input in Kafka. After downloading Kafka, I performed the following steps:
启动zookeeper:
Started zookeeper:
bin/zookeeper-server-start.sh config/zookeeper.properties
启动服务器:
bin/kafka-server-start.sh config/server.properties
创建了一个名为test"的主题:
Created a topic named "test":
bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic test
运行制片人:
bin/kafka-console-producer.sh --broker-list localhost:9092 --topic test
Test1
Test2
被消费者倾听:
bin/kafka-console-consumer.sh --zookeeper localhost:2181 --topic test --from-beginning
Test1
Test2
我想将数据文件传递给生产者,消费者可以直接看到它,而不是标准输入.或者是否有任何 kafka 生产者而不是控制台消费者使用它我可以读取数据文件.任何帮助将不胜感激.谢谢!
Instead of Standard input, I want to pass a data file to the Producer which can be seen directly by the Consumer. Or is there any kafka producer instead of console consumer using which I can read data files. Any help would really be appreciated. Thanks!
推荐答案
您可以通过 cat 读取数据文件并将其通过管道传输到 kafka-console-producer.sh.
You can read data file via cat and pipeline it to kafka-console-producer.sh.
cat ${datafile} | ${kafka_home}/bin/kafka-console-producer.sh --broker-list ${brokerlist} --topic test
这篇关于Kafka生产者读取数据文件的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持IT屋!