任何人都可以在 Scala 中分享 Flink Kafka 示例吗? [英] Can anyone share a Flink Kafka example in Scala?

问题描述

谁能分享一个 Scala 中 Flink Kafka 的工作示例(主要是接收来自 Kafka 的消息)?我知道有一个 KafkaWordCount 示例.我只需要在 Flink 中打印出 Kafka 消息.这真的很有帮助.

Can anyone share a working example of Flink Kafka (mainly receiving messages from Kafka) in Scala? I know there is a KafkaWordCount example in Spark. I just need to print out Kafka message in Flink. It would be really helpful.

推荐答案

以下代码展示了如何使用 Flink 的 Scala DataStream API 从 Kafka 主题中读取数据:

The following code shows how to read from a Kafka topic using Flink's Scala DataStream API:

import org.apache.flink.streaming.api.scala._
import org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer082
import org.apache.flink.streaming.util.serialization.SimpleStringSchema


object Main {
  def main(args: Array[String]) {
    val env = StreamExecutionEnvironment.getExecutionEnvironment
    val properties = new Properties()
    properties.setProperty("bootstrap.servers", "localhost:9092")
    properties.setProperty("zookeeper.connect", "localhost:2181")
    properties.setProperty("group.id", "test")
    val stream = env
      .addSource(new FlinkKafkaConsumer082[String]("topic", new SimpleStringSchema(), properties))
      .print

    env.execute("Flink Kafka Example")
  }
}

这篇关于任何人都可以在 Scala 中分享 Flink Kafka 示例吗?的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！