使用kubernetes安装Kafka和Zookeeper集群 [英] Installing kafka and zookeeper cluster using kubernetes

问题描述

谁能与我共享用于创建具有两个kafka代理和三个服务器的zookeeper集群的kafka集群的yaml文件.我是kubernetes的新手.

Can anyone share me the yaml file for creating kafka cluster with two kafka broker and zookeeper cluster with 3 servers.I'm new to kubernetes.

推荐答案

我建议您尝试 Strimzi Kafka运算符.使用它，您可以像其他Kubernetes对象一样定义Kafka集群-编写yaml文件.而且，用户，主题和Kafka Connect集群也只是一个k8s对象. Strimzi Kafka Operator的某些(并非全部！)功能:

I recommend you to try Strimzi Kafka Operator. Using it you can define a Kafka cluster just like other Kubernetes object - writing a yaml file. Moreover, also users, topics and Kafka Connect cluster are just a k8s objects. Some (by not all!) features of Strimzi Kafka Operator:

• 使用TLS保护经纪人之间以及经纪人和动物园管理员之间的安全通信
• 将集群暴露在k8s集群之外的能力
• 可部署为头盔图(简化很多事情)
• 更改集群配置时滚动更新
• 平滑扩展
• 准备使用 Prometheus 和格拉法纳(Grafana).

• Secure communication between brokers and between brokers and zookeeper with TLS
• Ability to expose the cluster outside k8s cluster
• Deployable as a helm chart (it simplifies things a lot)
• Rolling updates when changing cluster configuration
• Smooth scaling out
• Ready to monitor the cluster using Prometheus and Grafana.

值得一提的是出色的文档.

创建Kafka集群就像应用这样的Kubernetes清单一样简单:

Creating a Kafka cluster is as simple as applying a Kubernetes manifest like this:

apiVersion: kafka.strimzi.io/v1beta1
kind: Kafka
metadata:
  name: my-cluster
spec:
  kafka:
    version: 2.2.0
    replicas: 3
    listeners:
      plain: {}
      tls: {}
    config:
      offsets.topic.replication.factor: 3
      transaction.state.log.replication.factor: 3
      transaction.state.log.min.isr: 2
      log.message.format.version: "2.2"
    storage:
      type: jbod
      volumes:
      - id: 0
        type: persistent-claim
        size: 100Gi
        deleteClaim: false
  zookeeper:
    replicas: 3
    storage:
      type: persistent-claim
      size: 100Gi
      deleteClaim: false
  entityOperator:
    topicOperator: {}
    userOperator: {}

这篇关于使用kubernetes安装Kafka和Zookeeper集群的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！