Kafka在Kubernetes上落后于Traefik [英] Kafka behind Traefik on Kubernetes

问题描述

我试图在Traefik后面配置一个Kafka集群，但是我的生产者和客户端(在kubernetes之外)不连接到引导服务器.他们一直在说:

I am trying to configure a Kafka cluster behind Traefik but my producers and client (that are outside kubernetes) don't connect to the bootstrap-servers. They keep saying:

给定网址中没有可解析的boostrap服务器"

"no resolvable boostrap servers in the given url"

实际上这是Traefik入口:

Actually here is the Traefik ingress:

{
    "apiVersion": "extensions/v1beta1",
    "kind": "Ingress",
    "metadata": {
        "name": "nppl-ingress",
        "annotations": {
            "kubernetes.io/ingress.class": "traefik",
            "traefik.frontend.rule.type": "PathPrefixStrip"
        }
    },
    "spec": {
        "rules": [
            {
                "host": "" ,
                "http": {
                    "paths": [
                        {
                            "path": "/zuul-gateway",
                            "backend": {
                                "serviceName": "zuul-gateway",
                                "servicePort": "zuul-port"
                            }
                        },                      
                        {
                            "path": "/kafka",
                            "backend": {
                                "serviceName": "kafka-broker",
                                "servicePort": "kafka-port"
                            }

[..]
    }

我给kafka消费者/生产者提供的是Traefik的公共IP. 流程如下:[Kafka生产者/消费者]-> Traefik(公开为负载均衡器)-> [Kafka集群]

What I give to the kafka consumers/producers is the public IP of Traefik. Here is the flow: [Kafka producers/consumers] -> Traefik(exposed as Load Balancer) -> [Kafka-Cluster]

有什么解决办法吗?否则，我正在考虑添加kafka-rest代理( https://Traefik和kafka经纪人之间的docs.confluent.io/current/kafka-rest/docs/index.html )，但我认为这不是理想的解决方案.

Is there any solution? Otherwise I was thinking to add a kafka-rest proxy (https://docs.confluent.io/current/kafka-rest/docs/index.html) between Traefik and the kafka brokers but I think isn't the ideal solution.

推荐答案

我做到了.您可以在kubernetes中引用它，部署kafka.yaml

I did. You can refer to it, in kubernetes ,deployment kafka.yaml

   env:
    - name: KAFKA_BROKER_ID
      value: "1"
    - name: KAFKA_CREATE_TOPICS
      value: "test:1:1"
    - name: KAFKA_ZOOKEEPER_CONNECT
      value: "zookeeper:2181"
    - name: KAFKA_ADVERTISED_LISTENERS
      value: "INSIDE://:9092,OUTSIDE://kafka-com:30322"
    - name: KAFKA_LISTENERS
      value: "INSIDE://:9092,OUTSIDE://:30322"
    - name: KAFKA_LISTENER_SECURITY_PROTOCOL_MAP
      value: "INSIDE:PLAINTEXT,OUTSIDE:PLAINTEXT"
    - name: KAFKA_INTER_BROKER_LISTENER_NAME
      value: "INSIDE" 

kafka服务，外部服务调用地址或traefik代理地址

kafka service,the external service invocation address, or traefik proxy address

---
kind: Service
apiVersion: v1
metadata:
  name: kafka-com
  namespace: dev
  labels:
    k8s-app: kafka
spec:
  selector:
    k8s-app: kafka
  ports:
  - port: 9092
    name: innerport
    targetPort: 9092
    protocol: TCP
  - port: 30322
    name: outport 
    targetPort: 30322
    protocol: TCP
    nodePort: 30322
  type: NodePort

确保Kafka外部端口和nodePort端口一致，其他服务调用kafka-com:30322，我的博客写此

Ensure that Kafka external port and nodePort port are consistent,Other services call kafka-com:30322, my blog write this config_kafka_in_kubernetes, hope to help U !

这篇关于Kafka在Kubernetes上落后于Traefik的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！