Flink 1.7.0仪表板不显示任务统计信息 [英] Flink 1.7.0 Dashboard not show Task Statistics

问题描述

我使用Flink 1.7仪表板并选择一个流作业.这应该向我显示一些指标，但仍然需要加载.

I use Flink 1.7 dashboard and select a streaming job. This should show me some metrics, but it remains to load.

我在Flink 1.5集群中部署了相同的作业，并且可以观察指标. Flink在docker swarm中运行，但是如果我在docker-compose(不在swarm中)中运行Flink 1.7，则它可以正常工作

I deployed the same job in a Flink 1.5 cluster, and I can watch the metrics. Flink is running in docker swarm, but if I run Flink 1.7 in docker-compose (not in the swarm), it works

我可以做到，删除docker-compose.yaml文件中的主机名

I can do it work, deleting the hostname in docker-compose.yaml file

version: "3"
services:
  jobmanager17:
    image: flink:1.7.0-hadoop27-scala_2.11
    hostname: "{{.Node.Hostname}}"
    ports:
      - "8081:8081"
      - "9254:9249"
    command: jobmanager
....

我删除主机名:

version: "3"
services:
  jobmanager17:
    image: flink:1.7.0-hadoop27-scala_2.11
    ports:
      - "8081:8081"
      - "9254:9249"
    command: jobmanager
....

现在指标可以使用，但是没有主机名...

and now the metrics works, but without the hostname...

有可能两者兼有吗?

PD:我读到一些有关分离模式"的信息...但是我不使用它

PD: I read something about 'detached mode'... but I don't use it

推荐答案

我猜您是在Kubernetes或docker swarm上运行集群.在Kubernetes上使用Flink 1.7，您需要确保任务管理器是 用他们的IP地址而不是 主机名.如果查看工作经理日志，则会发现很多警告，提示无法访问任务经理.

I guess you are running your cluster on Kubernetes or docker swarm. With Flink 1.7 on Kubernetes you need to make sure the task managers are registering to the job manager with their IP addresses and not the hostnames. If you look at the jobmanagers log you'll find a lot of warnings that the Taskmanager can't be reached.

您可以通过传递定义taskmanager.host参数来实现.一个示例性的depoyment可能看起来像这样:

You can do that by passing defining the taskmanager.host parameter. An example depoyment might look like this:

apiVersion: extensions/v1beta1
kind: Deployment
....
spec:
  template:
    spec:
      containers:
      - name: "<%= name %>"
        args: ["taskmanager", "-Dtaskmanager.host=$(K8S_POD_IP)"]
        env:
          - name: K8S_POD_IP
          valueFrom:
            fieldRef:
              fieldPath: status.podIP

如果您未在K8上运行，则可以尝试手动传递此参数(通过提供IP地址，该地址可从作业管理器获取为taskmanager.host)

If you are not running on K8 it might be worth a try to pass this parameter manually (by providing an IP adress which is reachable from the jobmanager as the taskmanager.host)

希望有帮助.

更新:Flink 1.8解决了该问题.默认情况下，属性taskmanager.network.bind-policy设置为"ip"，其作用与上述解决方法大致相同(

Update: Flink 1.8 solves the problem. The property taskmanager.network.bind-policy is by default set to "ip" which does more or less the same what the above described workaround does (https://ci.apache.org/projects/flink/flink-docs-stable/ops/config.html#taskmanager)

这篇关于Flink 1.7.0仪表板不显示任务统计信息的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！