Docker 部署 flink1.19.2

官方文档

Docker

注意事项

平台错误

WARNING: The requested image's platform (linux/arm64/v8) does not match the detected host platform (linux/amd64/v3) and no specific platform was requested

平台不一致，所以报错

内存分配器问题

By default, Flink image adopts jemalloc as default memory allocator. This behavior can be disabled by setting the 'DISABLE_JEMALLOC' environment variable to 'true'.

部署脚本

networks:
  flink-network:
services:
  jobmanager:
    image: flink:1.19.2-scala_2.12-java8
    ports:
      - "18081:8081"
    command: jobmanager
    networks:
      - flink-network
    environment:
      - |
        FLINK_PROPERTIES=
        jobmanager.rpc.address: jobmanager
    #volumes:
     # - ./JobManager/conf/:/opt/flink/conf/

  taskmanager:
    image: flink:1.19.2-scala_2.12-java8
    depends_on:
      - jobmanager
    command: taskmanager
    scale: 1
    networks:
      - flink-network
    environment:
      - |
        FLINK_PROPERTIES=
        jobmanager.rpc.address: jobmanager
        taskmanager.numberOfTaskSlots: 5
    #volumes:
    #  - ./TaskManager/conf/:/opt/flink/conf/

ps: 目录挂载存在文件格式报错，待解决。

示例项目

学习文档

Overview

Maven 命令

$ mvn archetype:generate                \
  -DarchetypeGroupId=org.apache.flink   \
  -DarchetypeArtifactId=flink-quickstart-java \
  -DarchetypeVersion=1.19.2

打包并添加任务

批处理执行完成