It is possible for TaskManager to register with JobManager's Resource Manager while using Apache Flink with Docker Swarm. In fact, this is a common use case for deploying Apache Flink on Docker Swarm. To achieve this, you need to use Docker Swarm's overlay network mode to allow communication between the containers running TaskManager and JobManager. You also need to configure the Flink resource manager explicitly to use Docker Swarm mode. This can be done by setting the Flink configuration parameters:
resourcemanager.slot.request.timeout: <timeout-value>
containerized.heap-cutoff-ratio: <ratio-value>
containerized.heap-cutoff-min: <min-value>
containerized.heap-cutoff-max: <max-value>
These parameters specify the timeout value for slot requests, the heap cutoff ratio, and the minimum and maximum heap cutoff values. With these configurations in place, TaskManagers can successfully register with the Resource Manager of the JobManager, and tasks can be executed on the Docker Swarm cluster.
Asked: 2021-08-08 11:00:00 +0000
Seen: 17 times
Last updated: Dec 03 '22