It is possible for TaskManager to register with JobManager's Resource Manager while using Apache Flink with Docker Swarm. In fact, this is a common use case for deploying Apache Flink on Docker Swarm. To achieve this, you need to use Docker Swarm's overlay network mode to allow communication between the containers running TaskManager and JobManager. You also need to configure the Flink resource manager explicitly to use Docker Swarm mode. This can be done by setting the Flink configuration parameters:
resourcemanager.slot.request.timeout: <timeout-value>
containerized.heap-cutoff-ratio: <ratio-value>
containerized.heap-cutoff-min: <min-value>
containerized.heap-cutoff-max: <max-value>
These parameters specify the timeout value for slot requests, the heap cutoff ratio, and the minimum and maximum heap cutoff values. With these configurations in place, TaskManagers can successfully register with the Resource Manager of the JobManager, and tasks can be executed on the Docker Swarm cluster.
Please start posting anonymously - your entry will be published after you log in or create a new account. This space is reserved only for answers. If you would like to engage in a discussion, please instead post a comment under the question or an answer that you would like to discuss
Asked: 2021-08-08 11:00:00 +0000
Seen: 15 times
Last updated: Dec 03 '22
How can one ensure that sub-classes have uniform method parameters in TypeScript?
How can the calculation of matrix determinant be performed using CUDA?
How can code repetition be prevented when using (box)plot functions?
When I attempt to generate a database, why does the azure-cosmos-emulator become unresponsive?
What steps can I take to prevent my webpage from slowing down when all parts of a div are displayed?