Ask Your Question

How can the expensive data transfer costs be reduced in parallel computing with Matlab?

asked 2023-01-02 11:00:00 +0000

djk gravatar image

edit retag flag offensive close merge delete

1 Answer

Sort by ยป oldest newest most voted

answered 2021-06-29 10:00:00 +0000

ladyg gravatar image

There are several ways to reduce expensive data transfer costs in parallel computing with Matlab:

  1. Use distributed arrays instead of regular arrays: Distributed arrays partition data across multiple workers, reducing the amount of data that needs to be transferred between workers.

  2. Use parallel file I/O operations: Parallel file I/O operations can distribute file read and write operations across multiple workers, reducing the amount of data transfer.

  3. Use efficient communication algorithms: Efficient communication algorithms such as Message Passing Interface (MPI) can reduce the amount of data transfer by optimizing communication between workers.

  4. Reduce data size: Minimizing the amount of data that needs to be transferred can be achieved by reducing the size of the data or by selectively transferring only necessary portions of the data.

  5. Use appropriate hardware: Using high-speed networking hardware, such as InfiniBand, can significantly reduce data transfer costs. Additionally, selecting processors with larger caches and memory can reduce the need for data transfer.

edit flag offensive delete link more

Your Answer

Please start posting anonymously - your entry will be published after you log in or create a new account. This space is reserved only for answers. If you would like to engage in a discussion, please instead post a comment under the question or an answer that you would like to discuss

Add Answer

Question Tools


Asked: 2023-01-02 11:00:00 +0000

Seen: 10 times

Last updated: Jun 29 '21