Communicating with other processes

Data must be exchanged with other workers;

• Cooperative -- all parties agree to transfer data.
  Message-passing is an approach that makes the exchange of data cooperative. Data must both be explicitly sent and received.
  An advantage is that any change in the receiver's memory is made with the receiver's participation.

  Figure 1: Cooperative-Communicating with other processes.

  
• One sided -- one worker performs transfer of data.
  One-sided operations between parallel processes include remote memory reads and writes.
  An advantage is that data can be accessed without waiting for another process.

  Figure 2: One sided-Communicating with other processes.