List of Figures

1. Recommended Text Books.
2. Abstraction Layers
3. View of the Field
4. SISD Architecture.
5. SIMD Architecture.
6. MIMD Architecture.
7. (a) MIMD Shared Memory, (b) MIMD Distributed Memory.
8. (a) SIMD Distributed Computers, (b) Clusters.
9. Two SIMD Schemes.
10. Two MIMD Categories; Shared Memory and Message Passing MIMD Architectures.
11. Cooperative–Communicating with other processes.
12. One sided–Communicating with other processes.
13. Example program segments.
14. MPI messages.
15. Data+Envelope.
16. MPI basic datatypes for C.
17. Handshake for a blocking non-buffered send/receive operation.
18. Blocking buffered transfer protocols: Left: in the presence of communication hardware with buffers at send and receive ends; and Right: in the absence of communication hardware, sender interrupts receiver and deposits data in buffer at receiver end.
19. Non-blocking non-buffered send and receive operations Left: in absence of communication hardware; Right: in presence of communication hardware.
20. Midpoint Rule.
21. Sequential Code Output.
22. Parallel Code Output.
23. Diagram for Broadcast.
24. Diagram for Reduce.
25. Diagram for Gather.
26. Diagram for All_Gather.
27. Diagram for Scatter.
28. Diagram for Alltoall.
29. Threads model.
30. Thread shared memory model.
31. Threads Unsafe! Pointers having the same value point to the same data.
32. Creating four threads for "printf" function.
33. A sample OpenMP program along with its Pthreads translation that might be performed by an OpenMP compiler.
34. Fork-Join Model.