Parallel and Distributed Computers

• The processing units can communicate and interact with each other using either
  • shared memory
  • or message passing methods.
• The interconnection network for shared memory systems can be classified as
  • bus-based
  • switch-based.

• SIMD Computers
• MIMD Shared Memory, MIMD Distributed Memory
• Bus based, Switch based
• CC-NUMA
• Clusters, Grid Computing
  • Grids are geographically distributed platforms for computation.
  • They provide dependable, consistent, general, and inexpensive access to high end computational capabilities.

Figure 2.6: (a) MIMD Shared Memory, (b) MIMD Distributed Memory.

Figure 2.7: (a) SIMD Distributed Computers, (b) Clusters.