Chapter 7: Multiprocessors and Clusters
-
Problems with parallelization
-
Partitioning
-
Coordination
-
Communications overhead
-
Performance with parallelization (Amdahl's law)
-
Multiple processor memory organization
-
Shared memory
-
Uniform memory access (UMA)
-
Nonuniform memory access NUMA)
-
Message passing
-
Classification based on number of instruction and data streams