Collective Operations (Time - usec) - as function of no.of CPUs
Communications among groups of processors in the cluster e.g.
- Distribute data to all nodes in the cluster (scatter, all-to-all)
- Collect data from all nodes (gather)
• Collect information from all nodes to determine an overall condition e.g. minima or maxima (reduce).