Parallel Programs

There are three main classes,

• Data Parallelism: Such as HPF. Spread the data over a set of processors and execute same the program on each processor, this means that each processor operates on its own subset of the overall data.
• Task Parallelism: Two or more cooperating processes. Different tasks will be written to solve different parts of the problem. These tasks will pass data between themselves in pursuit of the solution.
• Master-Slave: One master process controls one or more slaves, it is responsible for the distribution of the data, general coordination of the solution methodology and collecting the results at the end.