Template:Parallel computing

v • d • e Parallel computing topics

General	High-performance computing

Parallelism	Bit-level parallelism · Instruction level parallelism · Data parallelism · Task parallelism

Theory	Speedup · Amdahl's law · Flynn's taxonomy (SISD • SIMD • MISD • MIMD) · Cost efficiency · Gustafson's law · Karp-Flatt metric · Parallel slowdown

Elements	Process · Thread · Fiber · Parallel Random Access Machine

Coordination	Multiprocessing · Multithreading · Multitasking · Memory coherency · Cache coherency · Barrier · Synchronization · Distributed computing · Grid computing

Programming	Programming model · Implicit parallelism · Explicit parallelism

Hardware	Computer cluster · Beowulf · Symmetric multiprocessing · Non-Uniform Memory Access · Cache only memory architecture · Asymmetric multiprocessing · Simultaneous multithreading · Shared memory · Distributed memory · Massively parallel processing · Superscalar processing · Vector processing · Supercomputer · Stream processing · GPGPU

Software	Distributed shared memory · Application checkpointing · Warewulf

APIs	POSIX Threads · OpenMP · Message Passing Interface (MPI) · Intel Threading Building Blocks

Problems	Embarrassingly parallel · Grand Challenge · Software lockout