Distributed Memory

In computer science, distributed memory refers to a multiple-processor computer system in which each processor has its own private memory. Computational tasks can only operate on local data, and if remote data is required, the computational task must communicate with one or more remote processors. In contrast, a shared memory multi processor offers a single memory space used by all processors. Processors do not have to be aware where data resides, except that there may be performance penalties, and that race conditions are to be avoided.

Read more about Distributed Memory:  Architecture, Programming Distributed Memory Machines, Distributed Shared Memory, Shared Memory Versus Distributed Memory Versus Distributed Shared Memory

Other articles related to "memory, distributed memory, distributed":

Parallel Computing - Software - Parallel Programming Languages
... can generally be divided into classes based on the assumptions they make about the underlying memory architecture—shared memory, distributed memory, or shared ... Shared memory programming languages communicate by manipulating shared memory variables ... Distributed memory uses message passing ...
Shared Memory Versus Distributed Memory Versus Distributed Shared Memory
... The advantage of (distributed) shared memory is that it offers a unified address space in which all data can be found ... The advantage of distributed memory is that it excludes race conditions, and that it forces the programmer to think about data distribution ... The advantage of distributed (shared) memory is that it is easier to design a machine that scales with the algorithm Distributed shared memory hides the mechanism of ...
Message Passing Interface - Overview
... for communication among processes that model a parallel program running on a distributed memory system ... Actual distributed memory supercomputers such as computer clusters often run such programs ... The principal MPI-1 model has no shared memory concept, and MPI-2 has only a limited distributed shared memory concept ...
SPMD - Distributed Memory
... refers to message passing programming on distributed memory computer architectures ... A distributed memory computer consists of a collection of independent computers, called nodes ... Distributed memory is the programming style used on parallel supercomputers from homegrown Beowulf clusters to the largest clusters on the Teragrid ...

Famous quotes containing the words memory and/or distributed:

    The advantage of having a bad memory is that you can enjoy the same good things for the first time several times.
    Friedrich Nietzsche (1844–1900)

    Taking food alone tends to make one hard and coarse. Those accustomed to it must lead a Spartan life if they are not to go downhill. Hermits have observed, if for only this reason, a frugal diet. For it is only in company that eating is done justice; food must be divided and distributed if it is to be well received.
    Walter Benjamin (1892–1940)