Parallel and Distributed Computing
Last update: 06 Jul 2025 16:08First version: Before 13 March 1995
Yet Another Inadequate Placeholder, last seriously updated in the early 2000s Cellular automata are parallel, interacting finite state machines; some of them are Turing-equivalent, that is, can compute any computable function.
Complexity classes --- in space (memory), time, other resources?
What would analog parallel computing look like? (A partial differential equation, presumably.)
Uses: data mining, simulations.
- See also:
- Cellular Automata
- Computation, Automata, Languages
- Computer Networks
- Multi-Agent Systems
- Neural Coding
- Neural Nets, Connectionism
- Synchronization
- Topology and Synchronization
- Recommended:
- David Gelernter, Mirror Worlds
- Metropolis and Rota (eds.), A New Era in Computation
- Mitchel Resnick, Turtles, Termites, and Traffic Jams: Explorations in Massively Parallel Microworlds [Review: Turtles Up the *]
- Nancy A. Lynch, Distributed Algorithms [Laudatory review by Danny Yee]
- Bruce Sterling, "Pervasive Computing," Viridian Note 00113
- To read, of now merely historical interest:
- Neil Gershenfeld, When Things Start to Think
- Peter Pacheco, MPI
- L. Ridgway Scott, Terry Clark, and Babak Bagheri, Scientific Parallel Computing
- Sterling et al., How to Build a Beowulf
- To read:
- Andrews, Fundamentals of Multithreaded, Parallel, and Distributed Programming
- Jon Barwise and Jerry Seligman, Information Flow: The Logic of Distributed Systems
- Ron Bekkerman, Mikhail Bilenko and John Langford (eds.), Scaling up Machine Learning: Parallel and Distributed Approaches
- Albert Benveniste, Eric Fabre and Stefan Haar, "Markov Nets: Probabilistic Models for Distributed and Concurrent Systems", IEEE Transactions on Automatic Control 48 (2003): 1936--1950
- Eike Best and Raymond Devillers, Petri Net Primer: A Compendium on the Core Model, Analysis, and Synthesis
- George F. Coulouris, Jean Dollimore, and Tim Kindberg, Distributed Systems: Concepts and Design
- Shlomi Dolev, Self-Stabilization
- Wan Fokkink, Introduction to Process Algebra
- Raymond Greenlaw, H. James Hoover, Walter L. Ruzzo, Limits to Parallel Computation: P-Completeness Theory
- Peter J. Haas, Stochastic Petri Nets: Modelling, Stability, Simulation
- Holger Hermanns, Interactive Markov Chains
- Jane Hillston, A Compositional Approach to Performance Modelling
- Huberman, Ecology of Computation
- Unmesh Joshi, Patterns of Distributed Systems [via]
- Nancy Lynch, "Building a Theory of Distributed Systems: Work by Nancy Lynch and Collaborators", arxiv:2502.20468
- Zohar Manna and Amir Pnueli, The Temporal Logic of Reactive and Concurrent Systems
- Robin Milner, Communicating and Mobile Systems: The Pi-calculus
- Wolfgang Reisig
- Davide Sangiorgi and David Walker, The Pi-Calculus: A Theory of Mobile Processes
- R. E. Tarjan, Data Structures and Network Algorithms
- Gerard Tel, Introduction to Distributed Algorithms
