The Totem single-ring ordering and membership protocol

  title={The Totem single-ring ordering and membership protocol},
  author={Yair Amir and Louise E. Moser and P. M. Melliar-Smith and Deborah A. Agarwal and P. Ciarfella},
  journal={ACM Trans. Comput. Syst.},
Fault-tolerant distributed systems are becoming more important, but in existing systems, maintaining the consistency of replicated data is quite expensive. [] Key Method Extended virtual synchrony ensures that processors deliver messages and configuration changes to the application in a consistent, systemwide total order. An effective flow control mechanism enables the Totem single-ring protocol to achieve message-ordering rates significantly higher than the best prior total-ordering protocols.

Figures from this paper

A high performance reliable atomic group protocol

The experiment results of the implemented protocol in a local area network of workstations have demonstrated that its performance is better than any existing solutions in the same environment, especially for achieving message total ordering and atomic (safe) delivery.

Optimistic total order in wide area networks

A simple technique is proposed which enables the usage of optimistic delivery also in WANs with much larger transmission delays where the optimistic assumption does not normally hold and an experimental evaluation of a modified sequencer-based protocol is presented, illustrating the usefulness of the approach in fault-tolerant database management.

The Totem multiple-ring ordering and topology maintenance protocol

The Totem multiple-ring protocol provides reliable totally ordered delivery of messages across multiple local-area networks interconnected by gateways and achieves a latency that increases logarithmically with system size by exploiting process group locality and selectiveforwarding of messages through the gateways.

An adaptive totally ordered multicast protocol that tolerates partitions

A novel algorithm that implements a totally ordered multicast primitive for a Totally Ordered Group Communication Service (TO-GCS), which provides well-defined message ordering semantics and is useful for soft real-time environments where sharp fluctuations in message delivery latency are not acceptable.

Non-blocking message total ordering protocol

The paper proves that NBTOP satisfies the properties of total order, agreement, and termination, and manifests that non-blocking property helps to improve protocol efficiency.

Developing and refining an adaptive token-passing strategy

The parameterized technique presents the safety properties of ring protocols and maintains high throughput in busy systems, while reducing the delay in lightly loaded systems from a linear to a logarithmic function in the number of processors.

Implementation of efficient and reliable multicast servers

The design and implementations of a new logical token ring based multicast communications services that provides total ordering, atomicity of multicast messages membership and fault-tolerant services in the presence of sites fail stop and network partitioning are discussed.

The totem redundant ring protocol

The totem redundant ring protocol allows the use of multiple redundant local-area networks and the partial or total failure of a network remains transparent to the application processes.

A multicast protocol based on a single logical ring using a virtual token and logical clocks

A novel and highly efficient multicast protocol based on single logical ring for a group of cooperative processes that uses a virtual token to achieve atomicity of messages and can tolerate communication faults, process crash failures and network partitions.



Fast message ordering and membership using a logical token-passing ring

The Totem protocol supports consistent concurrent operations by placing a total order on broadcast messages by including a sequence number in a token circulated around a logical ring that is imposed on a set of processors in a broadcast domain.

Probabilistic bounds on message delivery for the totem single-ring protocol

The authors present a methodology for determining the probability of satisfying bounds on the latency from message origination to ordered delivery in the presence of communication faults.

Monitoring Membership Changes in a Fault-Tolerant Distributed System

A network monitor with graphical output that is constructed for the Totem protocol development environment that collects information from the processors within the development environment and displays global membership information and other data in an intuitive fashion.

A reliable ordered delivery protocol for interconnected local area networks

The Totem multiple-ring protocol is presented, a novel reliable ordered multicast protocol for multiple interconnected local-area networks that simplifies the maintenance of consistency of replicated data, and eases the development of fault-tolerant distributed systems.


A local area protocol, operating on a single ring, uses a single sequence of message sequence numbers to ensure that all messages are delivered and ordered, with timestamps to order the messages.

Broadcast Protocols for Distributed Systems

An innovative approach is presented to the design of fault-tolerant distributed systems that avoids the several rounds of message exchange required by current protocols for consensus agreement. The

A Membership Protocol Based on Partial Order

A membership protocol is described that is based on a multicast facility that preserves only the partial order of messages exchanged among the communicating processes and requires less synchronization overhead than existing protocols.

A token-based protocol for reliable, ordered multicast communication

The TPM protocol combines several positive features of other reliable multicast schemes into a single protocol, yet maintains a relatively simple structure and requires that only a minimal amount of state information be kept by process group members.

The Totem Protocol Testbed

The Totem Protocol Testbed by Paul W. Ciarfella is combined into an easy to use and exible testbed for the debugging and evaluation of the Totem protocol.

Extended virtual synchrony

A model of extended virtual synchrony is formulated that defines a group communication transport service for multicast and broadcast communication in a distributed system and provides well-defined self-delivery and failure atomicity properties.