Fault Tolerant Messaging in the context of computer systems and networks, refers to a design approach and set of techniques aimed at ensuring reliable and continuous communication between components or nodes even in the presence of errors or failures. This concept is especially critical in distributed systems, where components may be geographically dispersed and interconnected through networks, making them susceptible to various potential points of failure.
The primary objective of fault-tolerant messaging is to maintain the integrity and availability of information exchange among system components, even when some components or communication channels encounter disruptions or errors. These errors may arise from hardware failures, network outages, software bugs, or other unexpected events.
Key characteristics and mechanisms commonly employed in fault-tolerant messaging include:
Redundancy: One of the fundamental principles of fault tolerance is redundancy, which involves duplicating critical components or data to create backup copies. Redundant systems can seamlessly take over the responsibilities of failed components, ensuring continuous operation and mitigating the impact of failures.
Error Detection and Correction: Fault-tolerant messaging systems often incorporate mechanisms to detect errors, such as checksums or error-detection codes, enabling them to identify corrupted or incomplete data. Moreover, error correction techniques like Forward Error Correction (FEC) may be utilized to reconstruct missing or damaged data.
Message Acknowledgment and Retransmission: To ensure the reliable delivery of messages, fault-tolerant messaging protocols often include acknowledgment mechanisms. When a sender transmits a message, the receiver acknowledges its receipt, and if no acknowledgment is received, the sender may retransmit the message.
Timeouts and Heartbeats: Timeout mechanisms are used to detect unresponsive or stalled communication channels. If a component does not receive a response within a specified time frame, it may trigger appropriate actions, such as retrying the communication or activating failover procedures. Heartbeats, or periodic status messages, are often employed to indicate that a component is still operational.
Error Recovery and Fault Isolation: Fault-tolerant messaging systems implement procedures to recover from errors gracefully. This may involve reconfiguring the system to bypass failed components, isolating faults, or initiating self-repair processes.
Load Balancing: In distributed systems, load balancing techniques distribute the workload across multiple components to avoid overburdening any single node and reduce the risk of individual component failures affecting the entire system.
Consistency and Replication: In replicated environments, maintaining data consistency across multiple copies is essential. Techniques like two-phase commit and quorum-based approaches help ensure consistency in distributed systems.
Several common protocols and technologies are employed to provide fault-tolerant messaging in distributed systems. These protocols are designed to ensure reliable communication, error detection and correction, and seamless failover mechanisms. Some of the most widely used protocols for fault-tolerant messaging include:
Transmission Control Protocol (TCP): TCP is a reliable, connection-oriented protocol that ensures data delivery and integrity. It provides acknowledgment mechanisms, retransmission of lost packets, and flow control to manage data transfer between communicating nodes.
Advanced Message Queuing Protocol (AMQP): AMQP is an open standard messaging protocol that facilitates message-oriented communication between applications. It supports reliable message delivery, acknowledgment, and queuing mechanisms to ensure fault tolerance in message processing.
Message Queuing Telemetry Transport (MQTT): MQTT is a lightweight messaging protocol often used in Internet of Things (IoT) applications. It supports Quality of Service (QoS) levels for message delivery, including guaranteed delivery, making it fault-tolerant in unreliable network conditions.
WebSockets: WebSockets provide a persistent, bidirectional communication channel between clients and servers. They can be utilized with custom error handling and retry mechanisms to enhance fault tolerance in real-time web applications.
Apache Kafka: Kafka is a distributed streaming platform that provides fault tolerance through replication and partitioning of data. It is widely used for real-time data streaming and processing in distributed systems.
Publish/Subscribe (Pub/Sub): mechanism for messaging between components. By leveraging replication capabilities, it can be made fault-tolerant.
A datagram is a basic transfer unit associated with a packet-switched network. Datagrams are typically structured in header and payload sections. Datagrams provide a connectionless communication service across a packet-switched network. The delivery, arrival time, and order of arrival of datagrams need not be guaranteed by the network.
The end-to-end principle is a design framework in computer networking. In networks designed according to this principle, guaranteeing certain application-specific features, such as reliability and security, requires that they reside in the communicating end nodes of the network. Intermediary nodes, such as gateways and routers, that exist to establish the network, may implement these to improve efficiency but cannot guarantee end-to-end correctness.
Checkpointing is a technique that provides fault tolerance for computing systems. It basically consists of saving a snapshot of the application's state, so that applications can restart from that point in case of failure. This is particularly important for long running applications that are executed in failure-prone computing systems.
Message-oriented middleware (MOM) is software or hardware infrastructure supporting sending and receiving messages between distributed systems. MOM allows application modules to be distributed over heterogeneous platforms and reduces the complexity of developing applications that span multiple operating systems and network protocols. The middleware creates a distributed communications layer that insulates the application developer from the details of the various operating systems and network interfaces. APIs that extend across diverse platforms and networks are typically provided by MOM.
A Byzantine fault is a condition of a computer system, particularly distributed computing systems, where components may fail and there is imperfect information on whether a component has failed. The term takes its name from an allegory, the "Byzantine generals problem", developed to describe a situation in which, to avoid catastrophic failure of the system, the system's actors must agree on a concerted strategy, but some of these actors are unreliable.
The Time-Triggered Protocol (TTP) is an open computer network protocol for control systems. It was designed as a time-triggered fieldbus for vehicles and industrial applications. and standardized in 2011 as SAE AS6003. TTP controllers have accumulated over 500 million flight hours in commercial DAL A aviation application, in power generation, environmental and flight controls. TTP is used in FADEC and modular aerospace controls, and flight computers. In addition, TTP devices have accumulated over 1 billion operational hours in SIL4 railway signalling applications.
Fault tolerance is the ability of a system to maintain proper operation in the event of failures or faults in one or more of its components. Any decrease in operating quality is proportional to the severity of the failure, unlike a naively designed system in which even a small failure can lead to total breakdown. Fault tolerance is particularly sought after in high-availability, mission-critical, or even life-critical systems. The ability to maintain functionality when portions of a system break down is referred to as graceful degradation.
In computer networking, a reliable protocol is a communication protocol that notifies the sender whether or not the delivery of data to intended recipients was successful. Reliability is a synonym for assurance, which is the term used by the ITU and ATM Forum.
Replication in computing involves sharing information so as to ensure consistency between redundant resources, such as software or hardware components, to improve reliability, fault-tolerance, or accessibility.
Packet loss occurs when one or more packets of data travelling across a computer network fail to reach their destination. Packet loss is either caused by errors in data transmission, typically across wireless networks, or network congestion. Packet loss is measured as a percentage of packets lost with respect to packets sent.
The Advanced Message Queuing Protocol (AMQP) is an open standard application layer protocol for message-oriented middleware. The defining features of AMQP are message orientation, queuing, routing, reliability and security.
The Time-Triggered Ethernet standard defines a fault-tolerant synchronization strategy for building and maintaining synchronized time in Ethernet networks, and outlines mechanisms required for synchronous time-triggered packet switching for critical integrated applications and integrated modular avionics (IMA) architectures. SAE International released SAE AS6802 in November 2011.
A reliable multicast is any computer networking protocol that provides a reliable sequence of packets to multiple recipients simultaneously, making it suitable for applications such as multi-receiver file transfer.
The Application Interface Specification (AIS) is a collection of open specifications that define the application programming interfaces (APIs) for high-availability application computer software. It is developed and published by the Service Availability Forum and made freely available. Besides reducing the complexity of high-availability applications and shortening development time, the specifications intended to ease the portability of applications between different middleware implementations and to admit third party developers to a field that was highly proprietary in the past.
RabbitMQ is an open-source message-broker software that originally implemented the Advanced Message Queuing Protocol (AMQP) and has since been extended with a plug-in architecture to support Streaming Text Oriented Messaging Protocol (STOMP), MQ Telemetry Transport (MQTT), and other protocols.
MQTT is a lightweight, publish-subscribe, machine to machine network protocol for message queue/message queuing service. It is designed for connections with remote locations that have devices with resource constraints or limited network bandwidth, such as in the Internet of Things (IoT). It must run over a transport protocol that provides ordered, lossless, bi-directional connections—typically, TCP/IP. It is an open OASIS standard and an ISO recommendation.
In computer science, a heartbeat is a periodic signal generated by hardware or software to indicate normal operation or to synchronize other parts of a computer system. Heartbeat mechanism is one of the common techniques in mission critical systems for providing high availability and fault tolerance of network services by detecting the network or systems failures of nodes or daemons which belongs to a network cluster—administered by a master server—for the purpose of automatic adaptation and rebalancing of the system by using the remaining redundant nodes on the cluster to take over the load of failed nodes for providing constant services. Usually a heartbeat is sent between machines at a regular interval in the order of seconds; a heartbeat message. If the endpoint does not receive a heartbeat for a time—usually a few heartbeat intervals—the machine that should have sent the heartbeat is assumed to have failed. Heartbeat messages are typically sent non-stop on a periodic or recurring basis from the originator's start-up until the originator's shutdown. When the destination identifies a lack of heartbeat messages during an anticipated arrival period, the destination may determine that the originator has failed, shutdown, or is generally no longer available.
Raft is a consensus algorithm designed as an alternative to the Paxos family of algorithms. It was meant to be more understandable than Paxos by means of separation of logic, but it is also formally proven safe and offers some additional features. Raft offers a generic way to distribute a state machine across a cluster of computing systems, ensuring that each node in the cluster agrees upon the same series of state transitions. It has a number of open-source reference implementations, with full-specification implementations in Go, C++, Java, and Scala. It is named after Reliable, Replicated, Redundant, And Fault-Tolerant.
RocketMQ is a distributed messaging and streaming platform with low latency, high performance and reliability, trillion-level capacity and flexible scalability. It is the third generation distributed messaging middleware open sourced by Alibaba in 2012. On November 21, 2016, Alibaba donated RocketMQ to the Apache Software Foundation. Next year, on February 20, the Apache Software Foundation announced Apache RocketMQ as a Top-Level Project.
Avalanche is a decentralized, open-source proof of stake blockchain with smart contract functionality. AVAX is the native cryptocurrency of the platform.
This page is based on this Wikipedia article Text is available under the CC BY-SA 4.0 license; additional terms may apply. Images, videos and audio are available under their respective licenses.
