What can cause a node to leave the cluster?
A node may leave the cluster for many reasons. Among them: • Shutdown: cman_tool leave was run on this node • Killed by another node. The node was killed with either by cman_tool kill or qdisk. • Panic: cman failed to allocate memory for a critical data structure or some other very bad internal failure. • Removed: Like 1, but the remainder of the cluster can adjust quorum downwards to keep working. • Membership Rejected: The node attempted to join a cluster but it’s • cluster.conf file did not match that of the other nodes. To find the real reason for this you need to examine the syslog of all the valid cluster members to find out why it was rejected. • Inconsistent cluster view: This is usually indicative of a bug but it can also happen if the network is extremely unreliable. • Missed too many heartbeats: This means what it says. All nodes are expected to broadcast a heartbeat every 5 seconds (by default). If none is received within 21 seconds (by default) then it is removed for this
