etcdNoLeader #

Meaning #

This alert is triggered when etcd cluster does not have a leader for more than 1 minute.

Impact #

When there is no leader, Kubernetes API will not be able to work as expected and cluster cannot process any writes or reads, and any write requests are queued for processing until a new leader is elected. Operations that preserve the health of the workloads cannot be performed.

Diagnosis #

Control plane nodes issue #

This can occur multiple control plane nodes are powered off or are unable to connect each other via the network. Check that all control plane nodes are powered and that network connections between each machine are functional.

Slow disk issue #

Another potential cause could be slow disk, inspect the Disk Sync Durationdashboard, as well as the Total Leader Elections Per Day to get more insight and help with diagnosis.

Other #

Check the logs of etcd containers to see any further information and to verify that etcd does not have leader. Logs should contain something like etcdserver: no leader.

Mitigation #

Disaster and recovery #

Follow the steps described in the disaster and recovery docs.