A second data center in the UAE region has lost power, due to active military conflict in the region.
An HA Typesense Cluster with 3 nodes can survive a maximum of 1 node failure, and with 2 data centers in the region now down, 2 nodes in HA clusters in the region are now inaccessible, which makes the 3rd node stop serving traffic to avoid split brain scenarios.
Our infrastructure provider estimates that it might take at least a day to evaluate critical systems and their safety, before providing an ETA for full restoration.
Given the severity and uncertainty of this event, we strongly recommend:
Provisioning a new cluster in a different region outside the Middle East.
Re-indexing data from your primary database.
Updating your application configuration to point to the new cluster.
Please note: the cluster cloning feature is unavailable because the regional control plane is also affected.