Constraints we worked within.
- One short change window
- Pre-sync and checksum-verified delta syncs left only the final changes, the deployment and the checks for the window.
- Recovery in minutes, data loss in seconds
- Asynchronous replication over a high-bandwidth, low-latency link between sites, and runbooks for data that has not replicated yet.
- No direct cluster-to-cluster access
- All cross-site traffic through a bastion and HAProxy, key-based access, checksums on every transfer and firewall rules that expire after the move.
- Air-gapped
- No internet access anywhere: release images, operators, charts and tool images mirrored to an internal registry, and every install run offline.