| 2026-09-15 |
P2 |
pvek8s Triple Replica Fault — Proxmox Backup fs-freeze, Corrupt Snapshot Chains, and an Orphaned Pod Route |
~23h 0m |
| 2026-09-02 |
P1 |
pvek8s Total Control Plane Loss and Read-Only Volume Cascade — systemd +esm4 PID 1 Segfault, a Recurring dqlite/iSCSI Storm, and Two Rounds of Storage Recovery |
~33h across two linked incidents |
| 2026-08-15 |
P2 |
hal NFS Handle Invalidation — Silent SQLite Failures Across Three Services and a 2.7-Day Detection Gap |
~2d 16h 38m |
| 2026-08-06 |
P2 |
pvek8s Read-Only Volume Cascade — dqlite Storm, iSCSI Starvation, and a 17-Hour Action Gap |
~17h 57m |
| 2026-08-01 |
P2 |
hal NFS Export Failure — Cluster-Wide Stale Mounts and a 7h Detection Gap |
~8h 5m total |
| 2026-07-13 |
P3 |
pvek8s Storage Cascade — ArgoCD Sync Burst, Watch-Cache Freeze, and jiva iSCSI Read-Only Volumes |
~1h 8m active |
| 2026-07-11 |
P2 |
pvek8s Scheduling Outage — k8s03 Watch-Cache Freeze and Stale-Unit Watchdog Lockout |
~3h 0m scheduling outage |
| 2026-07-09 |
P2 |
pvek8s Scheduling Outage — k8s03 Watch-Cache Freeze and Auto-Remediation Delivery Failure |
~5h 19m active |
| 2026-06-28 |
P2 |
pvek8s dqlite WAL Lock Storm — Jiva Controller Endpoint Deadlock |
~11h 11m total degradation |
| 2026-06-24 |
P2 |
k8s02 Watch-Cache Freeze — dqlite Leadership Disruption Stalls Pod Creation |
~4h active |
| 2026-06-17 |
P3 |
seerr Jiva CSI Stale Node Attachment — PVC Stuck After Cross-Node Rescheduling |
~31m active |
| 2026-06-05 |
P1 |
pvek8s Kernel Update — Simultaneous 3-Node Reboot Cascade |
~6h 58m |
| 2026-05-28 |
P2 |
pvek8s Post-Power-Outage Recovery — kubelet Volume Manager Stall and KCM Stale terminatingReplicas |
~5h 20m active |
| 2026-05-23 |
P3 |
k8s01 Calico CNI Unauthorized — Stale Pod-Bound Token After Calico Upgrade |
~1h active |
| 2026-05-18 |
P2 |
k8s03 Extended Recovery — kine Watch Corruption, VXLAN Route Corruption, and Kubelet Watch Stream Stall |
~2h10m active |
| 2026-05-17 |
P2 |
k8s03 PLEG Deadlock — Stale Calico IPAM Blocks + Generic PLEG Serial-Poll Vulnerability |
~9 hours active |
| 2026-05-16 |
P2 |
microk8s 1.34 → 1.35 Rolling Upgrade — cgroup v2, containerd Shim, Disk Pressure, and Kubelet Stall |
~8.75 hours active |
| 2026-05-15 |
P3 |
AWX Automation Pod Stuck Pending — Calico RBAC Gap + dqlite Write Storm |
~13 min silent |
| 2026-04-12 |
P1 |
pvek8s Complete Cluster Outage — dqlite Quorum Loss and Ansible-Injected Invalid Flags |
7 days degraded |
| 2026-04-02 |
P2 |
dqlite Snapshot Bloat → kube-apiserver Instability → Controller Crash-Loop Cascade and Watch Stream Failure |
~36h |
| 2026-03-30 |
P2 |
Sonarr Outage Due to iSCSI Hairpin NAT Failure on k8s03 |
Unknown silent failure period + ~45m active investigation and recovery |
| 2026-03-28 |
P2 |
Radarr Outage — OpenEBS Jiva Replica Divergence (Second Occurrence) |
~30h silent failure + ~50m active recovery |
| 2026-03-28 |
P2 |
ARC GitHub Actions Runner Pods Stuck Pending — Kubelet Sync Loop Stall and Multi-Node Degradation |
~7h40m |
| 2026-02-22 |
P2 |
Radarr Outage Due to OpenEBS Jiva Replica Divergence |
~16h30m silent failure + ~47m active recovery |
| 2026-01-06 |
P1 |
Cascading Kubernetes Cluster Failures |
~8 hours |