On November 30th, 2022, Cornerstone engineers were alerted by internal monitoring tools for maintenance pages served for customers hosted in LHR-SL3 (On-Prem).

Cornerstone engineers were engaged in the investigation and troubleshooting of the issue related to Storage IO contention on backend database cluster nodes. The nodes were reset to get the systems back to a healthy state. In addition, engineers detected a cluster configuration issue during the incident, which delayed system recovery.

To mitigate this situation from occurring in the future and to reduce the risk of a future impact, Cornerstone has remediated the cluster configuration issue and identified the cause of the incident. Additional reliability checks have been made and corrective action has been taken, including but not limited to updating processes to avoid or throttle such background processes that may trigger IO contention, avoiding the recurrence of this incident.