Cornerstone Status - Minor Issue - Reporting 2.0 Latency on US SL1 & 2

Minor Issue - Reporting 2.0 Latency on US SL1 & 2

Incident Report for Cornerstone

Postmortem

On March 8th, 2024, internal monitoring tools at Cornerstone flagged latency concerns, potentially affecting clients hosted in US SL1 & SL2 Prod swimlanes accessing Reporting 2.0 intermittently.

Promptly, Cornerstone engineers launched an investigation, pinpointing a caching issue within one of the authorization services. Swift action ensued as the team reset the service, swiftly resolving the problem.

To forestall similar incidents and mitigate future risks, Cornerstone has enacted additional corrective measures. These include configuration optimization changes deployed in production, aiming to prevent recurrence of such issues.

Posted Mar 22, 2024 - 09:15 PDT

Resolved

The CSOD Technology Team observed a performance degradation affecting this swimlane. The problem began at [05;30 AM] Pacific Time and was resolved at [07:50 AM] Pacific Time. During this time, clients with portals on this swimlane may have experienced slow performance or intermittent errors while accessing the application.

Posted Mar 08, 2024 - 07:56 PST

Investigating

The swimlane is experiencing some latency issues. Clients with portals in this swimlane may experience delays or issues accessing certain pages in the application. This is our top priority and we are working to resolve the problem as soon as possible. Please check back periodically for additional updates, which will be posted as they become available.

Posted Mar 08, 2024 - 07:28 PST

This incident affected: US SL1 (AWS) (Response Time) and US SL2 (AWS) (Response Time).