Investigating Service Degradation

Minor incident Regions Global Switzerland GDPR safe countries
2024-11-17 09:40 CET · 1 day, 1 minute

Updates

Resolved

We’re closing the report about this problem since it’s been solved. We’re sorry that some of our customers were affected. We’ll share what caused the problem in the first place in a detailed root cause analysis.

November 18, 2024 · 09:38 CET
De-escalate

We are going to de-escalate this incident now, since we have good signals that our service quality is within our defined goal.

The team will further monitor the situation and work on a root cause analysis in the coming days.

November 18, 2024 · 08:22 CET
Monitoring

We are actively monitoring the situation and will provide a update in 30 minutes about the further process.

November 18, 2024 · 07:44 CET
Monitoring

All error levels and latencies have returned to normal levels. We will further monitor the situation.

We are sorry any potential impact we had on our customers. The team will conduct a root cause analysis and publish it here in due course.

November 17, 2024 · 21:08 CET
Investigating

While the API latency remained stable we still observe some elevated error rates on the authentication endpoints (Login, Tokens, …).

The team is doing further investigations.

November 17, 2024 · 16:00 CET
Investigating

We are currently rolling out a mitigation for the infrastructure related issue we experience.

November 17, 2024 · 13:42 CET
Escalate

We identified an additional infrastructure related problem.

Work for the mitigation is ongoing.

November 17, 2024 · 12:04 CET
Investigating

The team is currently investigating additional solutions to further improve the latency.

November 17, 2024 · 11:29 CET
Investigating

We identified a potential problem and started rolling out a temporary mitigation to improve the service quality.

November 17, 2024 · 10:26 CET
Issue

Our team currently investigates reports of a potential service interruption and elevated error levels. We apologize for any inconvenience and will post another update as soon as we learn more.

November 17, 2024 · 09:40 CET

← Back