Resolved -
This incident has been resolved.
During a major upgrade of our infrastructure, the new servers were not performing like excepted. Immediately our monitoring systems informed us and we took action to switch all traffic back to the old infrastructure. During the migration back to the old servers there was accidentally a firewall rule added onto our load balancers. This caused that only our monitoring systems and company members were able to reach the websites. Customers were blocked out due to this. Our monitoring systems showed us an anomaly in the amount of data packages sent. After 1h 30m we were able to find the underlying reason and resolved it.
We apologize for any inconvenience caused.
Jun 26, 02:13 UTC
Monitoring -
A fix has been implemented and we are monitoring the results.
Jun 26, 01:29 UTC
Update -
We are continuing to work on a fix for this issue.
Jun 26, 01:10 UTC
Update -
During a major upgrade of our infrastructure, the new infrastructure was not performing like excepted. Our monitoring systems informed us immediately and we currently take action to switch all traffic back to the older cluster.
Jun 25, 23:32 UTC
Identified -
The issue has been identified and a fix is currently being implemented.
Jun 25, 23:20 UTC
Investigating -
We are currently experiencing a service disruption.
Some users may be experiencing trouble when visiting our pages.
Our infrastructure team is working to identify the root cause and implement a solution.
We will send an additional update as soon as we found the root cause.
Jun 25, 23:10 UTC