The root cause appears to be a core router that failed into a degraded state, adding 60-80ms latency to all circuits but not actually shutting them down.
Emergency maintenance will also be scheduled to replace the equipment in a subsequent update once we are ready to do so. Technicians are en route now for that task, but all customer services are operating normally at this time.
Aug 8, 12:35 PDT
The network performance remains stable and all services continue to work properly. Our engineering team is continuing work on understanding and preventing the cause of this incident.
Aug 8, 12:09 PDT
All services are operational. We will continue monitoring while we work on the root cause in our ORD datacenter. Customer impact should be fully mitigated. Please contact support if you are still seeing residual issues.
Aug 8, 09:49 PDT
We have routed around the cause of the issue and services are coming back online for affected customers. We are still working to fully resolve the issue.
Aug 8, 09:34 PDT
Our Engineering team is working on this issue. Network connectivity appears to be impacted on multiple providers affecting our North American datacenters.
Aug 8, 09:20 PDT
We are currently investigating an inability to access Dash portal. Phone service is also affected. vConsole is not affected.
Aug 8, 08:56 PDT