Dashboard (railway.com)Login - GitHubLogin - GoogleDNSTrafficBuild Machines (GCP)Image Registry (GCP)TCP Proxy (GCP)Southeast Asia (GCP / Singapore)US East (GCP / Virginia, USA)US West (GCP / Oregon, USA)EU West (GCP / Amsterdam, Netherlands)EU West (GCP / Amsterdam, Netherlands)US West (GCP / Oregon, USA)US East (GCP / Virginia, USA)Southeast Asia (GCP / Singapore)TCP Proxy (Metal)US East (Metal / Virginia, USA)Southeast Asia (Metal / Singapore)EU West (Metal / Amsterdam, Netherlands)US West (Metal / California, USA)MetricsLogsSoutheast Asia (Metal / Singapore)US East (Metal / Virginia, USA)US West (Metal / California, USA)EU West (Metal / Amsterdam, Netherlands)Build Machines (Metal)Image Registry (Metal)Central Station (station.railway.com)
Monitoring
Railway services have fully recovered. Some workloads may still need a redeploy, we're automatically redeploying any we detect as unhealthy. If your service isn't responding correctly, please trigger a redeploy from the dashboard or CLI.
We're sorry for the disruption. A detailed postmortem will follow once we've confirmed stability.
May 20, 06:14 UTC
Identified
More workloads are coming back online. Some users may still experience intermittent issues during the recovery. Non-enterprise deploys remain paused; enterprise deploys are unaffected.
May 20, 03:05 UTC
Identified
We are seeing gradual recovery on Railway metal workloads. To ensure things remain stable as we ramp back up, we are temporarily throttling all non-enterprise builds to avoid overwhelming our build infrastructure.
May 20, 01:41 UTC
Identified
We have recovered our compute on Google Cloud, but services are unable to start because of ongoing networking issues on Google Cloud's side. We are engaged with Google Cloud support to resolve this and will post the next update as soon as we have more to share.
May 20, 01:34 UTC
Identified
We are continuing to work on restoring access to our workloads on Google Cloud. In parallel, our infrastructure team is evaluating alternative paths to bring affected services back online. We do not have an ETA at this time and will continue posting updates as we have them.
May 20, 01:23 UTC
Identified
We are working to restore the Google Cloud infrastructure that powers our dashboard, API, and internal network's control plane. We are in direct contact with Google Cloud's support team. We do not have an ETA at this time.
May 20, 00:37 UTC
Identified
Google Cloud has blocked our account, making some Railway services unavailable. We have escalated this directly with Google.
The Railway Platform team has since confirmed access to Google Cloud and is working on restoring access to all workloads. We have access to some of our Google Cloud–hosted infrastructure and are working to restore the rest of the service. We apologize for the disruption.
May 19, 23:37 UTC
Identified
We have identified the cause of the disruption. Access to our upstream cloud provider has been restored and we are working on a fix.
The Railway dashboard and services running on our cloud infrastructure may continue to be affected until the fix is deployed.
May 19, 22:43 UTC
Investigating
We are investigating a widespread service disruption affecting Railway. Users may be experiencing errors including "no healthy upstream", "unconditional drop overload", login failures, and inability to access the dashboard. We are actively investigating and will provide updates as soon as possible.
May 19, 22:29 UTC