# CircleCI: Elevated level of infra fails on customer jobs

- Provider: [CircleCI](https://outages.cc/circleci.md)
- Type: Incident
- State: Resolved
- Worst impact: Degraded performance
- Started: 2026-10-07 14:27 UTC
- Resolved: 2026-10-07 15:21 UTC (lasted 54 min)
- Components: Pipelines & Workflows
- Official update: https://stspg.io/n2l0044kmkdr

## Updates from CircleCI

### postmortem, 2026-10-08 17:55 UTC

## **Summary** Between October 1 and October 8, 2026, CircleCI customers experienced five separate incidents in which jobs waited longer than normal to start, or failed to start. Three of the incidents were driven by limited instance availability from our cloud provider. One was caused by a configuration issue in our scheduling infrastructure, and one by memory limits on an internal service, which we raised during the incident. * **October 1, 07:57 to 10:24 UTC:** Docker Gen 2 jobs waited up to 30 minutes to start. A configuration issue prevented the Gen 2 scheduling servers from using their high-performance local disks. During a burst in traffic, the fallback disks saturated and job placement slowed. * **October 7, 13:27 to 14:06 UTC:** Machine jobs waited longer than normal because we could not acquire enough virtual machines from our cloud provider. * **October 7, 14:24 to 15:21 UTC:** Some jobs failed with an infrastructure error, and workflows were delayed. The service that gives

### resolved, 2026-10-07 15:21 UTC

This incident has been resolved.

### monitoring, 2026-10-07 14:44 UTC

We're seeing signs of recovery. Docker Gen2 wait times are slightly elevated and we're monitoring.

### investigating, 2026-10-07 14:27 UTC

We are investigating a rise in infra fails for customer jobs.
