Vespa Cloud - Node provisioning in AWS is not working – Incident details

All systems operational

Node provisioning in AWS is not working

Resolved
Degraded performance
Started about 2 years agoLasted about 2 hours

Affected

Enclave

Degraded performance from 9:00 AM to 10:35 AM

AWS

Degraded performance from 9:00 AM to 10:35 AM

Zones

Degraded performance from 9:00 AM to 10:35 AM

dev

Degraded performance from 9:00 AM to 10:35 AM

dev.gcp-us-central1-f

Degraded performance from 9:00 AM to 10:35 AM

perf

Degraded performance from 9:00 AM to 10:35 AM

Updates
  • Resolved
    UTC
    Resolved
    This incident has been resolved.
  • Identified
    UTC
    Identified

    During the release of vespa-8.362.16 today, we identified failing deployments to test and staging. This failed due to a change that broke provisioning of nodes from AWS.

    We are deploying a fix for this now