Vespa Cloud - Node provisioning in AWS is not working – Incident details

All systems operational

Node provisioning in AWS is not working

Resolved
Degraded performance
Started 7 months agoLasted about 2 hours

Affected

Zones

Degraded performance from 9:00 AM to 10:35 AM

dev.gcp-us-central1-f

Degraded performance from 9:00 AM to 10:35 AM

perf.aws-us-east-1c

Degraded performance from 9:00 AM to 10:35 AM

test.aws-us-east-1c

Degraded performance from 9:00 AM to 10:35 AM

prod.aws-us-east-1c

Degraded performance from 9:00 AM to 10:35 AM

prod.aws-us-west-2a

Degraded performance from 9:00 AM to 10:35 AM

Updates
  • Resolved
    Resolved
    This incident has been resolved.
  • Identified
    Identified

    During the release of vespa-8.362.16 today, we identified failing deployments to test and staging. This failed due to a change that broke provisioning of nodes from AWS.

    We are deploying a fix for this now