Vespa Cloud - Node failures in dev environment – Incident details

All systems operational

Node failures in dev environment

Resolved
Partial outage
Started about 2 years agoLasted about 2 hours

Affected

Zones

Partial outage from 1:35 PM to 3:07 PM

dev

Partial outage from 1:35 PM to 3:07 PM

dev.aws-us-east-1c

Partial outage from 1:35 PM to 3:07 PM

Updates
  • Resolved
    UTC
    Resolved

    This incident has been resolved.

  • Update
    UTC
    Update

    We implemented a fix and are currently monitoring the result. Due to the fact that there is no redundant storage in the dev environment, some documents may have been lost. We have restored as much as possible.

  • Monitoring
    UTC
    Monitoring

    We implemented a fix and are currently monitoring the result.

  • Investigating
    UTC
    Investigating

    Several nodes have been failed out in the dev environment. We are currently investigating this incident.