Vespa Cloud - Notice history

All systems operational

Console - Operational

100% - uptime
Apr 2025 · 100.0%May · 100.0%Jun · 100.0%

Previous page

Next page

Apr 2025
May 2025
Jun 2025

Infrastructure - Operational

100% - uptime
Apr 2025 · 100.0%May · 100.0%Jun · 99.68%

Previous page

Next page

Apr 2025
May 2025
Jun 2025
100% - uptime

dev.aws-us-east-1c - Operational

100% - uptime
Apr 2025 · 99.02%May · 99.93%Jun · 99.87%

Previous page

Next page

Apr 2025
May 2025
Jun 2025

dev.gcp-us-central1-f - Operational

100% - uptime
Apr 2025 · 99.93%May · 99.95%Jun · 99.87%

Previous page

Next page

Apr 2025
May 2025
Jun 2025

perf.aws-us-east-1c - Operational

100% - uptime
Apr 2025 · 100.0%May · 100.0%Jun · 99.87%

Previous page

Next page

Apr 2025
May 2025
Jun 2025

test.aws-us-east-1c - Operational

100% - uptime
Apr 2025 · 100.0%May · 100.0%Jun · 99.87%

Previous page

Next page

Apr 2025
May 2025
Jun 2025

test.gcp-us-central1-f - Operational

100% - uptime
Apr 2025 · 99.93%May · 100.0%Jun · 99.87%

Previous page

Next page

Apr 2025
May 2025
Jun 2025

staging.aws-us-east-1c - Operational

100% - uptime
Apr 2025 · 100.0%May · 100.0%Jun · 99.87%

Previous page

Next page

Apr 2025
May 2025
Jun 2025

staging.gcp-us-central1-f - Operational

100% - uptime
Apr 2025 · 99.93%May · 100.0%Jun · 99.87%

Previous page

Next page

Apr 2025
May 2025
Jun 2025

prod.aws-us-east-1c - Operational

100% - uptime
Apr 2025 · 100.0%May · 100.0%Jun · 99.87%

Previous page

Next page

Apr 2025
May 2025
Jun 2025

prod.aws-us-west-2a - Operational

100% - uptime
Apr 2025 · 100.0%May · 100.0%Jun · 99.87%

Previous page

Next page

Apr 2025
May 2025
Jun 2025

prod.aws-eu-west-1a - Operational

100% - uptime
Apr 2025 · 100.0%May · 100.0%Jun · 99.87%

Previous page

Next page

Apr 2025
May 2025
Jun 2025

prod.ap-northeast-1a - Operational

100% - uptime
Apr 2025 · 100.0%May · 100.0%Jun · 99.87%

Previous page

Next page

Apr 2025
May 2025
Jun 2025

prod.gcp-europe-west3-b - Operational

100% - uptime
Apr 2025 · 99.93%May · 100.0%Jun · 99.87%

Previous page

Next page

Apr 2025
May 2025
Jun 2025

prod.gcp-us-central1-f - Operational

100% - uptime
Apr 2025 · 99.93%May · 100.0%Jun · 99.87%

Previous page

Next page

Apr 2025
May 2025
Jun 2025
100% - uptime

AWS - Operational

100% - uptime
Apr 2025 · 99.93%May · 100.0%Jun · 100.0%

Previous page

Next page

Apr 2025
May 2025
Jun 2025

GCP - Operational

100% - uptime
Apr 2025 · 99.93%May · 100.0%Jun · 100.0%

Previous page

Next page

Apr 2025
May 2025
Jun 2025

Notice history

Jun 2025

The vespa release rolled out today, vespa-8.534.59, introduced an issue affecting applications with containers running embedders
  • Resolved
    Resolved
    This incident has been resolved.
  • Monitoring
    Monitoring

    We have implemented a fix and created a new release, which is now being rolled out across our infrastructure. Once the deployment is complete, the issue reported in this incident will be considered resolved.

  • Update
    Update
    We are continuing to work on a fix for this incident.
  • Identified
    Identified
    Impact: * Any application changes will fail to be successfully deployed * Autoscaling: New nodes added to such container clusters will fail to start We have implemented a fix that we currently are testing [Embedding Reference](https://docs.vespa.ai/en/reference/embedding-reference.html)
Performance regression on release 8.528.12
  • Resolved
    Resolved

    We don't see any further impact.
    Please don't hesitate to contact our support through the Vespa Cloud panel if you still experience any disruption.

  • Monitoring
    Monitoring

    All production applications have been rolled back the the previous version, there should not be any impact at the current moment.

    We will be monitoring the situation for a while.

  • Identified
    Identified

    All the upgrades in Vespa Cloud are being stopped and any application already upgraded will be automatically downgraded.

  • Investigating
    Investigating

    We are have identified a regression on the vespa release 8.528.12.

May 2025

Issues new deployments in Dev zones
  • Resolved
    Resolved

    This incident has been resolved.

  • Monitoring
    Monitoring

    We have resolved the issue that caused some deployments to fail

  • Identified
    Identified

    We identified the root of the problem and it is affecting only a subset of hosts.

    We are working on a fix.

  • Investigating
    Investigating

    We are currently investigating an incident affecting new deployments in Dev.

Apr 2025

Provisioning failures in dev.aws-us-east-1c
  • Resolved
    Resolved
    This incident has been resolved.
  • Monitoring
    Monitoring

    We have identified the issue and increased the limits so new tenants should start working. We are now monitoring to confirm that this resolves the issue.

  • Investigating
    Investigating

    Due to increased demand, we are seeing failures in launching instances for new tenants. We are currently investigating this incident.

Missing metrics from on GCP and Enclave
  • Resolved
    Resolved

    We can confirm that all the systems have been successfully working since our workaround is applied and the final fix has been applied.

  • Monitoring
    Monitoring

    We have applied a workaround and we see the data metrics flowing back in our systems.

    We are now monitoring the situation.

  • Identified
    Identified

    We have identified one problem with our telemetry gateway and are working on a fix.

  • Investigating
    Investigating
    We are currently investigating this incident.

Apr 2025 to Jun 2025

Next