<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/">
  <channel>
    <title>Vespa Cloud Status - Incident history</title>
    <link>https://status.vespa.ai</link>
    <description>Vespa Cloud</description>
    <pubDate>Fri, 17 Apr 2026 09:00:00 +0000</pubDate>
    
<item>
  <title>Vespa Cloud Console Maintenance</title>
  <description>
    Type: Maintenance
    Duration: 57 minutes

    Affected Components: Console
    Apr 17, 09:00:00 GMT+0 - Identified - We are planning for a scheduled maintenance during that time. Apr 17, 09:00:01 GMT+0 - Identified - Maintenance is now in progress Apr 17, 09:57:01 GMT+0 - Completed - Maintenance has completed successfully. Apr 17, 09:57:00 GMT+0 - Completed - Maintenance has completed successfully. 
  </description>
  <content:encoded>
    <![CDATA[<p><strong>Type:</strong> Maintenance</p>
    <p><strong>Duration:</strong> 57 minutes</p>
    <p><strong>Affected Components:</strong> </p>
    &lt;p&gt;&lt;small&gt;Apr &lt;var data-var=&#039;date&#039;&gt; 17&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;09:00:00&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Identified&lt;/strong&gt; -
  We are planning for a scheduled maintenance during that time..&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Apr &lt;var data-var=&#039;date&#039;&gt; 17&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;09:00:01&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Identified&lt;/strong&gt; -
  Maintenance is now in progress.&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Apr &lt;var data-var=&#039;date&#039;&gt; 17&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;09:57:01&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Completed&lt;/strong&gt; -
  Maintenance has completed successfully..&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Apr &lt;var data-var=&#039;date&#039;&gt; 17&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;09:57:00&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Completed&lt;/strong&gt; -
  Maintenance has completed successfully..&lt;/p&gt;
]]>
  </content:encoded>
  <pubDate>Fri, 17 Apr 2026 09:00:00 +0000</pubDate>
  <link>https://status.vespa.ai/maintenance/cmo2n1d7q0cmwz3zj3cax0qhx</link>
  <guid>https://status.vespa.ai/maintenance/cmo2n1d7q0cmwz3zj3cax0qhx</guid>
</item>

<item>
  <title>Vespa Cloud metrics view is unaccessible</title>
  <description>
    Type: Incident
    Duration: 3 hours and 38 minutes

    Affected Components: Console
    Apr 9, 12:44:00 GMT+0 - Investigating - We are currently investigating this incident. Apr 9, 14:50:18 GMT+0 - Investigating - We are currently investigating this incident. Apr 9, 16:22:23 GMT+0 - Resolved - This incident has been resolved. 
  </description>
  <content:encoded>
    <![CDATA[<p><strong>Type:</strong> Incident</p>
    <p><strong>Duration:</strong> 3 hours and 38 minutes</p>
    <p><strong>Affected Components:</strong> </p>
    &lt;p&gt;&lt;small&gt;Apr &lt;var data-var=&#039;date&#039;&gt; 9&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;12:44:00&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Investigating&lt;/strong&gt; -
  We are currently investigating this incident..&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Apr &lt;var data-var=&#039;date&#039;&gt; 9&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;14:50:18&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Investigating&lt;/strong&gt; -
  We are currently investigating this incident..&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Apr &lt;var data-var=&#039;date&#039;&gt; 9&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;16:22:23&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Resolved&lt;/strong&gt; -
  This incident has been resolved..&lt;/p&gt;
]]>
  </content:encoded>
  <pubDate>Thu, 9 Apr 2026 12:44:00 +0000</pubDate>
  <link>https://status.vespa.ai/incident/cmnrmmmtk00ccx4z76glkb4md</link>
  <guid>https://status.vespa.ai/incident/cmnrmmmtk00ccx4z76glkb4md</guid>
</item>

<item>
  <title>Authentication issues with Vespa Console</title>
  <description>
    Type: Incident
    

    Affected Components: Console
    Apr 8, 09:13:00 GMT+0 - Investigating - We are currently investigating issues with authentication in Vespa Console Apr 8, 09:28:00 GMT+0 - Resolved - This incident has been resolved. Apr 8, 09:25:00 GMT+0 - Identified - We are have identified the issue and proceeding with a fix 
  </description>
  <content:encoded>
    <![CDATA[<p><strong>Type:</strong> Incident</p>
    
    <p><strong>Affected Components:</strong> </p>
    &lt;p&gt;&lt;small&gt;Apr &lt;var data-var=&#039;date&#039;&gt; 8&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;09:13:00&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Investigating&lt;/strong&gt; -
  We are currently investigating issues with authentication in Vespa Console.&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Apr &lt;var data-var=&#039;date&#039;&gt; 8&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;09:28:00&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Resolved&lt;/strong&gt; -
  This incident has been resolved..&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Apr &lt;var data-var=&#039;date&#039;&gt; 8&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;09:25:00&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Identified&lt;/strong&gt; -
  We are have identified the issue and proceeding with a fix.&lt;/p&gt;
]]>
  </content:encoded>
  <pubDate>Wed, 8 Apr 2026 09:13:00 +0000</pubDate>
  <link>https://status.vespa.ai/incident/cmnpulhk402xcx917ddu0xjpn</link>
  <guid>https://status.vespa.ai/incident/cmnpulhk402xcx917ddu0xjpn</guid>
</item>

<item>
  <title>Metrics pipeline broken — Grafana dashboards reporting no incoming data</title>
  <description>
    Type: Incident
    Duration: 2 hours and 6 minutes

    Affected Components: , AWS, staging.gcp-us-central1-f, prod.aws-eu-west-1a, prod.aws-us-west-2a, perf.aws-us-east-1c, Infrastructure, prod.aws-us-east-1c, prod.gcp-us-central1-f, test.aws-us-east-1c, dev.aws-euw1-az1, prod.aws-apne1-az1, prod.aws-cac1-az1, prod.aws-euw1-az1, prod.gcp-us-central1-c, prod.gcp-us-central1-a, GCP, staging.aws-us-east-1c, prod.aws-euc1-az1, prod.gcp-europe-west3-b, prod.gcp-us-central1-b, prod.aws-ap-northeast-1a, prod.aws-aps1-az1, prod.aws-euc1-az3, prod.aws-use1-az4, test.gcp-us-central1-f, , , , prod.aws-cac1-az2, , prod.aws-use2-az1, prod.aws-use2-az3, prod.aws-usw2-az3, , dev.aws-us-east-1c, dev.gcp-us-central1-f, 
Enclave → 
dev → 
prod → 
test → 
perf → 
Zones →
    Apr 1, 00:50:14 GMT+0 - Investigating - We are currently investigating this incident. Apr 1, 02:22:24 GMT+0 - Monitoring - We implemented a fix and are currently monitoring the result. Apr 1, 02:56:04 GMT+0 - Resolved - This incident has been resolved. 
  </description>
  <content:encoded>
    <![CDATA[<p><strong>Type:</strong> Incident</p>
    <p><strong>Duration:</strong> 2 hours and 6 minutes</p>
    <p><strong>Affected Components:</strong> , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , </p>
    &lt;p&gt;&lt;small&gt;Apr &lt;var data-var=&#039;date&#039;&gt; 1&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;00:50:14&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Investigating&lt;/strong&gt; -
  We are currently investigating this incident..&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Apr &lt;var data-var=&#039;date&#039;&gt; 1&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;02:22:24&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Monitoring&lt;/strong&gt; -
  We implemented a fix and are currently monitoring the result..&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Apr &lt;var data-var=&#039;date&#039;&gt; 1&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;02:56:04&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Resolved&lt;/strong&gt; -
  This incident has been resolved..&lt;/p&gt;
]]>
  </content:encoded>
  <pubDate>Wed, 1 Apr 2026 00:50:14 +0000</pubDate>
  <link>https://status.vespa.ai/incident/cmnfbx2ce0vr213atwrrjzslo</link>
  <guid>https://status.vespa.ai/incident/cmnfbx2ce0vr213atwrrjzslo</guid>
</item>

<item>
  <title>prod - prod.gcp-europe-west3-b isn&#039;t accessible at the moment (automated)</title>
  <description>
    Type: Incident
    Duration: 1 hour and 53 minutes

    Affected Components: prod.gcp-europe-west3-b
    Mar 27, 03:47:23 GMT+0 - Investigating - prod - prod.gcp-europe-west3-b cannot be accessed at the moment. This incident was created by an automated monitoring service. Mar 27, 05:40:43 GMT+0 - Resolved - This incident has been resolved. 
  </description>
  <content:encoded>
    <![CDATA[<p><strong>Type:</strong> Incident</p>
    <p><strong>Duration:</strong> 1 hour and 53 minutes</p>
    <p><strong>Affected Components:</strong> </p>
    &lt;p&gt;&lt;small&gt;Mar &lt;var data-var=&#039;date&#039;&gt; 27&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;03:47:23&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Investigating&lt;/strong&gt; -
  prod - prod.gcp-europe-west3-b cannot be accessed at the moment. This incident was created by an automated monitoring service..&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Mar &lt;var data-var=&#039;date&#039;&gt; 27&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;05:40:43&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Resolved&lt;/strong&gt; -
  This incident has been resolved..&lt;/p&gt;
]]>
  </content:encoded>
  <pubDate>Fri, 27 Mar 2026 03:47:23 +0000</pubDate>
  <link>https://status.vespa.ai/incident/cmn8d1meu04a2k9ymoajvolsc</link>
  <guid>https://status.vespa.ai/incident/cmn8d1meu04a2k9ymoajvolsc</guid>
</item>

<item>
  <title>New nodes can fail to provision -</title>
  <description>
    Type: Incident
    Duration: 6 hours and 33 minutes

    Affected Components: AWS, prod.aws-eu-west-1a, prod.aws-us-west-2a, perf.aws-us-east-1c, prod.aws-us-east-1c, test.aws-us-east-1c, dev.aws-euw1-az1, prod.aws-apne1-az1, prod.aws-cac1-az1, prod.aws-euw1-az1, staging.aws-us-east-1c, prod.aws-euc1-az1, prod.aws-ap-northeast-1a, prod.aws-aps1-az1, prod.aws-euc1-az3, prod.aws-use1-az4, prod.aws-cac1-az2, prod.aws-use2-az1, prod.aws-use2-az3, prod.aws-usw2-az3, dev.aws-us-east-1c
    Mar 6, 07:30:00 GMT+0 - Investigating - We have observed that new nodes are failing to provision.

**Existing nodes are unaffected.** Mar 6, 09:07:35 GMT+0 - Identified - We have identified the root cause and started working on a workaround. Mar 6, 10:06:58 GMT+0 - Identified - We are continuing to work on a fix for this incident, we have noticed failures in more zones for new hosts.

_Ticket updated with the new Zones._

**Existing nodes are unaffected, only provisioning of new nodes is impacted.** Mar 6, 10:35:34 GMT+0 - Identified - We have implemented a fix and it is currently rolling out fleet-wide. 

Provision of **new nodes** is still impacted, but we should resolve within 30 minutes, we will post an update as soon as possible, or by 11:00 UTC in any case.

**Existing nodes are not affected.** Mar 6, 11:09:03 GMT+0 - Identified - Rollout is still in progress, still impacting **new nodes on AWS**.

**Existing nodes are not impacted.** Mar 6, 11:43:09 GMT+0 - Identified - We have found an edge-case which has been slowing down the rollout, we&#039;re in the process of mitigating this issue.

For now **new hosts** are still impacted.

New update at 12:15 or earlier.

There is **no impact for existing nodes.** Mar 6, 12:47:19 GMT+0 - Monitoring - The rollout is compete and new nodes are able to provision. 

We are monitoring the situation and will post a final update later today. Mar 6, 14:03:22 GMT+0 - Resolved - This incident has been resolved. 
  </description>
  <content:encoded>
    <![CDATA[<p><strong>Type:</strong> Incident</p>
    <p><strong>Duration:</strong> 6 hours and 33 minutes</p>
    <p><strong>Affected Components:</strong> , , , , , , , , , , , , , , , , , , , , </p>
    &lt;p&gt;&lt;small&gt;Mar &lt;var data-var=&#039;date&#039;&gt; 6&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;07:30:00&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Investigating&lt;/strong&gt; -
  We have observed that new nodes are failing to provision.

**Existing nodes are unaffected.**.&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Mar &lt;var data-var=&#039;date&#039;&gt; 6&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;09:07:35&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Identified&lt;/strong&gt; -
  We have identified the root cause and started working on a workaround..&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Mar &lt;var data-var=&#039;date&#039;&gt; 6&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;10:06:58&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Identified&lt;/strong&gt; -
  We are continuing to work on a fix for this incident, we have noticed failures in more zones for new hosts.

_Ticket updated with the new Zones._

**Existing nodes are unaffected, only provisioning of new nodes is impacted.**.&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Mar &lt;var data-var=&#039;date&#039;&gt; 6&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;10:35:34&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Identified&lt;/strong&gt; -
  We have implemented a fix and it is currently rolling out fleet-wide. 

Provision of **new nodes** is still impacted, but we should resolve within 30 minutes, we will post an update as soon as possible, or by 11:00 UTC in any case.

**Existing nodes are not affected.**.&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Mar &lt;var data-var=&#039;date&#039;&gt; 6&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;11:09:03&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Identified&lt;/strong&gt; -
  Rollout is still in progress, still impacting **new nodes on AWS**.

**Existing nodes are not impacted.**.&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Mar &lt;var data-var=&#039;date&#039;&gt; 6&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;11:43:09&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Identified&lt;/strong&gt; -
  We have found an edge-case which has been slowing down the rollout, we&#039;re in the process of mitigating this issue.

For now **new hosts** are still impacted.

New update at 12:15 or earlier.

There is **no impact for existing nodes.**.&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Mar &lt;var data-var=&#039;date&#039;&gt; 6&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;12:47:19&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Monitoring&lt;/strong&gt; -
  The rollout is compete and new nodes are able to provision. 

We are monitoring the situation and will post a final update later today..&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Mar &lt;var data-var=&#039;date&#039;&gt; 6&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;14:03:22&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Resolved&lt;/strong&gt; -
  This incident has been resolved..&lt;/p&gt;
]]>
  </content:encoded>
  <pubDate>Fri, 6 Mar 2026 07:30:00 +0000</pubDate>
  <link>https://status.vespa.ai/incident/cmmepi8z4000d3xjzgbtmlg49</link>
  <guid>https://status.vespa.ai/incident/cmmepi8z4000d3xjzgbtmlg49</guid>
</item>

<item>
  <title>Issues with staging/system test deployments</title>
  <description>
    Type: Incident
    Duration: 22 days, 8 hours and 28 minutes

    Affected Components: staging.gcp-us-central1-f, test.aws-us-east-1c, staging.aws-us-east-1c, test.gcp-us-central1-f
    Mar 4, 23:15:00 GMT+0 - Identified - The root cause has been identified Mar 5, 05:45:00 GMT+0 - Monitoring - We deployed a fix and are currently monitoring the result. Mar 27, 07:43:29 GMT+0 - Resolved - This incident has been resolved. 
  </description>
  <content:encoded>
    <![CDATA[<p><strong>Type:</strong> Incident</p>
    <p><strong>Duration:</strong> 22 days, 8 hours and 28 minutes</p>
    <p><strong>Affected Components:</strong> , , , </p>
    &lt;p&gt;&lt;small&gt;Mar &lt;var data-var=&#039;date&#039;&gt; 4&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;23:15:00&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Identified&lt;/strong&gt; -
  The root cause has been identified.&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Mar &lt;var data-var=&#039;date&#039;&gt; 5&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;05:45:00&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Monitoring&lt;/strong&gt; -
  We deployed a fix and are currently monitoring the result..&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Mar &lt;var data-var=&#039;date&#039;&gt; 27&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;07:43:29&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Resolved&lt;/strong&gt; -
  This incident has been resolved..&lt;/p&gt;
]]>
  </content:encoded>
  <pubDate>Wed, 4 Mar 2026 23:15:00 +0000</pubDate>
  <link>https://status.vespa.ai/incident/cmmdbpczm02cpx7bgt52w6ujt</link>
  <guid>https://status.vespa.ai/incident/cmmdbpczm02cpx7bgt52w6ujt</guid>
</item>

<item>
  <title>Node provisioning is failing, impacting all test and staging test runs, and node changes in deployments</title>
  <description>
    Type: Incident
    Duration: 5 hours and 41 minutes

    Affected Components: Infrastructure
    Mar 4, 12:01:01 GMT+0 - Resolved - This incident has been resolved. Mar 4, 06:20:00 GMT+0 - Identified - We are investigating Mar 4, 10:41:18 GMT+0 - Identified - We are continuing to work on a fix for this incident.

We are currently testing an attempted mitigation Mar 4, 10:43:31 GMT+0 - Monitoring - We implemented a fix and are currently monitoring the result. Mar 4, 10:53:07 GMT+0 - Monitoring - We implemented a fix and are currently monitoring the result. 
  </description>
  <content:encoded>
    <![CDATA[<p><strong>Type:</strong> Incident</p>
    <p><strong>Duration:</strong> 5 hours and 41 minutes</p>
    <p><strong>Affected Components:</strong> </p>
    &lt;p&gt;&lt;small&gt;Mar &lt;var data-var=&#039;date&#039;&gt; 4&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;12:01:01&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Resolved&lt;/strong&gt; -
  This incident has been resolved..&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Mar &lt;var data-var=&#039;date&#039;&gt; 4&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;06:20:00&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Identified&lt;/strong&gt; -
  We are investigating.&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Mar &lt;var data-var=&#039;date&#039;&gt; 4&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;10:41:18&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Identified&lt;/strong&gt; -
  We are continuing to work on a fix for this incident.

We are currently testing an attempted mitigation.&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Mar &lt;var data-var=&#039;date&#039;&gt; 4&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;10:43:31&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Monitoring&lt;/strong&gt; -
  We implemented a fix and are currently monitoring the result..&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Mar &lt;var data-var=&#039;date&#039;&gt; 4&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;10:53:07&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Monitoring&lt;/strong&gt; -
  We implemented a fix and are currently monitoring the result..&lt;/p&gt;
]]>
  </content:encoded>
  <pubDate>Wed, 4 Mar 2026 06:20:00 +0000</pubDate>
  <link>https://status.vespa.ai/incident/cmmbs9mim00nl10ssrdpw94vi</link>
  <guid>https://status.vespa.ai/incident/cmmbs9mim00nl10ssrdpw94vi</guid>
</item>

<item>
  <title>Issues with staging/system test deployments</title>
  <description>
    Type: Incident
    Duration: 7 hours and 40 minutes

    Affected Components: test.aws-us-east-1c, staging.gcp-us-central1-f, staging.aws-us-east-1c, test.gcp-us-central1-f
    Mar 3, 23:15:00 GMT+0 - Investigating - There was a period where some staging and system test deployments failed. Mar 4, 06:55:00 GMT+0 - Resolved - The root cause has been identified and mitigated. 
  </description>
  <content:encoded>
    <![CDATA[<p><strong>Type:</strong> Incident</p>
    <p><strong>Duration:</strong> 7 hours and 40 minutes</p>
    <p><strong>Affected Components:</strong> , , , </p>
    &lt;p&gt;&lt;small&gt;Mar &lt;var data-var=&#039;date&#039;&gt; 3&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;23:15:00&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Investigating&lt;/strong&gt; -
  There was a period where some staging and system test deployments failed..&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Mar &lt;var data-var=&#039;date&#039;&gt; 4&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;06:55:00&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Resolved&lt;/strong&gt; -
  The root cause has been identified and mitigated..&lt;/p&gt;
]]>
  </content:encoded>
  <pubDate>Tue, 3 Mar 2026 23:15:00 +0000</pubDate>
  <link>https://status.vespa.ai/incident/cmmbwbt670n5p50p1wokttahl</link>
  <guid>https://status.vespa.ai/incident/cmmbwbt670n5p50p1wokttahl</guid>
</item>

<item>
  <title>Issues with staging/system test deployments</title>
  <description>
    Type: Incident
    Duration: 1 day and 1 hour

    Affected Components: test.aws-us-east-1c, staging.gcp-us-central1-f, staging.aws-us-east-1c, test.gcp-us-central1-f
    Feb 28, 14:00:00 GMT+0 - Investigating - There was a period where some staging and system test deployments failed. The root cause has been identified and fixed. Mar 1, 15:00:00 GMT+0 - Resolved - This incident has been resolved. 
  </description>
  <content:encoded>
    <![CDATA[<p><strong>Type:</strong> Incident</p>
    <p><strong>Duration:</strong> 1 day and 1 hour</p>
    <p><strong>Affected Components:</strong> , , , </p>
    &lt;p&gt;&lt;small&gt;Feb &lt;var data-var=&#039;date&#039;&gt; 28&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;14:00:00&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Investigating&lt;/strong&gt; -
  There was a period where some staging and system test deployments failed. The root cause has been identified and fixed..&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Mar &lt;var data-var=&#039;date&#039;&gt; 1&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;15:00:00&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Resolved&lt;/strong&gt; -
  This incident has been resolved..&lt;/p&gt;
]]>
  </content:encoded>
  <pubDate>Sat, 28 Feb 2026 14:00:00 +0000</pubDate>
  <link>https://status.vespa.ai/incident/cmm9dyv1w0af46l72zsgjqgfs</link>
  <guid>https://status.vespa.ai/incident/cmm9dyv1w0af46l72zsgjqgfs</guid>
</item>

<item>
  <title>Vespa Cloud Console Maintenance</title>
  <description>
    Type: Maintenance
    Duration: 12 minutes

    Affected Components: Console
    Feb 20, 11:00:01 GMT+0 - Identified - Maintenance is now in progress Feb 20, 11:11:58 GMT+0 - Completed - Maintenance has completed successfully. Feb 20, 11:00:00 GMT+0 - Identified - We are planning for a scheduled maintenance during that time.

No downtime is expected. 
  </description>
  <content:encoded>
    <![CDATA[<p><strong>Type:</strong> Maintenance</p>
    <p><strong>Duration:</strong> 12 minutes</p>
    <p><strong>Affected Components:</strong> </p>
    &lt;p&gt;&lt;small&gt;Feb &lt;var data-var=&#039;date&#039;&gt; 20&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;11:00:01&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Identified&lt;/strong&gt; -
  Maintenance is now in progress.&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Feb &lt;var data-var=&#039;date&#039;&gt; 20&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;11:11:58&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Completed&lt;/strong&gt; -
  Maintenance has completed successfully..&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Feb &lt;var data-var=&#039;date&#039;&gt; 20&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;11:00:00&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Identified&lt;/strong&gt; -
  We are planning for a scheduled maintenance during that time.

No downtime is expected..&lt;/p&gt;
]]>
  </content:encoded>
  <pubDate>Fri, 20 Feb 2026 11:00:00 +0000</pubDate>
  <link>https://status.vespa.ai/maintenance/cmlthtoio04qj24hsd6x76jaq</link>
  <guid>https://status.vespa.ai/maintenance/cmlthtoio04qj24hsd6x76jaq</guid>
</item>

<item>
  <title>Issues with new host provisioning</title>
  <description>
    Type: Incident
    Duration: 3 hours and 48 minutes

    Affected Components: AWS, prod.gcp-europe-west3-b, test.aws-us-east-1c, staging.gcp-us-central1-f, staging.aws-us-east-1c, prod.aws-eu-west-1a, prod.aws-us-west-2a, perf.aws-us-east-1c, GCP, Infrastructure, prod.aws-us-east-1c, prod.gcp-us-central1-f, test.gcp-us-central1-f, dev.aws-us-east-1c, dev.gcp-us-central1-f, Console
    Feb 10, 11:28:07 GMT+0 - Investigating - We are experiencing a technical issue that is impacting provisioning of new Vespa hosts. Provisioning requests may fail or be delayed while we work to resolve the problem.  
  
**Existing deployments remain unaffected.**  
  
We are currently investigating this incident. Feb 10, 12:39:50 GMT+0 - Identified - We have identified the root cause and are taking the necessary steps to resolve the issue. Feb 10, 12:59:35 GMT+0 - Monitoring - We implemented a fix and are currently monitoring the result. Feb 10, 15:15:59 GMT+0 - Resolved - This incident has been resolved. 
  </description>
  <content:encoded>
    <![CDATA[<p><strong>Type:</strong> Incident</p>
    <p><strong>Duration:</strong> 3 hours and 48 minutes</p>
    <p><strong>Affected Components:</strong> , , , , , , , , , , , , , , , </p>
    &lt;p&gt;&lt;small&gt;Feb &lt;var data-var=&#039;date&#039;&gt; 10&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;11:28:07&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Investigating&lt;/strong&gt; -
  We are experiencing a technical issue that is impacting provisioning of new Vespa hosts. Provisioning requests may fail or be delayed while we work to resolve the problem.  
  
**Existing deployments remain unaffected.**  
  
We are currently investigating this incident..&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Feb &lt;var data-var=&#039;date&#039;&gt; 10&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;12:39:50&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Identified&lt;/strong&gt; -
  We have identified the root cause and are taking the necessary steps to resolve the issue..&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Feb &lt;var data-var=&#039;date&#039;&gt; 10&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;12:59:35&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Monitoring&lt;/strong&gt; -
  We implemented a fix and are currently monitoring the result..&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Feb &lt;var data-var=&#039;date&#039;&gt; 10&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;15:15:59&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Resolved&lt;/strong&gt; -
  This incident has been resolved..&lt;/p&gt;
]]>
  </content:encoded>
  <pubDate>Tue, 10 Feb 2026 11:28:07 +0000</pubDate>
  <link>https://status.vespa.ai/incident/cmlgiost217l05p7vd6jowrgy</link>
  <guid>https://status.vespa.ai/incident/cmlgiost217l05p7vd6jowrgy</guid>
</item>

<item>
  <title>Vespa Cloud Console Slow or Unavailable</title>
  <description>
    Type: Incident
    Duration: 43 minutes

    Affected Components: Console
    Feb 5, 20:45:00 GMT+0 - Investigating - We are aware of slowdowns and downtime in the Vespa Console, we are currently investigating this incident. Feb 5, 21:07:46 GMT+0 - Identified - We have identified the issue and are working on a workaround. Feb 5, 21:28:21 GMT+0 - Resolved - This incident has been resolved, we have had a misconfiguration in autoscaling which prevented an immediate automatic resolution. 

We have implemented a workaround and will implement a permanent fix in the next days. 
  </description>
  <content:encoded>
    <![CDATA[<p><strong>Type:</strong> Incident</p>
    <p><strong>Duration:</strong> 43 minutes</p>
    <p><strong>Affected Components:</strong> </p>
    &lt;p&gt;&lt;small&gt;Feb &lt;var data-var=&#039;date&#039;&gt; 5&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;20:45:00&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Investigating&lt;/strong&gt; -
  We are aware of slowdowns and downtime in the Vespa Console, we are currently investigating this incident..&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Feb &lt;var data-var=&#039;date&#039;&gt; 5&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;21:07:46&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Identified&lt;/strong&gt; -
  We have identified the issue and are working on a workaround..&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Feb &lt;var data-var=&#039;date&#039;&gt; 5&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;21:28:21&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Resolved&lt;/strong&gt; -
  This incident has been resolved, we have had a misconfiguration in autoscaling which prevented an immediate automatic resolution. 

We have implemented a workaround and will implement a permanent fix in the next days..&lt;/p&gt;
]]>
  </content:encoded>
  <pubDate>Thu, 5 Feb 2026 20:45:00 +0000</pubDate>
  <link>https://status.vespa.ai/incident/cml9y5r7v00033m8w7z1ezl9u</link>
  <guid>https://status.vespa.ai/incident/cml9y5r7v00033m8w7z1ezl9u</guid>
</item>

<item>
  <title>Missing metrics from GCP and enclave</title>
  <description>
    Type: Incident
    Duration: 39 minutes

    Affected Components: Console
    Jan 17, 09:52:58 GMT+0 - Investigating - The metrics shown in console are incomplete for applications running in GCP and enclave.

We are currently investigating this incident. Jan 17, 10:16:09 GMT+0 - Monitoring - We implemented a fix and are currently monitoring the result. Jan 17, 10:31:32 GMT+0 - Resolved - This incident has been resolved. 
  </description>
  <content:encoded>
    <![CDATA[<p><strong>Type:</strong> Incident</p>
    <p><strong>Duration:</strong> 39 minutes</p>
    <p><strong>Affected Components:</strong> </p>
    &lt;p&gt;&lt;small&gt;Jan &lt;var data-var=&#039;date&#039;&gt; 17&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;09:52:58&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Investigating&lt;/strong&gt; -
  The metrics shown in console are incomplete for applications running in GCP and enclave.

We are currently investigating this incident..&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Jan &lt;var data-var=&#039;date&#039;&gt; 17&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;10:16:09&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Monitoring&lt;/strong&gt; -
  We implemented a fix and are currently monitoring the result..&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Jan &lt;var data-var=&#039;date&#039;&gt; 17&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;10:31:32&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Resolved&lt;/strong&gt; -
  This incident has been resolved..&lt;/p&gt;
]]>
  </content:encoded>
  <pubDate>Sat, 17 Jan 2026 09:52:58 +0000</pubDate>
  <link>https://status.vespa.ai/incident/cmki4pzur073e8nn6utsrf1x3</link>
  <guid>https://status.vespa.ai/incident/cmki4pzur073e8nn6utsrf1x3</guid>
</item>

<item>
  <title>Missing Metrics for GCP and Enclave Accounts</title>
  <description>
    Type: Incident
    Duration: 8 hours and 39 minutes

    Affected Components: prod.gcp-europe-west3-b, staging.gcp-us-central1-f, GCP, prod.gcp-us-central1-f, test.gcp-us-central1-f
    Jan 4, 12:20:00 GMT+0 - Investigating - We are currently investigating this incident. Jan 4, 19:57:49 GMT+0 - Monitoring - We have applied a fix and are currently monitoring the result. Jan 4, 20:58:36 GMT+0 - Resolved - This incident has been resolved. 
  </description>
  <content:encoded>
    <![CDATA[<p><strong>Type:</strong> Incident</p>
    <p><strong>Duration:</strong> 8 hours and 39 minutes</p>
    <p><strong>Affected Components:</strong> , , , , </p>
    &lt;p&gt;&lt;small&gt;Jan &lt;var data-var=&#039;date&#039;&gt; 4&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;12:20:00&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Investigating&lt;/strong&gt; -
  We are currently investigating this incident..&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Jan &lt;var data-var=&#039;date&#039;&gt; 4&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;19:57:49&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Monitoring&lt;/strong&gt; -
  We have applied a fix and are currently monitoring the result..&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Jan &lt;var data-var=&#039;date&#039;&gt; 4&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;20:58:36&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Resolved&lt;/strong&gt; -
  This incident has been resolved..&lt;/p&gt;
]]>
  </content:encoded>
  <pubDate>Sun, 4 Jan 2026 12:20:00 +0000</pubDate>
  <link>https://status.vespa.ai/incident/cmk03c8690123et5dbqlkmarl</link>
  <guid>https://status.vespa.ai/incident/cmk03c8690123et5dbqlkmarl</guid>
</item>

<item>
  <title>Missing Metrics for GCP and Enclave (All)</title>
  <description>
    Type: Incident
    Duration: 5 days and 30 minutes

    Affected Components: AWS, prod.gcp-europe-west3-b, staging.gcp-us-central1-f, GCP, prod.gcp-us-central1-f, dev.gcp-us-central1-f
    Dec 12, 11:09:00 GMT+0 - Investigating - We identified an issue which is preventing metrics to be published to our systems.. We are investigating the issue. Dec 17, 11:39:08 GMT+0 - Resolved - This incident has been resolved. Dec 16, 10:24:22 GMT+0 - Identified - The first attempts to resolve this failed  
We are continuing to work on a fix for this incident. Dec 12, 15:00:00 GMT+0 - Monitoring - We implemented a fix and are currently monitoring the progress. Dec 16, 16:47:27 GMT+0 - Monitoring - We have applied a fix and are currently monitoring the result. 
  </description>
  <content:encoded>
    <![CDATA[<p><strong>Type:</strong> Incident</p>
    <p><strong>Duration:</strong> 5 days and 30 minutes</p>
    <p><strong>Affected Components:</strong> , , , , , </p>
    &lt;p&gt;&lt;small&gt;Dec &lt;var data-var=&#039;date&#039;&gt; 12&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;11:09:00&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Investigating&lt;/strong&gt; -
  We identified an issue which is preventing metrics to be published to our systems.. We are investigating the issue..&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Dec &lt;var data-var=&#039;date&#039;&gt; 17&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;11:39:08&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Resolved&lt;/strong&gt; -
  This incident has been resolved..&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Dec &lt;var data-var=&#039;date&#039;&gt; 16&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;10:24:22&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Identified&lt;/strong&gt; -
  The first attempts to resolve this failed  
We are continuing to work on a fix for this incident..&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Dec &lt;var data-var=&#039;date&#039;&gt; 12&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;15:00:00&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Monitoring&lt;/strong&gt; -
  We implemented a fix and are currently monitoring the progress..&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Dec &lt;var data-var=&#039;date&#039;&gt; 16&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;16:47:27&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Monitoring&lt;/strong&gt; -
  We have applied a fix and are currently monitoring the result..&lt;/p&gt;
]]>
  </content:encoded>
  <pubDate>Fri, 12 Dec 2025 11:09:00 +0000</pubDate>
  <link>https://status.vespa.ai/incident/cmj32ve7r070j12dnedon30sv</link>
  <guid>https://status.vespa.ai/incident/cmj32ve7r070j12dnedon30sv</guid>
</item>

<item>
  <title>Temporary downtime of sign in on Vespa Cloud Console</title>
  <description>
    Type: Maintenance
    Duration: 30 minutes

    Affected Components: Console
    Dec 9, 13:00:00 GMT+0 - Identified - We are preparing to perform maintenance on the sign-in functionality on the Vespa Cloud Console. Sign in functionality may be sporadically unavailable for up to 30 minutes. This will affect only the control plane login, data plane authentication will remain functional during this maintenance window. Dec 9, 13:00:01 GMT+0 - Identified - Maintenance is now in progress Dec 9, 13:30:00 GMT+0 - Completed - Maintenance has completed successfully 
  </description>
  <content:encoded>
    <![CDATA[<p><strong>Type:</strong> Maintenance</p>
    <p><strong>Duration:</strong> 30 minutes</p>
    <p><strong>Affected Components:</strong> </p>
    &lt;p&gt;&lt;small&gt;Dec &lt;var data-var=&#039;date&#039;&gt; 9&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;13:00:00&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Identified&lt;/strong&gt; -
  We are preparing to perform maintenance on the sign-in functionality on the Vespa Cloud Console. Sign in functionality may be sporadically unavailable for up to 30 minutes. This will affect only the control plane login, data plane authentication will remain functional during this maintenance window..&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Dec &lt;var data-var=&#039;date&#039;&gt; 9&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;13:00:01&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Identified&lt;/strong&gt; -
  Maintenance is now in progress.&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Dec &lt;var data-var=&#039;date&#039;&gt; 9&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;13:30:00&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Completed&lt;/strong&gt; -
  Maintenance has completed successfully.&lt;/p&gt;
]]>
  </content:encoded>
  <pubDate>Tue, 9 Dec 2025 13:00:00 +0000</pubDate>
  <link>https://status.vespa.ai/maintenance/cmiyl2l2d07k9c8n9oaf29fu3</link>
  <guid>https://status.vespa.ai/maintenance/cmiyl2l2d07k9c8n9oaf29fu3</guid>
</item>

<item>
  <title>AWS experiences issues in us-east-1</title>
  <description>
    Type: Incident
    Duration: 23 hours and 36 minutes

    Affected Components: AWS, dev.aws-us-east-1c, test.aws-us-east-1c, staging.aws-us-east-1c, perf.aws-us-east-1c, Infrastructure, prod.aws-us-east-1c
    Oct 20, 07:11:00 GMT+0 - Identified - Track status on &lt;https://health.aws.amazon.com/health/status&gt;

Existing applications are not affected by outage.

Only maintenance operations are degraded. Oct 20, 10:26:36 GMT+0 - Monitoring - Infrastructure services restored, we will continue to monitor the situation for any residual issues. Oct 20, 16:50:39 GMT+0 - Monitoring - We are still experiencing the failures with provisioning new hosts on AWS us-east region.

Therefore, we recommend to avoid applying changes to the applications on this region until the issue is resolved on AWS side.  Oct 20, 20:58:27 GMT+0 - Monitoring - Infrastructure services are now opertional. We continue to monitor our system performance to detect residual issues. Oct 21, 06:47:23 GMT+0 - Resolved - This incident has been resolved. 
  </description>
  <content:encoded>
    <![CDATA[<p><strong>Type:</strong> Incident</p>
    <p><strong>Duration:</strong> 23 hours and 36 minutes</p>
    <p><strong>Affected Components:</strong> , , , , , , </p>
    &lt;p&gt;&lt;small&gt;Oct &lt;var data-var=&#039;date&#039;&gt; 20&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;07:11:00&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Identified&lt;/strong&gt; -
  Track status on &lt;https://health.aws.amazon.com/health/status&gt;

Existing applications are not affected by outage.

Only maintenance operations are degraded..&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Oct &lt;var data-var=&#039;date&#039;&gt; 20&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;10:26:36&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Monitoring&lt;/strong&gt; -
  Infrastructure services restored, we will continue to monitor the situation for any residual issues..&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Oct &lt;var data-var=&#039;date&#039;&gt; 20&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;16:50:39&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Monitoring&lt;/strong&gt; -
  We are still experiencing the failures with provisioning new hosts on AWS us-east region.

Therefore, we recommend to avoid applying changes to the applications on this region until the issue is resolved on AWS side. .&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Oct &lt;var data-var=&#039;date&#039;&gt; 20&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;20:58:27&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Monitoring&lt;/strong&gt; -
  Infrastructure services are now opertional. We continue to monitor our system performance to detect residual issues..&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Oct &lt;var data-var=&#039;date&#039;&gt; 21&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;06:47:23&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Resolved&lt;/strong&gt; -
  This incident has been resolved..&lt;/p&gt;
]]>
  </content:encoded>
  <pubDate>Mon, 20 Oct 2025 07:11:00 +0000</pubDate>
  <link>https://status.vespa.ai/incident/cmgytgo3p00mlmx24ihc87kdx</link>
  <guid>https://status.vespa.ai/incident/cmgytgo3p00mlmx24ihc87kdx</guid>
</item>

<item>
  <title>Issues with metric dashboards in Vespa Console</title>
  <description>
    Type: Incident
    Duration: 3 hours and 13 minutes

    Affected Components: Console
    Aug 22, 15:08:28 GMT+0 - Resolved - This incident on Grafana is still open, but we don&#039;t observe any effect on our side. Aug 22, 11:55:00 GMT+0 - Monitoring - We have identified an issue in our vespa Console, when clicking on &quot;Metrics&quot; for an application we you might experience &quot;Failed to load dashboard - Internal Server Error&quot; This is caused by an outage in Grafana, for more details please refer to \[the Grafana Status Page\](https://status.grafana.com/incidents/z42xrjqydny8) updates. 
  </description>
  <content:encoded>
    <![CDATA[<p><strong>Type:</strong> Incident</p>
    <p><strong>Duration:</strong> 3 hours and 13 minutes</p>
    <p><strong>Affected Components:</strong> </p>
    &lt;p&gt;&lt;small&gt;Aug &lt;var data-var=&#039;date&#039;&gt; 22&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;15:08:28&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Resolved&lt;/strong&gt; -
  This incident on Grafana is still open, but we don&#039;t observe any effect on our side..&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Aug &lt;var data-var=&#039;date&#039;&gt; 22&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;11:55:00&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Monitoring&lt;/strong&gt; -
  We have identified an issue in our vespa Console, when clicking on &quot;Metrics&quot; for an application we you might experience &quot;Failed to load dashboard - Internal Server Error&quot; This is caused by an outage in Grafana, for more details please refer to \[the Grafana Status Page\](https://status.grafana.com/incidents/z42xrjqydny8) updates..&lt;/p&gt;
]]>
  </content:encoded>
  <pubDate>Fri, 22 Aug 2025 11:55:00 +0000</pubDate>
  <link>https://status.vespa.ai/incident/cmems9mnk0001107un22ahtkn</link>
  <guid>https://status.vespa.ai/incident/cmems9mnk0001107un22ahtkn</guid>
</item>

<item>
  <title>Provisioning new nodes might fail</title>
  <description>
    Type: Incident
    Duration: 1 hour and 12 minutes

    Affected Components: perf.aws-us-east-1c, test.gcp-us-central1-f, prod.aws-us-east-1c, prod.gcp-europe-west3-b, prod.gcp-us-central1-f, staging.gcp-us-central1-f, test.aws-us-east-1c, staging.aws-us-east-1c, dev.aws-us-east-1c, , prod.aws-eu-west-1a, prod.aws-us-west-2a, dev.gcp-us-central1-f, 
Zones →
    Jul 2, 06:31:58 GMT+0 - Investigating - We are currently investigating this incident. Jul 2, 06:47:51 GMT+0 - Identified - We have identified the root cause and we are applying a mitigation to allow nodes to be provisioned. Jul 2, 07:00:57 GMT+0 - Monitoring - Workaround is in place, so it should be possible to provision new nodes.

If you encounter issues don&#039;t hesitate to contact support. Jul 2, 07:43:51 GMT+0 - Resolved - This incident has been resolved. 
  </description>
  <content:encoded>
    <![CDATA[<p><strong>Type:</strong> Incident</p>
    <p><strong>Duration:</strong> 1 hour and 12 minutes</p>
    <p><strong>Affected Components:</strong> , , , , , , , , , , , , </p>
    &lt;p&gt;&lt;small&gt;Jul &lt;var data-var=&#039;date&#039;&gt; 2&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;06:31:58&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Investigating&lt;/strong&gt; -
  We are currently investigating this incident..&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Jul &lt;var data-var=&#039;date&#039;&gt; 2&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;06:47:51&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Identified&lt;/strong&gt; -
  We have identified the root cause and we are applying a mitigation to allow nodes to be provisioned..&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Jul &lt;var data-var=&#039;date&#039;&gt; 2&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;07:00:57&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Monitoring&lt;/strong&gt; -
  Workaround is in place, so it should be possible to provision new nodes.

If you encounter issues don&#039;t hesitate to contact support..&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Jul &lt;var data-var=&#039;date&#039;&gt; 2&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;07:43:51&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Resolved&lt;/strong&gt; -
  This incident has been resolved..&lt;/p&gt;
]]>
  </content:encoded>
  <pubDate>Wed, 2 Jul 2025 06:31:58 +0000</pubDate>
  <link>https://status.vespa.ai/incident/cmclkwzow01fxt1chtevzvasm</link>
  <guid>https://status.vespa.ai/incident/cmclkwzow01fxt1chtevzvasm</guid>
</item>

<item>
  <title>Metrics dashboard not working for GCP and enclave applications</title>
  <description>
    Type: Incident
    Duration: 1 hour and 1 minute

    Affected Components: Console
    Jun 26, 12:17:20 GMT+0 - Investigating - New data will not be populated in the dashboard, while historical data is still visible.  
We are currently investigating this incident.   Jun 26, 13:18:09 GMT+0 - Resolved - This incident has been resolved. 
  </description>
  <content:encoded>
    <![CDATA[<p><strong>Type:</strong> Incident</p>
    <p><strong>Duration:</strong> 1 hour and 1 minute</p>
    <p><strong>Affected Components:</strong> </p>
    &lt;p&gt;&lt;small&gt;Jun &lt;var data-var=&#039;date&#039;&gt; 26&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;12:17:20&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Investigating&lt;/strong&gt; -
  New data will not be populated in the dashboard, while historical data is still visible.  
We are currently investigating this incident.  .&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Jun &lt;var data-var=&#039;date&#039;&gt; 26&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;13:18:09&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Resolved&lt;/strong&gt; -
  This incident has been resolved..&lt;/p&gt;
]]>
  </content:encoded>
  <pubDate>Thu, 26 Jun 2025 12:17:20 +0000</pubDate>
  <link>https://status.vespa.ai/incident/cmcdcm03p002f7gde7sg7nl6g</link>
  <guid>https://status.vespa.ai/incident/cmcdcm03p002f7gde7sg7nl6g</guid>
</item>

<item>
  <title>The vespa release rolled out today, vespa-8.534.59, introduced an issue affecting applications with containers running embedders</title>
  <description>
    Type: Incident
    Duration: 14 hours and 10 minutes

    Affected Components: Infrastructure
    Jun 16, 08:30:00 GMT+0 - Identified - Impact: \* Any application changes will fail to be successfully deployed \* Autoscaling: New nodes added to such container clusters will fail to start We have implemented a fix that we currently are testing \[Embedding Reference\](https://docs.vespa.ai/en/reference/embedding-reference.html) Jun 16, 14:54:51 GMT+0 - Identified - We are continuing to work on a fix for this incident. Jun 16, 21:29:16 GMT+0 - Monitoring - We have implemented a fix and created a new release, which is now being rolled out across our infrastructure. Once the deployment is complete, the issue reported in this incident will be considered resolved. Jun 16, 22:40:06 GMT+0 - Resolved - This incident has been resolved. 
  </description>
  <content:encoded>
    <![CDATA[<p><strong>Type:</strong> Incident</p>
    <p><strong>Duration:</strong> 14 hours and 10 minutes</p>
    <p><strong>Affected Components:</strong> </p>
    &lt;p&gt;&lt;small&gt;Jun &lt;var data-var=&#039;date&#039;&gt; 16&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;08:30:00&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Identified&lt;/strong&gt; -
  Impact: \* Any application changes will fail to be successfully deployed \* Autoscaling: New nodes added to such container clusters will fail to start We have implemented a fix that we currently are testing \[Embedding Reference\](https://docs.vespa.ai/en/reference/embedding-reference.html).&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Jun &lt;var data-var=&#039;date&#039;&gt; 16&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;14:54:51&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Identified&lt;/strong&gt; -
  We are continuing to work on a fix for this incident..&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Jun &lt;var data-var=&#039;date&#039;&gt; 16&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;21:29:16&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Monitoring&lt;/strong&gt; -
  We have implemented a fix and created a new release, which is now being rolled out across our infrastructure. Once the deployment is complete, the issue reported in this incident will be considered resolved..&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Jun &lt;var data-var=&#039;date&#039;&gt; 16&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;22:40:06&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Resolved&lt;/strong&gt; -
  This incident has been resolved..&lt;/p&gt;
]]>
  </content:encoded>
  <pubDate>Mon, 16 Jun 2025 08:30:00 +0000</pubDate>
  <link>https://status.vespa.ai/incident/cmbz7ph1i000gq87zjzk79lst</link>
  <guid>https://status.vespa.ai/incident/cmbz7ph1i000gq87zjzk79lst</guid>
</item>

<item>
  <title>Performance regression on release 8.528.12</title>
  <description>
    Type: Incident
    Duration: 3 hours and 23 minutes

    Affected Components: perf.aws-us-east-1c, test.gcp-us-central1-f, prod.aws-us-east-1c, prod.gcp-europe-west3-b, prod.gcp-us-central1-f, staging.gcp-us-central1-f, test.aws-us-east-1c, staging.aws-us-east-1c, dev.aws-us-east-1c, , prod.aws-eu-west-1a, prod.aws-us-west-2a, dev.gcp-us-central1-f, 
Zones →
    Jun 3, 11:36:20 GMT+0 - Investigating - We are have identified a regression on the vespa release 8.528.12. Jun 3, 11:47:59 GMT+0 - Identified - All the upgrades in Vespa Cloud are being stopped and any application already upgraded will be automatically downgraded. Jun 3, 12:17:43 GMT+0 - Monitoring - All production applications have been rolled back the the previous version, there should not be any impact at the current moment.  
  
We will be monitoring the situation for a while. Jun 3, 14:59:40 GMT+0 - Resolved - We don&#039;t see any further impact.  
Please don&#039;t hesitate to contact our support through the Vespa Cloud panel if you still experience any disruption. 
  </description>
  <content:encoded>
    <![CDATA[<p><strong>Type:</strong> Incident</p>
    <p><strong>Duration:</strong> 3 hours and 23 minutes</p>
    <p><strong>Affected Components:</strong> , , , , , , , , , , , , </p>
    &lt;p&gt;&lt;small&gt;Jun &lt;var data-var=&#039;date&#039;&gt; 3&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;11:36:20&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Investigating&lt;/strong&gt; -
  We are have identified a regression on the vespa release 8.528.12..&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Jun &lt;var data-var=&#039;date&#039;&gt; 3&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;11:47:59&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Identified&lt;/strong&gt; -
  All the upgrades in Vespa Cloud are being stopped and any application already upgraded will be automatically downgraded..&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Jun &lt;var data-var=&#039;date&#039;&gt; 3&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;12:17:43&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Monitoring&lt;/strong&gt; -
  All production applications have been rolled back the the previous version, there should not be any impact at the current moment.  
  
We will be monitoring the situation for a while..&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Jun &lt;var data-var=&#039;date&#039;&gt; 3&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;14:59:40&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Resolved&lt;/strong&gt; -
  We don&#039;t see any further impact.  
Please don&#039;t hesitate to contact our support through the Vespa Cloud panel if you still experience any disruption..&lt;/p&gt;
]]>
  </content:encoded>
  <pubDate>Tue, 3 Jun 2025 11:36:20 +0000</pubDate>
  <link>https://status.vespa.ai/incident/cmbgg0p79000equffv437p932</link>
  <guid>https://status.vespa.ai/incident/cmbgg0p79000equffv437p932</guid>
</item>

<item>
  <title>Issues new deployments in Dev zones</title>
  <description>
    Type: Incident
    Duration: 12 hours and 47 minutes

    Affected Components: dev.aws-us-east-1c, dev.gcp-us-central1-f
    May 22, 22:17:00 GMT+0 - Resolved - This incident has been resolved. May 22, 20:30:00 GMT+0 - Investigating - We are currently investigating an incident affecting new deployments in Dev. May 22, 20:58:04 GMT+0 - Identified - We identified the root of the problem and it is affecting only a subset of hosts.  
  
We are working on a fix. May 22, 22:10:22 GMT+0 - Monitoring - We have resolved the issue that caused some deployments to fail 
  </description>
  <content:encoded>
    <![CDATA[<p><strong>Type:</strong> Incident</p>
    <p><strong>Duration:</strong> 12 hours and 47 minutes</p>
    <p><strong>Affected Components:</strong> , </p>
    &lt;p&gt;&lt;small&gt;May &lt;var data-var=&#039;date&#039;&gt; 22&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;22:17:00&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Resolved&lt;/strong&gt; -
  This incident has been resolved..&lt;/p&gt;
&lt;p&gt;&lt;small&gt;May &lt;var data-var=&#039;date&#039;&gt; 22&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;20:30:00&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Investigating&lt;/strong&gt; -
  We are currently investigating an incident affecting new deployments in Dev..&lt;/p&gt;
&lt;p&gt;&lt;small&gt;May &lt;var data-var=&#039;date&#039;&gt; 22&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;20:58:04&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Identified&lt;/strong&gt; -
  We identified the root of the problem and it is affecting only a subset of hosts.  
  
We are working on a fix..&lt;/p&gt;
&lt;p&gt;&lt;small&gt;May &lt;var data-var=&#039;date&#039;&gt; 22&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;22:10:22&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Monitoring&lt;/strong&gt; -
  We have resolved the issue that caused some deployments to fail.&lt;/p&gt;
]]>
  </content:encoded>
  <pubDate>Thu, 22 May 2025 20:30:00 +0000</pubDate>
  <link>https://status.vespa.ai/incident/cmazula79001311nk2jb9tsn7</link>
  <guid>https://status.vespa.ai/incident/cmazula79001311nk2jb9tsn7</guid>
</item>

<item>
  <title>Provisioning failures in dev.aws-us-east-1c</title>
  <description>
    Type: Incident
    Duration: 23 hours and 29 minutes

    Affected Components: dev.aws-us-east-1c
    Apr 21, 11:57:00 GMT+0 - Investigating - Due to increased demand, we are seeing failures in launching instances for new tenants. We are currently investigating this incident. Apr 22, 08:52:23 GMT+0 - Monitoring - We have identified the issue and increased the limits so new tenants should start working. We are now monitoring to confirm that this resolves the issue. Apr 22, 11:25:49 GMT+0 - Resolved - This incident has been resolved. 
  </description>
  <content:encoded>
    <![CDATA[<p><strong>Type:</strong> Incident</p>
    <p><strong>Duration:</strong> 23 hours and 29 minutes</p>
    <p><strong>Affected Components:</strong> </p>
    &lt;p&gt;&lt;small&gt;Apr &lt;var data-var=&#039;date&#039;&gt; 21&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;11:57:00&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Investigating&lt;/strong&gt; -
  Due to increased demand, we are seeing failures in launching instances for new tenants. We are currently investigating this incident..&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Apr &lt;var data-var=&#039;date&#039;&gt; 22&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;08:52:23&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Monitoring&lt;/strong&gt; -
  We have identified the issue and increased the limits so new tenants should start working. We are now monitoring to confirm that this resolves the issue..&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Apr &lt;var data-var=&#039;date&#039;&gt; 22&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;11:25:49&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Resolved&lt;/strong&gt; -
  This incident has been resolved..&lt;/p&gt;
]]>
  </content:encoded>
  <pubDate>Mon, 21 Apr 2025 11:57:00 +0000</pubDate>
  <link>https://status.vespa.ai/incident/cm9s8b72e004lh2rii8i6frg5</link>
  <guid>https://status.vespa.ai/incident/cm9s8b72e004lh2rii8i6frg5</guid>
</item>

<item>
  <title>Missing metrics from on GCP and Enclave</title>
  <description>
    Type: Incident
    Duration: 4 hours and 20 minutes

    Affected Components: staging.gcp-us-central1-f, dev.gcp-us-central1-f, test.gcp-us-central1-f, prod.gcp-europe-west3-b, prod.gcp-us-central1-f, AWS, GCP
    Apr 8, 08:16:44 GMT+0 - Identified - We have identified one problem with our telemetry gateway and are working on a fix. Apr 8, 07:36:26 GMT+0 - Investigating - We are currently investigating this incident. Apr 8, 09:19:15 GMT+0 - Monitoring - We have applied a workaround and we see the data metrics flowing back in our systems. 

We are now monitoring the situation. Apr 8, 11:56:01 GMT+0 - Resolved - We can confirm that all the systems have been successfully working since our workaround is applied and the final fix has been applied. 
  </description>
  <content:encoded>
    <![CDATA[<p><strong>Type:</strong> Incident</p>
    <p><strong>Duration:</strong> 4 hours and 20 minutes</p>
    <p><strong>Affected Components:</strong> , , , , , , </p>
    &lt;p&gt;&lt;small&gt;Apr &lt;var data-var=&#039;date&#039;&gt; 8&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;08:16:44&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Identified&lt;/strong&gt; -
  We have identified one problem with our telemetry gateway and are working on a fix..&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Apr &lt;var data-var=&#039;date&#039;&gt; 8&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;07:36:26&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Investigating&lt;/strong&gt; -
  We are currently investigating this incident..&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Apr &lt;var data-var=&#039;date&#039;&gt; 8&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;09:19:15&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Monitoring&lt;/strong&gt; -
  We have applied a workaround and we see the data metrics flowing back in our systems. 

We are now monitoring the situation..&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Apr &lt;var data-var=&#039;date&#039;&gt; 8&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;11:56:01&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Resolved&lt;/strong&gt; -
  We can confirm that all the systems have been successfully working since our workaround is applied and the final fix has been applied..&lt;/p&gt;
]]>
  </content:encoded>
  <pubDate>Tue, 8 Apr 2025 07:36:26 +0000</pubDate>
  <link>https://status.vespa.ai/incident/cm986shm0008qsp4flqbc6ms6</link>
  <guid>https://status.vespa.ai/incident/cm986shm0008qsp4flqbc6ms6</guid>
</item>

<item>
  <title>Metrics view in application console unavailable due to Grafana incident with AWS</title>
  <description>
    Type: Incident
    Duration: 3 hours and 39 minutes

    Affected Components: Console
    Feb 18, 08:43:00 GMT+0 - Identified - We are monitoring the progress via &lt;https://status.grafana.com/&gt; Feb 18, 12:21:43 GMT+0 - Resolved - The part of the Grafana incident that had an impact on the rendring of the metrics in the Vespa Cloud console has been resolved 
  </description>
  <content:encoded>
    <![CDATA[<p><strong>Type:</strong> Incident</p>
    <p><strong>Duration:</strong> 3 hours and 39 minutes</p>
    <p><strong>Affected Components:</strong> </p>
    &lt;p&gt;&lt;small&gt;Feb &lt;var data-var=&#039;date&#039;&gt; 18&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;08:43:00&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Identified&lt;/strong&gt; -
  We are monitoring the progress via &lt;https://status.grafana.com/&gt;.&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Feb &lt;var data-var=&#039;date&#039;&gt; 18&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;12:21:43&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Resolved&lt;/strong&gt; -
  The part of the Grafana incident that had an impact on the rendring of the metrics in the Vespa Cloud console has been resolved.&lt;/p&gt;
]]>
  </content:encoded>
  <pubDate>Tue, 18 Feb 2025 08:43:00 +0000</pubDate>
  <link>https://status.vespa.ai/incident/cm7act6cx002om2eggsyn4fwt</link>
  <guid>https://status.vespa.ai/incident/cm7act6cx002om2eggsyn4fwt</guid>
</item>

<item>
  <title>New deployments, node increase, and replacements might fail in prod.gcp-europe-west3-b</title>
  <description>
    Type: Incident
    Duration: 5 hours and 48 minutes

    Affected Components: prod.gcp-europe-west3-b
    Oct 7, 08:00:00 GMT+0 - Investigating - We have identified that some deployments are fail in the `prod.gcp-europe-west3-b` zone, we are investigating the issue. Oct 7, 09:00:00 GMT+0 - Identified - We have identified the source of the issue being one of the Quota limits in GCP.

The team has been working with Google Cloud Platform (GCP) to increase quotas. Oct 7, 12:40:44 GMT+0 - Identified - We are still waiting from Google Cloud Platform to update our quota for the affected Zone.

**Note:**

This incident has **no impact on application performances**.  
Only _new applications and deployments_ with large local storage _might_ be affected. Oct 7, 13:47:34 GMT+0 - Resolved - We have received confirmation from the Google Compute Platform (GCP) that quotas on our account have been updated, this issue has now been be resolved. 
  </description>
  <content:encoded>
    <![CDATA[<p><strong>Type:</strong> Incident</p>
    <p><strong>Duration:</strong> 5 hours and 48 minutes</p>
    <p><strong>Affected Components:</strong> </p>
    &lt;p&gt;&lt;small&gt;Oct &lt;var data-var=&#039;date&#039;&gt; 7&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;08:00:00&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Investigating&lt;/strong&gt; -
  We have identified that some deployments are fail in the `prod.gcp-europe-west3-b` zone, we are investigating the issue..&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Oct &lt;var data-var=&#039;date&#039;&gt; 7&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;09:00:00&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Identified&lt;/strong&gt; -
  We have identified the source of the issue being one of the Quota limits in GCP.

The team has been working with Google Cloud Platform (GCP) to increase quotas..&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Oct &lt;var data-var=&#039;date&#039;&gt; 7&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;12:40:44&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Identified&lt;/strong&gt; -
  We are still waiting from Google Cloud Platform to update our quota for the affected Zone.

**Note:**

This incident has **no impact on application performances**.  
Only _new applications and deployments_ with large local storage _might_ be affected..&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Oct &lt;var data-var=&#039;date&#039;&gt; 7&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;13:47:34&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Resolved&lt;/strong&gt; -
  We have received confirmation from the Google Compute Platform (GCP) that quotas on our account have been updated, this issue has now been be resolved..&lt;/p&gt;
]]>
  </content:encoded>
  <pubDate>Mon, 7 Oct 2024 08:00:00 +0000</pubDate>
  <link>https://status.vespa.ai/incident/cm1yxjree003n11ysqtggmk5c</link>
  <guid>https://status.vespa.ai/incident/cm1yxjree003n11ysqtggmk5c</guid>
</item>

<item>
  <title>Vespa Cloud console maintenance</title>
  <description>
    Type: Maintenance
    Duration: 5 minutes

    Affected Components: Console
    Sep 4, 07:15:01 GMT+0 - Identified - Maintenance is now in progress Sep 4, 07:20:00 GMT+0 - Completed - Maintenance has completed successfully Sep 4, 07:15:00 GMT+0 - Identified - We are planning a Vespa Cloud console maintenance. The console will be unavailable for a few minutes 
  </description>
  <content:encoded>
    <![CDATA[<p><strong>Type:</strong> Maintenance</p>
    <p><strong>Duration:</strong> 5 minutes</p>
    <p><strong>Affected Components:</strong> </p>
    &lt;p&gt;&lt;small&gt;Sep &lt;var data-var=&#039;date&#039;&gt; 4&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;07:15:01&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Identified&lt;/strong&gt; -
  Maintenance is now in progress.&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Sep &lt;var data-var=&#039;date&#039;&gt; 4&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;07:20:00&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Completed&lt;/strong&gt; -
  Maintenance has completed successfully.&lt;/p&gt;
&lt;p&gt;&lt;small&gt;Sep &lt;var data-var=&#039;date&#039;&gt; 4&lt;/var&gt;, &lt;var data-var=&#039;time&#039;&gt;07:15:00&lt;/var&gt; GMT+0&lt;/small&gt;&lt;br&gt;&lt;strong&gt;Identified&lt;/strong&gt; -
  We are planning a Vespa Cloud console maintenance. The console will be unavailable for a few minutes.&lt;/p&gt;
]]>
  </content:encoded>
  <pubDate>Wed, 4 Sep 2024 07:15:00 +0000</pubDate>
  <link>https://status.vespa.ai/maintenance/cm0niqq02004vl3c8tq3x35xq</link>
  <guid>https://status.vespa.ai/maintenance/cm0niqq02004vl3c8tq3x35xq</guid>
</item>

  </channel>
  </rss>