tag:status.hashicorp.com,2005:/historyHashiCorp Services Status - Incident History2024-03-29T00:06:38ZHashiCorp Servicestag:status.hashicorp.com,2005:Incident/202801512024-04-21T17:00:00Z2024-03-16T23:29:26ZScheduled Maintenance | Terraform Cloud and Terraform Public Registry<p><strong>THIS IS A SCHEDULED EVENT Apr <var data-var='date'>21</var>, <var data-var='time'>17:00</var> - <var data-var='time'>21:00</var> UTC</strong></p><p><small>Mar <var data-var='date'>16</var>, <var data-var='time'>23:29</var> UTC</small><br><strong>Scheduled</strong> - Terraform Cloud and Terraform Public Registry will undergo scheduled maintenance on Sunday, April 21st beginning at 17:00 UTC. We expect this maintenance to complete within 4 hours.<br /><br />During this time, these services will be unavailable until the maintenance completes. We'll post updates as necessary throughout the maintenance period.</p>tag:status.hashicorp.com,2005:Incident/203816402024-03-28T00:18:28Z2024-03-28T00:18:28ZEmergency Maintenance<p><small>Mar <var data-var='date'>28</var>, <var data-var='time'>00:18</var> UTC</small><br><strong>Resolved</strong> - HCP Emergency Maintenance is now complete.</p><p><small>Mar <var data-var='date'>27</var>, <var data-var='time'>23:29</var> UTC</small><br><strong>Update</strong> - HCP Boundary Maintenance is still ongoing and is expected to complete in 1 hour 00:30 UTC. During this time, HCP Boundary sessions may disconnect unexpectedly, but reconnecting will be possible. We will continue to post updates as necessary throughout the maintenance period.</p><p><small>Mar <var data-var='date'>27</var>, <var data-var='time'>20:30</var> UTC</small><br><strong>Identified</strong> - HCP Boundary will undergo emergency maintenance on 27, March, 2024 beginning at 20:30 UTC . We expect this maintenance to be complete within three hours. During this time, HCP Boundary sessions may disconnect unexpectedly, but reconnecting will be possible. We will post updates as necessary throughout the maintenance period.</p>tag:status.hashicorp.com,2005:Incident/203543152024-03-25T17:30:00Z2024-03-25T20:54:12ZTerraform Cloud Degradation<p><small>Mar <var data-var='date'>25</var>, <var data-var='time'>17:30</var> UTC</small><br><strong>Resolved</strong> - Terraform Cloud engineers deployed a routine database migration that renamed an unused column. While the engineering team believed the change to be safe, it resulted in application errors during the deployment window. During this time there was an increase in error rates and latency. The issue has since been resolved.</p>tag:status.hashicorp.com,2005:Incident/203023122024-03-19T16:52:56Z2024-03-19T16:52:56ZStuck / Slow Runs and Slow API Calls<p><small>Mar <var data-var='date'>19</var>, <var data-var='time'>16:52</var> UTC</small><br><strong>Resolved</strong> - All Terraform Cloud systems appear nominal.</p><p><small>Mar <var data-var='date'>19</var>, <var data-var='time'>16:19</var> UTC</small><br><strong>Monitoring</strong> - Emergency maintenance was successful in addressing the database problem. We are continuing to monitor system health.</p><p><small>Mar <var data-var='date'>19</var>, <var data-var='time'>16:05</var> UTC</small><br><strong>Identified</strong> - We have identified a database problem and are performing emergency maintenance to mitigate the issue.</p><p><small>Mar <var data-var='date'>19</var>, <var data-var='time'>15:40</var> UTC</small><br><strong>Investigating</strong> - Our Engineering team is investigating problems with the responsiveness of the Terraform Cloud API and degraded Run Performance.</p>tag:status.hashicorp.com,2005:Incident/202952512024-03-18T23:28:27Z2024-03-18T23:28:27ZReports of Slow Runs<p><small>Mar <var data-var='date'>18</var>, <var data-var='time'>23:28</var> UTC</small><br><strong>Resolved</strong> - The fix was successful.</p><p><small>Mar <var data-var='date'>18</var>, <var data-var='time'>22:53</var> UTC</small><br><strong>Monitoring</strong> - Our engineering team has implemented a fix and we are monitoring the results.</p><p><small>Mar <var data-var='date'>18</var>, <var data-var='time'>21:28</var> UTC</small><br><strong>Investigating</strong> - Our engineering team is investigating an issue with the following:<br /><br />Terraform Run performance.<br /><br />During this time, users may experience the following:<br /><br />Slow or stuck Terraform runs.<br /><br />We will share another update as soon as we have more information.</p>tag:status.hashicorp.com,2005:Incident/199506592024-03-16T16:18:55Z2024-03-16T16:18:55ZHCP Platform Scheduled Maintenance<p><small>Mar <var data-var='date'>16</var>, <var data-var='time'>16:18</var> UTC</small><br><strong>Resolved</strong> - All three phases of HCP Platform Maintenance have been completed successfully. All systems are operational and affected services have been fully restored.</p><p><small>Mar <var data-var='date'>16</var>, <var data-var='time'>14:58</var> UTC</small><br><strong>Identified</strong> - The third and final phase of this maintenance is now beginning. During this time, users may be unable to log into the HCP Portal and calls to HCP APIs may fail. This may impact the ability to create, modify, or delete clusters. Existing HCP Clusters will continue to operate normally.<br /><br />We anticipate that all work will be complete within 3 hours. We will post another update once the maintenance has been completed.</p><p><small>Mar <var data-var='date'> 9</var>, <var data-var='time'>16:09</var> UTC</small><br><strong>Monitoring</strong> - Today's maintenance has been completed successfully. All affected services have been fully restored.<br /><br />The third and final phase of this maintenance will take place next week on March 16 at 15:00 UTC. During that time, you may experience interruption to the HCP Portal and API endpoints. Operations that create, modify, or delete HCP clusters may not be available. Existing HCP clusters will continue to operate normally. <br /><br />The work on March 16 is expected to complete within 3 hours.</p><p><small>Mar <var data-var='date'> 9</var>, <var data-var='time'>15:03</var> UTC</small><br><strong>Identified</strong> - The second phase of this maintenance is now beginning. During this time, you may experience interruption to the HCP Portal and API endpoints. In addition, some email notifications may be delayed or may fail to send. Existing HCP clusters will be unaffected and will continue to operate normally.<br /><br />We anticipate all work will be complete within 3 hours. We will post another update once the maintenance is complete.</p><p><small>Feb <var data-var='date'>24</var>, <var data-var='time'>16:29</var> UTC</small><br><strong>Monitoring</strong> - Today's maintenance has been completed successfully. All affected services have been fully restored.<br /><br />The second phase of this maintenance will take place on March 9 at 15:00 UTC. During that time, HCP platform users may be unable to log into the portal. The work on March 9 is expected to complete within 3 hours.</p><p><small>Feb <var data-var='date'>24</var>, <var data-var='time'>15:10</var> UTC</small><br><strong>Identified</strong> - The first phase maintenance is now beginning. We anticipate all work will be complete within 3 hours. During this time, expect interruption to operations that would create, modify, or delete HCP resources. We will post an update once the maintenance is complete.</p><p><small>Feb <var data-var='date'> 9</var>, <var data-var='time'>19:09</var> UTC</small><br><strong>Investigating</strong> - The HCP Platform will undergo planned maintenance in three phases. Maintenance will take place at 15:00 UTC on February 24, March 9, and March 16. We expect maintenance to complete within 3 hours during each window. During maintenance, operations that create, modify, or delete HCP clusters may be unavailable. We will post updates throughout each phase.</p>tag:status.hashicorp.com,2005:Incident/202456622024-03-14T19:54:26Z2024-03-14T19:54:26ZDegraded run and policy performance<p><small>Mar <var data-var='date'>14</var>, <var data-var='time'>19:54</var> UTC</small><br><strong>Resolved</strong> - All systems nominal.</p><p><small>Mar <var data-var='date'>14</var>, <var data-var='time'>18:24</var> UTC</small><br><strong>Monitoring</strong> - User impact should be mitigated, and we are continuing to monitor the system closely.</p><p><small>Mar <var data-var='date'>14</var>, <var data-var='time'>17:38</var> UTC</small><br><strong>Update</strong> - We've spotted that something has gone wrong. We're currently investigating the issue, and will provide an update soon.</p><p><small>Mar <var data-var='date'>14</var>, <var data-var='time'>17:30</var> UTC</small><br><strong>Identified</strong> - We have identified and are currently monitoring some degraded performance for pre-apply and policy stages.</p>tag:status.hashicorp.com,2005:Incident/202372602024-03-27T20:30:39Z2024-03-27T20:30:39ZHCP Boundary Maintenance: March 2024<p><small>Mar <var data-var='date'>13</var>, <var data-var='time'>20:32</var> UTC</small><br><strong>Identified</strong> - HCP Boundary will undergo planned database maintenance on Saturday, March 30th beginning at 14:00 UTC. We expect this maintenance to be completed within 1 hour.<br /><br />During this time, HCP Boundary and all Boundary clusters will be unavailable. Sessions will be dropped and session establishment will fail until the maintenance completes. We will post updates as necessary throughout the maintenance period.</p>tag:status.hashicorp.com,2005:Incident/201952982024-03-08T17:39:50Z2024-03-08T17:39:50ZTFC Degredation and partial VCS outage<p><small>Mar <var data-var='date'> 8</var>, <var data-var='time'>17:39</var> UTC</small><br><strong>Resolved</strong> - Terraform Cloud systems have returned to normal operations.<br /><br />Customers may note that some VCS connected resources (Workspaces, Policy Sets, Registry Modules) have failed to ingest into Terraform Cloud, and may need to be retried now that the incident has passed.</p><p><small>Mar <var data-var='date'> 8</var>, <var data-var='time'>17:23</var> UTC</small><br><strong>Monitoring</strong> - We've identified the issue: a routine database migration caused elevated application errors. It has completed, and Terraform Cloud appears to have recovered. We're monitoring the situation.</p><p><small>Mar <var data-var='date'> 8</var>, <var data-var='time'>17:03</var> UTC</small><br><strong>Investigating</strong> - Our engineering team is investigating an issue with elevated 500 errors in Terraform Cloud, particularly for VCS integrated resources.<br /><br />During this time, users may experience the following: 500 errors for requests on VCS integrated resources (workspaces, modules, policy sets) and failure to ingest those resources when triggered from webhooks.<br /><br />We will share another update in 30 minutes.</p>tag:status.hashicorp.com,2005:Incident/201586972024-03-04T19:14:45Z2024-03-04T19:14:45ZPublishing Delays for New Module/Provider Versions<p><small>Mar <var data-var='date'> 4</var>, <var data-var='time'>19:14</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Mar <var data-var='date'> 4</var>, <var data-var='time'>18:40</var> UTC</small><br><strong>Monitoring</strong> - Our Engineering team has implemented a fix to resolve the issue. New public module and provider versions are publishing as expected.<br /><br />We are continuing to monitor the situation closely and will post an update as soon as the issue is fully resolved.</p><p><small>Mar <var data-var='date'> 4</var>, <var data-var='time'>16:46</var> UTC</small><br><strong>Investigating</strong> - Our engineering team is investigating an issue with the Terraform Registry that is causing delays in publishing new module and provider versions.<br /><br />During this time, users may experience not immediately see new versions of public providers and modules that have been published.<br /><br />We will share another update as soon as we have more information.</p>tag:status.hashicorp.com,2005:Incident/200787842024-02-26T14:41:32Z2024-02-26T14:41:32ZHCP Consul unable to create, update, and delete clusters<p><small>Feb <var data-var='date'>26</var>, <var data-var='time'>14:41</var> UTC</small><br><strong>Resolved</strong> - Our Engineering team has resolved the following issue: <br /><br />HCP Consul users are unable to create, update, and delete clusters.<br /><br />These systems should now be operating normally. If you continue to experience any problems, please open a ticket with our support team.</p><p><small>Feb <var data-var='date'>26</var>, <var data-var='time'>14:23</var> UTC</small><br><strong>Monitoring</strong> - Our Engineering team has implemented a fix to resolve the issue with:<br /><br />Impacted HCP Consul services were manually restarted.<br /><br />We are monitoring the situation closely and will post an update as soon as the issue is fully resolved.</p><p><small>Feb <var data-var='date'>26</var>, <var data-var='time'>13:42</var> UTC</small><br><strong>Investigating</strong> - Our engineering team is investigating an issue with the following:<br /><br />HCP Consul operations are failing to complete.<br /><br />During this time, users may experience the following:<br /><br />Users are unable to create, update, or delete clusters.<br /><br />We will share another update as soon as we have more information.</p>tag:status.hashicorp.com,2005:Incident/200520702024-02-25T19:17:28Z2024-02-25T19:17:28ZHCP Boundary Emergency Maintenance<p><small>Feb <var data-var='date'>25</var>, <var data-var='time'>19:17</var> UTC</small><br><strong>Resolved</strong> - HCP Boundary maintenance is complete.</p><p><small>Feb <var data-var='date'>25</var>, <var data-var='time'>19:07</var> UTC</small><br><strong>Monitoring</strong> - HCP Boundary emergency maintenance is complete.</p><p><small>Feb <var data-var='date'>25</var>, <var data-var='time'>15:54</var> UTC</small><br><strong>Update</strong> - We have started HCP Boundary emergency maintenance and expect to complete it within four hours. During this time, the HCP Boundary sessions may disconnect unexpectedly. We will post updates as necessary throughout the maintenance period.</p><p><small>Feb <var data-var='date'>22</var>, <var data-var='time'>21:42</var> UTC</small><br><strong>Investigating</strong> - HCP Boundary will undergo emergency maintenance on Sunday 25th February 2024 beginning at 15:00 UTC. We expect this maintenance to be complete within four hours. During this time, HCP Boundary sessions may disconnect unexpectedly. We will post updates as necessary throughout the maintenance period.</p>tag:status.hashicorp.com,2005:Incident/200638412024-02-24T21:43:33Z2024-02-24T21:43:33ZConnectivity issues between nodes of HCP Vault clusters<p><small>Feb <var data-var='date'>24</var>, <var data-var='time'>21:43</var> UTC</small><br><strong>Resolved</strong> - We are seeing the return to system health, the incident has been resolved.</p><p><small>Feb <var data-var='date'>24</var>, <var data-var='time'>20:47</var> UTC</small><br><strong>Monitoring</strong> - We are seeing the return of health to the nodes impacted by this issue. Our engineers will continue to monitor the health of the system.</p><p><small>Feb <var data-var='date'>24</var>, <var data-var='time'>14:11</var> UTC</small><br><strong>Identified</strong> - Our engineers have identified the issue and now are working to implement a fix. <br />We will provide updates when more information is available.</p><p><small>Feb <var data-var='date'>24</var>, <var data-var='time'>09:29</var> UTC</small><br><strong>Update</strong> - Our engineers are continuing to work to resolve the issue. <br />Updates will be posted when more information is available.</p><p><small>Feb <var data-var='date'>24</var>, <var data-var='time'>07:50</var> UTC</small><br><strong>Investigating</strong> - HCP Vault clusters located in Azure-Central US may experience intermittent connectivity issues.<br />These issues can result in some or all nodes of your HCP Vault clusters becoming unreachable.<br /><br />Our engineering team is investigating this issue and will provide updates when more information is available.</p>tag:status.hashicorp.com,2005:Incident/200520862024-02-23T01:27:55Z2024-02-23T01:27:55ZAdministrative tasks against Vault and Consul clusters are degraded<p><small>Feb <var data-var='date'>23</var>, <var data-var='time'>01:27</var> UTC</small><br><strong>Resolved</strong> - Our Engineering team has resolve the issues causing degraded administrative actions against HCP Consul and HCP Vault clusters.<br /><br />All operations are healthy.<br /><br />These systems should now be operating normally. If you continue to experience any problems, please open a ticket with our support team.</p><p><small>Feb <var data-var='date'>22</var>, <var data-var='time'>23:21</var> UTC</small><br><strong>Update</strong> - We are continuing to monitor for any further issues.</p><p><small>Feb <var data-var='date'>22</var>, <var data-var='time'>23:13</var> UTC</small><br><strong>Monitoring</strong> - Our Engineering team has implemented a fix to resolve the issue of degraded administrative tasks against HCP Vault and HCP Consul clusters.<br /><br />We are beginning to see recovery and are monitoring the situation closely and will post an update as soon as the issue is fully resolved.</p><p><small>Feb <var data-var='date'>22</var>, <var data-var='time'>22:20</var> UTC</small><br><strong>Identified</strong> - Our Engineering team has identified the cause for the following incident: <br /><br />Administrative tasks against Vault and Consul clusters are degraded (cluster creation, deletion, generation of admin tokens, snapshot operations, etc).<br /><br />Existing Vault and Consul clusters will continue to operate without issue.<br /><br />We are actively working on a fix. Once we have additional information, we will share another update.</p><p><small>Feb <var data-var='date'>22</var>, <var data-var='time'>21:45</var> UTC</small><br><strong>Investigating</strong> - Our engineering team is investigating an issue with the following:<br /><br />HCP Vault cluster creation and admin token generation is degraded. <br /><br />During this time, users may experience the following:<br /><br />Failure to create new HCP Vault clusters<br />Failure to generate admin tokens<br /><br />We will share another update as soon as we have more information.</p>tag:status.hashicorp.com,2005:Incident/200487482024-02-22T15:36:41Z2024-02-22T15:36:41ZTerraform Cloud degradation<p><small>Feb <var data-var='date'>22</var>, <var data-var='time'>15:36</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Feb <var data-var='date'>22</var>, <var data-var='time'>15:05</var> UTC</small><br><strong>Monitoring</strong> - The issue has been identified, a fix has been implemented, and we are monitoring the results.</p><p><small>Feb <var data-var='date'>22</var>, <var data-var='time'>14:52</var> UTC</small><br><strong>Investigating</strong> - We are currently investigating an issue in Terraform Cloud where some runs are being queued up and processed slowly.</p>tag:status.hashicorp.com,2005:Incident/200431542024-02-22T01:39:31Z2024-02-22T01:39:31ZHCP portal experiencing instability<p><small>Feb <var data-var='date'>22</var>, <var data-var='time'>01:39</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Feb <var data-var='date'>22</var>, <var data-var='time'>01:36</var> UTC</small><br><strong>Update</strong> - The upstream provider has resolved their major outage. The HashiCorp Cloud Platform and other HashiCorp services should now be operating normally. If you continue to experience any problems, please open a ticket with our support team.</p><p><small>Feb <var data-var='date'>22</var>, <var data-var='time'>00:50</var> UTC</small><br><strong>Monitoring</strong> - Our Engineering team has identified the cause for the following incident: <br /><br />The HCP portal is being affected by an upstream provider that is having a major outage.<br /><br />Once we have additional information, we will share another update.</p>tag:status.hashicorp.com,2005:Incident/200408862024-02-21T19:40:13Z2024-02-21T19:40:13ZCreation of HCP Organizations and Projects is degraded<p><small>Feb <var data-var='date'>21</var>, <var data-var='time'>19:40</var> UTC</small><br><strong>Resolved</strong> - Our Engineering team has resolved the following issue: Creation of HCP Organizations and Projects failing<br /><br />These systems should now be operating normally. If you continue to experience any problems, please open a ticket with our support team.</p><p><small>Feb <var data-var='date'>21</var>, <var data-var='time'>19:33</var> UTC</small><br><strong>Monitoring</strong> - Our Engineering team has implemented a fix to resolve the issue: a fix has been validated and deployed.<br /><br />We are monitoring the situation closely and will post an update as soon as the issue is fully resolved.</p><p><small>Feb <var data-var='date'>21</var>, <var data-var='time'>19:20</var> UTC</small><br><strong>Identified</strong> - Our Engineering team has identified the cause for the following incident: <br /><br />Creation requests for HCP Organizations and Projects is currently failing.<br /><br />We are actively working on a fix. Once we have additional information, we will share another update.</p>tag:status.hashicorp.com,2005:Incident/200324482024-02-20T21:51:10Z2024-02-20T21:51:10ZMonitoring an incident<p><small>Feb <var data-var='date'>20</var>, <var data-var='time'>21:51</var> UTC</small><br><strong>Resolved</strong> - Our Engineering team has resolved the following issue: <br /><br />Unable to create or delete peering connections from HCP to Azure.<br /><br />These systems should now be operating normally. If you continue to experience any problems, please open a ticket with our support team.</p><p><small>Feb <var data-var='date'>20</var>, <var data-var='time'>20:43</var> UTC</small><br><strong>Monitoring</strong> - Our Engineering team has implemented a fix to resolve the issue with:<br /><br />Unable to create or delete peering connections from HCP to Azure.<br /><br />We are monitoring the situation closely and will post an update as soon as the issue is fully resolved.</p>tag:status.hashicorp.com,2005:Incident/199853012024-02-14T17:21:00Z2024-02-14T17:21:00ZNew Email/Password users unable to sign up<p><small>Feb <var data-var='date'>14</var>, <var data-var='time'>17:21</var> UTC</small><br><strong>Resolved</strong> - We think the impact from the issue is over.</p><p><small>Feb <var data-var='date'>14</var>, <var data-var='time'>17:12</var> UTC</small><br><strong>Monitoring</strong> - Issue has been identified and a fix deployed. We are monitoring</p><p><small>Feb <var data-var='date'>14</var>, <var data-var='time'>17:08</var> UTC</small><br><strong>Identified</strong> - Our Engineering team has identified the cause for the following incident: <br /><br />New email/password users to HCP will be unable to sign in<br /><br />We are actively working on a fix. Once we have additional information, we will share another update.</p>tag:status.hashicorp.com,2005:Incident/198206972024-02-10T18:56:07Z2024-02-10T18:56:07ZHCP Boundary Scheduled Maintenance<p><small>Feb <var data-var='date'>10</var>, <var data-var='time'>18:56</var> UTC</small><br><strong>Resolved</strong> - HCP Boundary maintenance window is now complete and service is fully restored</p><p><small>Feb <var data-var='date'>10</var>, <var data-var='time'>18:15</var> UTC</small><br><strong>Monitoring</strong> - HCP Boundary maintenance is complete and service should be fully restored.</p><p><small>Feb <var data-var='date'>10</var>, <var data-var='time'>15:01</var> UTC</small><br><strong>Identified</strong> - HCP Boundary is currently undergoing maintenance. During this time, HCP Boundary sessions may disconnect unexpectedly. We will post updates as necessary throughout the maintenance period.</p><p><small>Feb <var data-var='date'> 2</var>, <var data-var='time'>22:08</var> UTC</small><br><strong>Update</strong> - HCP Boundary will undergo planned maintenance the weekend of February 10-11. The exact time and day will be added on Monday February 5th. We expect this maintenance to be complete within three hours. During this time, HCP Boundary sessions may disconnect unexpectedly. We will post updates as necessary throughout the maintenance period.</p><p><small>Jan <var data-var='date'>26</var>, <var data-var='time'>20:38</var> UTC</small><br><strong>Update</strong> - HCP Boundary will undergo planned maintenance on Saturday, February 3rd beginning at 15:00 UTC . We expect this maintenance to be complete within two hours. During this time, HCP Boundary sessions may disconnect unexpectedly. We will post updates as necessary throughout the maintenance period.</p><p><small>Jan <var data-var='date'>24</var>, <var data-var='time'>18:31</var> UTC</small><br><strong>Investigating</strong> - HCP Boundary will undergo planned maintenance on Saturday, January 27th beginning at 19:00 UTC . We expect this maintenance to be complete within three hours. During this time, HCP Boundary sessions may disconnect unexpectedly. We will post updates as necessary throughout the maintenance period.</p>tag:status.hashicorp.com,2005:Incident/198789082024-01-31T21:24:56Z2024-01-31T21:24:56ZBug when creating HVD cluster and HVN simultaneously in Portal UI<p><small>Jan <var data-var='date'>31</var>, <var data-var='time'>21:24</var> UTC</small><br><strong>Resolved</strong> - Our Engineering team has resolved the bug. Simultaneous cluster and HVN creation via the UI should now be operating normally. If you continue to experience any problems, please open a ticket with our support team.</p><p><small>Jan <var data-var='date'>31</var>, <var data-var='time'>20:22</var> UTC</small><br><strong>Identified</strong> - Our Engineering team has identified the cause for the following incident: <br /><br />There is a bug in production causing some newly-created clusters to be deployed to the wrong HVN when also creating a new network in the same cluster create flow. This is not 100% deterministic as it only happens based on the number of fields changed when configuring the newly created network.<br /><br />A small percentage of newly-created clusters from the UI may not be configured with the intended network. Please double check if your cluster is in the intended network if you created a cluster and HVN simultaneously on the cluster creation form via the UI between December 18, 2023 and now.<br /><br />We are actively working on a fix. Once we have additional information, we will share another update.</p>tag:status.hashicorp.com,2005:Incident/198689012024-01-30T18:59:16Z2024-01-30T18:59:16ZTerraform Cloud Degredation<p><small>Jan <var data-var='date'>30</var>, <var data-var='time'>18:59</var> UTC</small><br><strong>Resolved</strong> - Mitigations were successful, and Terraform Cloud systems have returned to normal operations.</p><p><small>Jan <var data-var='date'>30</var>, <var data-var='time'>18:18</var> UTC</small><br><strong>Monitoring</strong> - The engineering team has performed mitigations, and we're now seeing recovery of Terraform Cloud systems. Our support and engineering teams will continue to monitor.<br /><br />If you have any stuck runs, please cancel them and retry.</p><p><small>Jan <var data-var='date'>30</var>, <var data-var='time'>18:08</var> UTC</small><br><strong>Update</strong> - We've spotted that something has gone wrong. We're currently investigating the issue, and will provide an update soon.</p><p><small>Jan <var data-var='date'>30</var>, <var data-var='time'>17:56</var> UTC</small><br><strong>Investigating</strong> - Our engineering team is investigating an issues causing slow page response times and enqueued runs in Terraform Cloud.</p>tag:status.hashicorp.com,2005:Incident/198200382024-01-24T19:18:45Z2024-01-24T19:18:45ZTerraform Cloud degradation<p><small>Jan <var data-var='date'>24</var>, <var data-var='time'>19:18</var> UTC</small><br><strong>Resolved</strong> - We have seen a full recovery of the Terraform Cloud system</p><p><small>Jan <var data-var='date'>24</var>, <var data-var='time'>18:10</var> UTC</small><br><strong>Monitoring</strong> - We are now seeing the recovery of the Terraform Cloud systems and calls are succeeding. Our Support and Engineering teams will continue to monitor<br /><br />If you have any runs that are stuck, please cancel them and retry</p><p><small>Jan <var data-var='date'>24</var>, <var data-var='time'>17:50</var> UTC</small><br><strong>Update</strong> - Terraform Cloud requests to include login, updates and runs currently are impacted<br />Impact is seen through call timeouts or degraded performance</p><p><small>Jan <var data-var='date'>24</var>, <var data-var='time'>17:22</var> UTC</small><br><strong>Investigating</strong> - We are currently investigating an issue that is causing slow page response times and enqueued runs in Terraform Cloud.</p>tag:status.hashicorp.com,2005:Incident/197970972024-01-22T22:34:09Z2024-01-22T22:34:09ZTerraform Cloud outage<p><small>Jan <var data-var='date'>22</var>, <var data-var='time'>22:34</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved. If any runs are failing to proceed in your workspaces, they may have to be cancelled and retried.</p><p><small>Jan <var data-var='date'>22</var>, <var data-var='time'>21:45</var> UTC</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>Jan <var data-var='date'>22</var>, <var data-var='time'>19:53</var> UTC</small><br><strong>Identified</strong> - The issue has been identified and a fix is being implemented.</p><p><small>Jan <var data-var='date'>22</var>, <var data-var='time'>18:27</var> UTC</small><br><strong>Investigating</strong> - We are currently investigating this issue.</p>tag:status.hashicorp.com,2005:Incident/197952362024-01-22T17:12:52Z2024-01-22T17:20:29ZTerraform Cloud outage<p><small>Jan <var data-var='date'>22</var>, <var data-var='time'>17:12</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved. If any runs are failing to proceed in your workspaces, they may have to be cancelled and retried.</p><p><small>Jan <var data-var='date'>22</var>, <var data-var='time'>16:52</var> UTC</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>Jan <var data-var='date'>22</var>, <var data-var='time'>16:07</var> UTC</small><br><strong>Update</strong> - We are continuing to investigate this issue.</p><p><small>Jan <var data-var='date'>22</var>, <var data-var='time'>15:18</var> UTC</small><br><strong>Investigating</strong> - We are currently investigating an outage for Terraform Cloud. We will update this incident as more information becomes available.</p>