All Systems Operational

Mar 28, 2025

No incidents reported today.

Mar 27, 2025
Resolved - This incident has been resolved.
Mar 27, 20:54 PDT
Update - We are continuing to monitor for any further issues.
Mar 27, 19:50 PDT
Update - We are continuing to monitor for any further issues.
Mar 27, 19:50 PDT
Monitoring - We've identified an issue causing 400 Bad Request status code to be returned for a portion of traffic to the /v1/otel/v1/metrics ingest endpoint in the US East (N. Virginia) region. As a result, data points in this traffic were not being successfully ingested by Observe. Our team has identified and remediated the root cause, and this traffic is now successfully being ingested. The duration of the impact was approximately 1 hour 40 minutes.
Mar 27, 19:49 PDT
Completed - The scheduled maintenance has been completed.
Mar 27, 12:00 PDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Mar 27, 11:00 PDT
Scheduled - We will be performing our weekly release for the Asia Pacific (Sydney)-2 region. Users may experience brief interruptions or slowness with queries that should resolve within 5 minutes.
Mar 24, 20:51 PDT
Mar 26, 2025
Completed - The scheduled maintenance has been completed.
Mar 26, 18:31 PDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Mar 26, 17:30 PDT
Scheduled - We will be performing our weekly release for the Europe (Frankfurt) region. Users may experience brief interruptions or slowness with queries that should resolve within 5 minutes.
Mar 24, 20:51 PDT
Completed - The scheduled maintenance has been completed.
Mar 26, 18:30 PDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Mar 26, 17:30 PDT
Scheduled - We will be performing our weekly release for the US West (Oregon) region. Users may experience brief interruptions or slowness with queries that should resolve within 5 minutes.
Mar 24, 20:50 PDT
Completed - The scheduled maintenance has been completed.
Mar 26, 18:30 PDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Mar 26, 17:30 PDT
Scheduled - We will be performing our weekly release for the US East (N. Virginia) region. Users may experience brief interruptions or slowness with queries that should resolve within 5 minutes.
Mar 24, 20:51 PDT
Completed - The scheduled maintenance has been completed.
Mar 26, 18:30 PDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Mar 26, 17:30 PDT
Scheduled - We will be performing our weekly release for the Canada (Central) region. Users may experience brief interruptions or slowness with queries that should resolve within 5 minutes.
Mar 24, 20:51 PDT
Completed - The scheduled maintenance has been completed.
Mar 26, 14:00 PDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Mar 26, 13:00 PDT
Scheduled - We will be performing our weekly release for the Asia Pacific (Sydney)-1 region. Users may experience brief interruptions or slowness with queries that should resolve within 5 minutes.
Mar 24, 20:50 PDT
Completed - The scheduled maintenance has been completed.
Mar 26, 14:00 PDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Mar 26, 13:00 PDT
Scheduled - We will be performing our weekly release for the Asia Pacific (Tokyo) region. Users may experience brief interruptions or slowness with queries that should resolve within 5 minutes.
Mar 24, 20:50 PDT
Mar 25, 2025

No incidents reported.

Mar 24, 2025

No incidents reported.

Mar 23, 2025

No incidents reported.

Mar 22, 2025

No incidents reported.

Mar 21, 2025

No incidents reported.

Mar 20, 2025
Resolved - This incident has been resolved.
Mar 20, 18:05 PDT
Monitoring - Dataset freshness has been restored to configured goals on customer tenants. We will continue to monitor freshness for the next 2 hours to ensure this incident has been resolved.
Mar 20, 16:05 PDT
Update - Recovery efforts are ongoing on the Observe side and we are getting closer to meeting data freshness goals on all customer datasets. We expect all remaining datasets freshness latency to be resolved within the next hour. We are continuing to monitor the systems very closely through the recovery process.
Mar 20, 14:52 PDT
Update - Our service provider, Snowflake, has completed changes to mitigate the networking issue on their end. https://status.snowflake.com/incidents/525rr3btnrz8.

Recovery efforts are ongoing on the Observe side and we are getting closer to meeting our customers' data freshness goals. ETA on dataset freshness catch up is approximately 1 hour. We are continue to monitor the systems very closely through recovery.

Mar 20, 13:27 PDT
Update - Snowflake has completed changes to mitigate the networking issue on their end. This is the incident they were working https://status.snowflake.com/incidents/525rr3btnrz8.

Recovery efforts are underway on the Observe side and we are steadily catching back up. ETA on restoration is approximately 1-2 hours to be fully restored and caught up.

We currently are monitoring the catch up and the current ingest of this region.

Mar 20, 12:28 PDT
Update - Snowflake is continuing to apply changes to mitigate the networking issue on their end. Recovery efforts are underway on the Observe side and we are ramping processing back up. https://status.snowflake.com/incidents/525rr3btnrz8. Both Observe and Snowflake have the highest level of focus and priority on resolving the issue. Currently all data ingest is continuing at a slow pace. Data acceleration is similarly delayed. We do not expect any data loss.
Mar 20, 11:27 PDT
Identified - We are continuing our investigation with our service provider to mitigate the issue. Our service provider has identified a networking issue that is tracked by an incident https://status.snowflake.com/incidents/525rr3btnrz8. Snowflake is actively taking steps to mitigate the identified issue. There is no ETA yet on resolution. Both Observe and Snowflake have the highest level of focus and priority on resolving the issue. Currently all data ingest is continuing at a slow pace. Data acceleration is similarly delayed. We do not expect any data loss.
Mar 20, 10:28 PDT
Update - We are continuing our investigation with our service provider to mitigate the issue. Our service provider has identified an issue that is affecting more than 3 customers that is tracked by an incident https://status.snowflake.com/incidents/525rr3btnrz8. Both Observe and Snowflake have the highest level of focus and priority on resolving the issue. Currently all data ingest is continuing at a slow pace. Data acceleration is similarly delayed. We do not expect any data loss.
Mar 20, 09:28 PDT
Update - We are continuing our investigation with our service provider to mitigate the issue. Our service provider has identified an issue that is affecting more than 3 customers. Currently all data ingest is continuing at a slow pace. Data acceleration is similarly delayed. We do not expect any data loss.
Mar 20, 08:56 PDT
Update - We are continuing our investigation with our service provider Snowflake to try to identify the root cause of the issue and mitigate. Currently all data ingest is continuing but loading of data is failing. We do not expect any data loss.
Mar 20, 07:56 PDT
Update - We are continuing our investigation with our service provider Snowflake to try to identify the root cause of the issue and mitigate. Currently all data ingest is continuing but loading of data is failing. We do not expect any data loss.
Mar 20, 06:55 PDT
Update - We are continuing our investigation with our service provider Snowflake to try to identify the root cause of the issue and mitigate. Currently all data ingest is continuing but loading of data is failing. We do not expect any data loss.
Mar 20, 05:55 PDT
Update - We are currently still investigating and actively working the incident with our service provider Snowflake to try to identify the root cause of the issue and mitigate. Currently all data ingest is continuing but loading of data is failing. We do not expect any data loss.
Mar 20, 04:55 PDT
Update - We have identified that the issue is being caused by an issue with our service provider Snowflake. Currently all ingest is failing but we do not expect any data loss. Our engineers are actively working with Snowflake to try to identify the root cause of the issue and mitigate. We will post further updates as they become available.
Mar 20, 03:58 PDT
Investigating - We’ve identified an issue causing delays in ingest in the following regions: US East (N. Virginia). As a result, some users may experience see delays in ingesting data. Our team is actively investigating the root cause and working to restore normal performance as quickly as possible. We’ll provide updates as we learn more. Thank you for your patience!
Mar 20, 02:55 PDT
Completed - The scheduled maintenance has been completed.
Mar 20, 12:00 PDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Mar 20, 11:00 PDT
Scheduled - We will be performing our weekly release for the Asia Pacific (Sydney) region. Users may experience brief interruptions or slowness with queries that should resolve within 5 minutes.
Mar 19, 11:24 PDT
Mar 19, 2025
Resolved - This incident has been resolved.
Mar 19, 22:54 PDT
Monitoring - A fix has been implemented and we are monitoring the results.
Mar 19, 21:54 PDT
Identified - We’ve identified an issue causing intermittent failed ingest errors in the following regions: US West (Oregon). As a result, some users may experience 5xx code errors on ingest. No data loss from the ingestion but this may cause a delay. Our team is actively investigating the root cause and working to restore normal performance as quickly as possible. We’ll provide updates as we learn more. Thank you for your patience!
Mar 19, 20:00 PDT
Resolved - This incident has been resolved
Mar 19, 21:19 PDT
Monitoring - We have applied a fix and are monitoring the recovery.
Mar 19, 18:35 PDT
Investigating - We have identified an issue causing Transform Latency affecting the following regions: GCP. As a result, some users may experience trouble running queries, delays in monitors, and delays in data freshness. Our team is actively investigating the root cause and working to restore normal performance as quickly as possible. We'll provide updates as we learn more. Thank you for your patience!
Mar 19, 18:00 PDT
Completed - The scheduled maintenance has been completed.
Mar 19, 18:30 PDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Mar 19, 17:30 PDT
Scheduled - We will be performing our weekly release for the US West (Oregon) region. Users may experience brief interruptions or slowness with queries that should resolve within 5 minutes.
Mar 19, 10:32 PDT
Completed - The scheduled maintenance has been completed.
Mar 19, 14:00 PDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Mar 19, 13:00 PDT
Scheduled - We will be performing our weekly release for the Europe (Frankfurt) region. Users may experience brief interruptions or slowness with queries that should resolve within 5 minutes.
Mar 19, 11:24 PDT
Completed - The scheduled maintenance has been completed.
Mar 19, 14:00 PDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Mar 19, 13:00 PDT
Scheduled - We will be performing our weekly release for the Asia Pacific (Tokyo) region. Users may experience brief interruptions or slowness with queries that should resolve within 5 minutes.
Mar 19, 11:24 PDT
Mar 18, 2025

No incidents reported.

Mar 17, 2025

No incidents reported.

Mar 16, 2025

No incidents reported.

Mar 15, 2025

No incidents reported.

Mar 14, 2025

No incidents reported.