No notices reported this month
At 2:58 PM, once the revert was completed, we confirmed that app.dopt.com functions as expected. We've also rolled back the broken nginx image and its assets internally.
At 2:55 PM, we began rolling out a revert to the previous version of app.dopt.com's client.
Starting at 2:32 PM (pacific), app.dopt.com redirected to a static nginx page rather than Dopt's web app.
Blocks API deploys took an abnormally long time because of a pre-existing dependency between a few internal services which were all simultaneously updated between 1:20 and 1:30 PM pacific time today.
We've rolled out a change which decouples these services so that these 502s won't re-occur in the future.
This automated health-check failure resulted due 502s from our blocks.dopt.com gateway due to an abnormally slow roll-out of new nodes in k8s.
We're investigating why this roll-out was so slow, but all systems are operational and functioning as expected.
A previously reported automated failure on health-check has been resolved.
We're investigating an incident which was automatically triggered by a health-check failure.
All systems are operational.
This incident is to test that our status.dopt.com related webhooks trigger appropriately.
app.dopt.com loads and communicates with our internal APIs as expected.
We've deployed a fix to app.dopt.com which correctly communicates with gateway.dopt.com over HTTPS.
app.dopt.com deployed with a broken configuration for our internal API, gateway.dopt.com. We have fixed the issue and are deploying a new version right now.
Aug 2023 to Oct 2023