On the morning of May 3rd, 2021, part of Interact's infrastructure became unstable and less responsive to incoming requests. This led to an increase in latency, which was first addressed by restarting related servers. While this mitigated a number of issues, a piece of the cloud environment responsible for serving user-uploaded images remained unable to effectively process requests in a timely fashion.
Resolution
To fix this issue, Interact engineers rotated servers related to this piece of the platform and services returned to normal.
Remediation
Development is underway on a project to overhaul and upgrade a portion of Interact's cloud infrastructure to improve site reliability.