On the morning of May 10th, 2021, during routine scaling, customers reported increased latency as the Interact infrastructure became less responsive to incoming requests due to high traffic volume. While our Cloud Engineers rotated in new servers to handle increased traffic, customers were reporting a positive increase in response and load times. A subset of customers still experienced issues; therefore, our Cloud Engineers restarted a specific DB server impacted while the connections were reset. A spot-check of client environments was subsequently performed and verified that the platform was running successfully and marked the incident as full resolved.
Resolution:
Our Cloud Engineering team rotated new web servers while restarting a DB server.
Remediation:
Current work is being done to increase cloud infrastructure to improve site reliability. Moreover, Interact has recently hired additional resources to help scalability and to improve overall site performance.