[UK South] Email processing issues

Incident Report for CodeTwo

Resolved

All CodeTwo services are operational, but we are actively monitoring this geo as Microsoft has not resolved their cooling failure yet.
Posted Sep 14, 2020 - 18:33 UTC

Monitoring

Microsoft reported that the issue was caused by a cooling failure. As a result, Azure Storage, Networking and Compute resources were shut down as part of an automated processes to preserve the equipment and prevent damage. Currently the Microsoft engineering team is focused on bringing the networking devices back online, whereas CodeTwo DevOps Teams are actively monitoring this process.
Posted Sep 14, 2020 - 17:12 UTC

Update

While the emails are being processed via secondary services, we are actively monitoring the situation in UK South. For more info, see: https://status.azure.com/en-us/status
Posted Sep 14, 2020 - 15:03 UTC

Identified

Microsoft has confirmed performance issues of Microsoft Azure services in UK South. In the meantime, we have enabled secondary services in a different region to process the delayed messages. These messages are now queued and will soon be delivered.
Posted Sep 14, 2020 - 14:43 UTC

Update

We are continuing to investigate this issue.
Posted Sep 14, 2020 - 14:23 UTC

Investigating

A subset of users may experience email processing delays due to Azure availability issues in the region. We're currently investigating this issue.
Posted Sep 14, 2020 - 14:16 UTC
This incident affected: UK South (Mail flow, Signature adding (rules processing), Signature management (app.codetwo.com)).