Mailfoundry engineers have temporarily taken the G1 gateway offline as they investigate an issue causing some mail to get stuck in queue.  We expect services to be restored shortly but currently do not have an ETA.  At this time mail will queue on the sending server and will be delivered after G1 comes back online and the sender retries.

Update: G1 is back up and performing normally.

We are currently performing emergency database maintenance on the G1 gateway to repair a corrupted user database.  We estimate a total time for repair of 30-60 minutes.  During a portion of this time SMTP services on G1 will be disabled.  Sending servers will queue the mail until services are restored and will deliver at that time.

MF2 is currently undergoing emergency user database maintenance to help improve performance on the gateway.  During this time mail services are stopped and mail will queue on sending servers, to be delivered normally within 4 hours based upon retry settings at the sender.

Emergency maintenance is expected to take approximately 30 minutes.

UPDATE: Maintenance complete @ 0243

Mail is temporarily being deferred on G1 (g1.ijnet.net) due to the user list index being corrupted.  We are currently rebuilding the index and expect service to be restored shortly.

Mail being temporarily deferred means that the gateway is responding to SMTP requests, but rather than accepting messages is responding with a 451 error to the sending server, asking the server to try again shortly.  Once the user list is rebuilt and mail is being accepted again, senders will be free to retry to deliver mail that was deferred.  No mail will be lost from this issue.

UPDATE: Service has been restored as of 8:30am central US time.

Due to a hard drive failure in the RAID array on MF1, we have replaced the drive and the array is now rebuilding. We are monitoring the rebuild and expect it to complete within the next 8-10 hours. There should be very little customer impact related to this emergency repair, though there may be brief periods where the gateway is unable to respond to SMTP requests. These outages should be brief and infrequent.

Our G1 gateway has completed database maintenance, and normal mail flow has resumed.