Some systems are experiencing issues

Past Incidents

Saturday 22nd July 2017

No incidents reported

Friday 21st July 2017

Email Email Service Issues

The primary focus early this week was to establish stable mail delivery and login access. While we have made significant progress, some work remains. Our current focus is on individual mailbox repairs due to issues indirectly caused when the system was under high load. Now that the system is stabilized, these mailbox repairs are processing more quickly. If you believe that your mailbox is still having issues, please contact support so we can confirm that your issues are indeed related to the server issues from last week.

Thursday 20th July 2017

No incidents reported

Wednesday 19th July 2017

Email Email Service Issues

We continue to perform mailbox level cleanups to address the following issues, which we have identified proactively from system logs:

  • mailboxes with login/access issues: this issue may cause intermittent errors for users that connect via POP or IMAP.
  • extraneous folders prefixed with "lost-"
  • missing messages or folders: the information is present, but not visible to email programs, including Webmail.

We recommend that those users who experience intermittent errors connecting via POP or IMAP utilize Webmail instead. While we are working to resolve all symptoms, our highest priority is ensuring all affected users have access to their mailbox.

Tuesday 18th July 2017

Email Email Service Issue

Our initial pass of fixes for mailboxes that we detected as having login/access issues was successful. We will run a pass for newly discovered mailboxes that our logs have indicated are having issues. Once complete, we will begin the bulk mailbox level cleanup to address the issues we have identified proactively from system logs. These issues include:

  • missing messages or folders; the information is present but not visible to email programs including Webmail
  • extraneous folders starting with "lost-"

As we continue to progress through our mailbox cleanup efforts, some users may see slowness within Webmail. Some mailboxes may require additional attention to resolve some of the issues experienced, and our team is actively working through those.

Monday 17th July 2017

Email Email Service Issues

We are continuing to focus on maintaining access and performance while assisting individual users who may have specific issues arising as a result of the previous high system load. We have begun running a fix to address the issues for users that have not yet been able to successfully access their mailbox. During this time, some users may see some slowness within Webmail. Once completed, we will begin the bulk mailbox level cleanup to address the issues we have identified proactively from system logs. These issues include:

  • missing messages or folders; the information is present but not visible to email programs including Webmail
  • extraneous folders starting with “lost-“

Some mailboxes may require additional attention to resolve some of the issues experienced and our team is actively working through those.

Email Email Service Issues

Over the weekend we have worked through a system-wide cleanup to address the after-effects of the high system load experienced last week. The load was the result of an unknown bug that impacted an effort to proactively double system capacity.

Our priority today is to maintain good access and performance while assisting individual users who may have specific issues arising as a result of the previous high system load. In an abundance of caution, we are limiting the number of simultaneous connections to a single mailbox to 2 POP connections and 4 IMAP connections. Mail programs that exceed the limit will usually retry and users are unlikely to see errors due to connection limits.

We are also rate limiting email delivery for mailboxes that receive hundreds or thousands of email messages per minute; that email will safely queue for delivery over a longer period of time. If a user normally receives less email than this, they should see normal delivery speeds.

After peak load hours today, usually finished before 2pm Eastern, we will consider a bulk mailbox level cleanup to address several issues we have identified proactively from system logs. These issues include:

  • some users have not yet been able to successfully access their mailbox
  • missing messages or folders; the information is present but not visible to email programs including Webmail
  • extraneous folders starting with “lost-“

Some mailboxes may require additional attention to resolve some of the issues experienced and our team is actively working through those. We apologize for these extended issues with the email platform and will post here as more information becomes available.

Sunday 16th July 2017

Email Email Service Issues

Our efforts this weekend have been focused on system wide cleanup to address the consequences of high system load after expanding capacity. These efforts are nearing completion. We will soon begin a more detailed mailbox-level cleanup effort to address some issues that we have seen among some users. While those updates happen there may be very brief periods where accessing email is slow or gives an error; trying again a few minutes later should be successful.

The mailbox level cleanup will address, in an automated fashion, the following issues for users we have been able to identify proactively:

  • some users have not yet been able to successfully access their mailbox
  • missing messages or folders; the information is present but not visible to email programs including Webmail
  • extraneous folders starting with “lost-“

Some mailboxes may require additional attention to resolve some of the issues experienced and our team is actively working through those. We apologize for these extended issues with the email platform and will post here as more information becomes available.