Below are the archives of past years' notifications on the Portal Status page.
Past Maintenance
Date, Time | Impact | Reason |
---|---|---|
Sunday, August 28, 2022 2:30 AM - 3:30 AM EDT | System outage | Database maintenance. |
Sunday, August 7, 2022 1:30 AM - 5:30 AM EDT | System outage | Database optimization, server patches and updates. |
Sunday, April 10, 2022 12:30 AM - 2:30 AM EDT | System outage | Security updates and server updates. |
Saturday, February 19, 2022 1:30 AM - 1:45 AM EST | System outage | Security updates and server updates. |
Saturday, January 29, 2022 1:00 AM - 3:00 AM EST | System outage | Perform server/software upgrades to improve system performance |
Saturday, October 31, 2021, 2:30 AM - 3:00 AM EDT | System outage | Perform server maintenance to improve system performance. |
Saturday, August 28, 2021, 2:30 AM - 3:00 AM EDT | System outage, slow performance initially | Perform server maintenance to improve system performance. |
Saturday, July 31, 2021, 2:30 AM - 7:30 AM EDT | System outage, slow performance initially | Server maintenance to improve system performance; database indexing and optimization. |
Sunday, July 25, 2021, 2:30 AM - 7:30 AM EDT | System outage, slow performance initially | Server maintenance to improve system performance. |
Saturday, May 08, 2021, 1:30 AM - 4:30 AM EDT | System outage, slow performance initially | Server maintenance to improve system performance: TinCan DB Disk Space Increase & Patch Update of EC2. |
Saturday, April 24, 2021, 1:30 AM - 5:30 AM EDT | System outage, slow performance initially | Server maintenance to improve system performance: NFS Disk Space Increase & Patch Update of EC2. |
Saturday, February 06, 2021, 1:30 AM - 7:30 AM EST | Slow performance, no system outage | Improve system performance, including load balancer upgrade, Route 53 maintenance, and database optimization. |
Saturday, January 30, 2021, 1:30 AM - 3:30 AM EST | System outage | Improve system performance; server maintenance for AWS machines and services. |
Past Incidents
Date | Duration | Impact | Root Cause |
---|---|---|---|
April 11, 2023, 7:30pm EDT | 1hr 20min | System Outage | Alerts regarding an unhealthy server (due to high server usage) failed to be delivered internally, resulting in the server crashing. |
November 28, 2022 | 10 mins | Site intermittently down for 10 mins over a 1 hour period. | All traffic was put on a single app server. The remaining servers were not responding for a short period of time. |
August 08, 2022 | Appox. 3 days | Some users at districts rostering via Clever could not access their account. | Resolved; we are still investigating the root cause of this issue and will post more here. |
January 14 - 28, 2022 | 2 weeks | Firefox 96.0.1 users cannot access certain content | Users accessing the Portal with Firefox (v96.0.1) could not access the epub versions of core content (student books, teacher editions, etc) due to the content not properly rendering. |
December 22-23, 2021 | ~24 hours | Site slowness for some users | Power failure for AWS US-EAST-1 Region, impacting AWS EC2. Servers moved to different AWS region while AWS repaired US-EAST-1. Some users may have experienced some slowness due to this issue and the resulting repair work. |
November 30, 2021 | 32 mins | Site outage for some users | Due to a sudden spike in the server load, the site became unavailable for some users. |
September 27, 2021 | 4 hours | Site Outage | We experienced degraded performance for some AWS EBS volumes in the United States. The issue was caused by increased resource contention within the EBS subsystem responsible for coordinating EBS storage hosts. |
August 30, 2021 | 2 days | Some teachers reported that they cannot sync classes from Google Classroom | In 2020, a subset of teachers set the sync expiration date for August 30, 2021. We removed teacher's ability to set the expiration date from the UI due to user confusion; however, the expiration date was still in the cache and stopped the sync process for this subset of teachers. |
August 17, 2021 | 1 day | Some teachers reported that they cannot sync classes from Google Classroom | A specific path users followed to sync classes was not working properly to retrieve the rosters from Google Classroom. A patch was deployed on production to resolve this issue. |
April 30, 2021 | 2 hours | Ancillary resources not available | During a server patch deployment, there was a service conflict that occurred with one of our instances. |
February 09, 2021 | 4 hours | Browser connection not secure | Error renewing SSL certificate. |
February 02, 2021 | 4 hours | Intermittent access | Sudden spike in usage caused database to become slow and/or unresponsive for many users. |