MozMEAO SRE Status Report - January 23, 2018

Here’s what happened on the MozMEAO SRE team from December 2017 - January 23.

Current work

SRE general

We’re busy setting up multiple Kubernetes 1.8 clusters in us-west-2 to serve SUMO, Bedrock and other MozMEAO applications. These new clusters will replace our Deis 1 cluster in the same region.

The Bedrock team will be moving from an RDS database to updates distributed via S3. This will make Bedrock hosting cheaper and easier to manage.

Additionally, Bedrock needs to be tweaked to run on Kubernetes natively as Deis Workflow is being discontinued.


MDN is switching it’s Celery results backend from MySQL to Redis, to avoid database reads/writes. No significant difference in throughput noticed. (SUMO)

Work is progressing quickly on the SUMO move from SCL3 to AWS.

User media is now hosted by S3 and Cloudfront in SCL3 as of 2017-01-17 14:14 UTC. This makes our migration easier as it’s one less component we have to plan for on go-live day.

We’ve been discussing SUMO database architecture with a focus on high uptime. We’re also discussing our Elasticsearch architecture.

Work on a new CDN is in-progress for hosting static media in AWS. We’ll need to request a few DNS changes and certificates in order to proceed.

The team is also working on establishing MySQL replication between SCL3 and RDS, in order to significantly decrease the deployment window on migration day.