How CloudStats.me moved from MySQL to clustered MariaDB for high availability

Presented by Andrey Vasilyev and Art van Scheppingen

Webinar Replay

Webinar Slides

Please Sign In to View Content

To view the webinar replay video or slides, "How CloudStats.me moved from MySQL to clustered MariaDB for high availability", you must be signed in using your Severalnines.com account. If you don't already have an account you can create one in just a couple minutes. Just click on the "Login to View" button below.

CloudStats.me is a fast growing cloud-based server and website monitoring service. The rapid growth of the CloudStats user base and the number of services being monitored created a significant load on its MySQL infrastructure. The system ingests large amounts of incoming metrics/event data collected by thousands of agents. The backend systems also perform analytics on large portions of that data, and alerts are triggered as soon as certain conditions are met.

Agenda

CloudStats.me infrastructure overview
Database challenges
Limitations in cloud-based infrastructure
Scaling MySQL - many options (MySQL Cluster, Master-Slave Replication, Sharding, etc)
Availability and failover
Application sharding vs auto-sharding
Migration to MariaDB / Galera Cluster with ClusterControl + NoSQL
Load Balancing with HAProxy/MaxScale
Infrastructure set up provided to CloudStats.me (Private Network, Cluster Nodes, H/W SSD Raid + BBU)
What we learnt - “Know your data!”

Presenters

Andrey Vasilyev

Andrey Vasilyev is the CTO of Aqua Networks Limited - a London-based company which owns brands, such as WooServers.com, CloudStats.me and CloudLayar.com.

Art van Scheppingen

Art van Scheppingen is a Senior Support Engineer at Severalnines. He’s a pragmatic MySQL and Database expert with over 15 years experience in web development. He previously worked at Spil Games as Head of Database Engineering, where he kept a broad vision upon the whole database environment: from MySQL to Couchbase, Vertica to Hadoop and from Sphinx Search to SOLR. He regularly presents his work and projects at various conferences (Percona Live, FOSDEM) and related meetups.