How CloudStats.me moved from MySQL to clustered MariaDB for high availability
CloudStats.me is a fast growing cloud-based server and website monitoring service. The rapid growth of the CloudStats user base and the number of services being monitored created a significant load on its MySQL infrastructure. The system ingests large amounts of incoming metrics/event data collected by thousands of agents. The backend systems also perform analytics on large portions of that data, and alerts are triggered as soon as certain conditions are met.
Agenda
- CloudStats.me infrastructure overview
- Database challenges
- Limitations in cloud-based infrastructure
- Scaling MySQL - many options (MySQL Cluster, Master-Slave Replication, Sharding, etc)
- Availability and failover
- Application sharding vs auto-sharding
- Migration to MariaDB / Galera Cluster with ClusterControl + NoSQL
- Load Balancing with HAProxy/MaxScale
- Infrastructure set up provided to CloudStats.me (Private Network, Cluster Nodes, H/W SSD Raid + BBU)
- What we learnt - “Know your data!”
Presenters
Andrey Vasilyev is the CTO of Aqua Networks Limited - a London-based company which owns brands, such as WooServers.com, CloudStats.me and CloudLayar.com.
Art van Scheppingen is a Senior Support Engineer at Severalnines. He’s a pragmatic MySQL and Database expert with over 15 years experience in web development. He previously worked at Spil Games as Head of Database Engineering, where he kept a broad vision upon the whole database environment: from MySQL to Couchbase, Vertica to Hadoop and from Sphinx Search to SOLR. He regularly presents his work and projects at various conferences (Percona Live, FOSDEM) and related meetups.
Comments & questions
Follow Us
