Manish Gill works at ClickHouse Inc, where he is managing the AutoScaling team for ClickHouse Cloud. He is based out of Berlin and is deeply interested in Databases and Cloud challenges and runs https://berlinsystems.xyz/ on the side.

Presentations

22x

Dancing with the Pods: Live migration of a database fleet while serving millions of queries

ClickHouse recently undertook a major refactoring of our operator to change how we orchestrate customer-provisioned databases through Kubernetes StatefulSets.

The challenge? Migrating thousands of services to the new orchestration system without any downtime. This talk explores how we accomplished this migration, diving into the complex challenges we faced and solved. We'll cover our custom migration controller, durable execution workflows, and database synchronization hurdles that emerged while keeping ClickHouse Cloud's fleet running smoothly.

See Presentation