Shopify’s Open Source Approach to Network Monitoring with eBPF, Vector and ClickHouse
Sebastian Rabenhorst & Matt Franklin, Shopify
At Shopify, they successfully implemented a scalable, open-source network monitoring solution for the cloud. In this talk, they will demonstrate how they built a network monitoring solution leveraging eBPF, Vector, ClickHouse, and Grafana. This solution enables them to monitor over 30 million network flow, DNS and other networking-related events per second at the container level for thousands of services across hundreds of Kubernetes clusters in the Shopify Cloud.
ClickHouse at DoorDash
How DoorDash monitors TCP and DNS traffic helping their observability team take care of their kubernetes infrastructure.
How Modal delivers instant search on 500B+ logs
How Modal solved a scaling bottleneck by switching to ClickHouse, transforming their logging infrastructure into a system that handles half a trillion logs and delivers instant search results.
ClickHouse at Ramp: Just OLAP it
Ryan Delgado, Engineering at Ramp, shares how his team boosted analytics performance by moving from Postgres to ClickHouse, turning slow queries into reports running hundreds of times faster.
