At Criteo, we’ve relied on automatic aggregations for years. “Automatic aggregation” is the name we give to a system of recording rules that matches most metrics and removes certain dimensions, such as the instance emitting the metric, to reduce the cardinality (i.e., the number of metrics) and thus makes queries faster. What started as a workaround has become a key part of how we ensure backend stability and reliability at scale, with hundreds of millions of active metrics, all without requiring users to write a single recording rule. It also significantly reduces the cost of metrics storage. Internally, we call this approach zero-effort Observability, as most teams don’t have to write/maintain recording rules. In this talk, Raphael will explain how our approach to automatic aggregations has evolved over time and how we’ve adapted it to fit naturally into our Prometheus-based stack. He will share the different implementations we’ve tried, the lessons we’ve learned, and how our latest version takes advantage of recent improvements in Prometheus (new type label).
talk-data.com
Topic
Prometheus
monitoring
alerting
time_series_database
1
tagged
Activity Trend
2
peak/qtr
2020-Q1
2026-Q1
Top Events
Data Engineering Podcast
5
VictoriaMetrics | Criteo - Observability Meetup in Paris 🇫🇷 - Tech Event
2
SQL Superpowers and Smart Plant Monitoring with Grafana
1
O'Reilly Data Science Books
1
Kubernetes & Cloud Native Berlin Meetup May Edition
1
New Relic Breakfast Club: Amsterdam
1
Inaugural Grafana & Friends London Meetup!
1
Sensors to Screens: Building Real-Time IoT & Physical Dashboards w Raspberry Pi
1
AWS Women’s UG Berlin November Meetup - AWS Cloud Talks
1
Airflow Summit 2022
1
Observability Insights with Grafana, HelloFresh and Reddit
1
New Relic Breakfast Club: London
1
Filtering by:
Raphael Bizos
×