talk-data.com talk-data.com

Company

Criteo

Speakers

4

Activities

5

Speakers from Criteo

Talks & appearances

5 activities from Criteo speakers

At Criteo, we’ve relied on automatic aggregations for years. “Automatic aggregation” is the name we give to a system of recording rules that matches most metrics and removes certain dimensions, such as the instance emitting the metric, to reduce the cardinality (i.e., the number of metrics) and thus makes queries faster. What started as a workaround has become a key part of how we ensure backend stability and reliability at scale, with hundreds of millions of active metrics, all without requiring users to write a single recording rule. It also significantly reduces the cost of metrics storage. Internally, we call this approach zero-effort Observability, as most teams don’t have to write/maintain recording rules. In this talk, Raphael will explain how our approach to automatic aggregations has evolved over time and how we’ve adapted it to fit naturally into our Prometheus-based stack. He will share the different implementations we’ve tried, the lessons we’ve learned, and how our latest version takes advantage of recent improvements in Prometheus (new type label).

Kafka est un outil puissant, mais son intégration peut vite ressembler à de la magie noire : configuration complexe, gestion fine des partitions, des retries, des schémas… Cette présentation propose de démystifier Kafka en explorant ses cas d’usage concrets (broadcast, coopération entre instances), sa configuration, et surtout comment notre SDK maison en C# simplifie son utilisation.

Kafka est un outil puissant, mais son intégration peut vite ressembler à de la magie noire : configuration complexe, gestion fine des partitions, des retries, des schémas… Cette présentation propose de démystifier Kafka en explorant ses cas d’usage concrets (broadcast, coopération entre instances), sa configuration, et surtout comment notre SDK maison en C# simplifie son utilisation.

We will share Criteo's journey of integrating authentication and authorisation into our Kafka infrastructure, including how we incorporated OAuth and JWT authentication systems into Kafka to enhance the security of our data streams. The talk covers the obstacles we faced and the lessons learned during transforming an open Kafka infra into a safeguarded platform.