Technical Talks

View All

Building Highly Reliable Data Pipelines at Datadog

Quentin Francois Quentin Francois | Data Engineering Team Lead | Datadog

Every day at Datadog we run massive data pipelines to power core functionality. In this talk, we'll cover best practices we use at Datadog to ensure that we reliably deliver this functionality while processing trillions of points/day in the face of exponential data growth, hardware failures, corrupt data, and even human error.
💾 Download Slides
Quentin Francois
Quentin Francois
Data Engineering Team Lead | Datadog

Quentin is a Data Engineering Team Lead at Datadog. Over the past 3 years, he has worked with Luigi, Spark, and Go to build and scale many highly reliable data pipelines. These pipelines power numerous internal and customer facing features - including enabling Datadog's users to perform fast real time queries against PBs of historical time series data.

FEATURED MEETINGS

event1-590x332_wm3.jpg
event1-590x332_wm3.jpg
event1-590x332_wm3.jpg