Beyond TSDB: Unlocking Prometheus with Parquet for Modern Sc... J. Vazquez, A. Protasio, M. Hoffmann

Dec 19, 2025Channel
AI Analysis
Data from YouTube Data API v3Updated Just now

Video Overview

Video Details

Published5 months ago
Duration29:26
Video IDeg1FaJ9UuWs
Languageen
CategoryScience & Technology
PrivacyPublic
Made for KidsNo
Video TypeRegular Video

Performance Metrics

Views66
Likes3
Comments0
Engagement Rate4.55%
Likes per 100 views4.55
Comments per 1K views0.00

Description

Don't miss out! Join us at our next Flagship Conference: KubeCon + CloudNativeCon events in Amsterdam, The Netherlands (23-26 March, 2026). Connect with our current graduated, incubating, and sandbox projects as the community gathers to further the education and advancement of cloud native computing. Learn more at https://kubecon.io Beyond TSDB: Unlocking Prometheus with Parquet for Modern Scale - Jesus Vazquez, Alan Protasio, Michael Hoffmann Prometheus has been the main tool for time-series metrics in cloud-native world. Its TSDB format is used in many projects like Thanos, Cortex, and Mimir. But now, with OpenTelemetry’s need for an increased amount of time series dimensions, the well known limitations with high cardinality and slow queries from object storage are more pressing. In this talk, we want to share how we, from Grafana Labs (Mimir), AWS Managed Prometheus (Cortex), and Cloudflare (Thanos), tried to replace the Prometheus TSDB with Apache Parquet. Parquet is a columnar storage format that is already popular for big data analytics. We will talk about what we learned from running Parquet storage in production. You will hear about the architecture, the problems we found, and the improvements we saw when we stored labels and chunks in Parquet. We hope you will see how Parquet can solve some old problems and help Prometheus go to the next level. We also want to invite you to help support Parquet in Prometheus directly. All this work happened in the open, with conversations and code shared in CNCF Slack and on the Prometheus Community GitHub. We believe this open way is important, so everyone can join, give feedback, and help make Prometheus better for all.

Related Videos

More videos from CNCF [Cloud Native Computing Foundation]