When a partitioning change to our petabyte-scale ClickHouse cluster caused critical billing jobs to stall, standard metrics showed no obvious errors. This post explores how we identified severe lock contention in ClickHouse's query planner and built upstream patches to fix it.
Software Engineering
Our billing pipeline was suddenly slow. The culprit was a hidden bottleneck in ClickHouse
Cloudflare Blog · 2026-05-14
Related items
Software EngineeringAWS Architecture Blog
The Hidden Price Tag: Uncovering Hidden Costs in Cloud Architectures with the AWS Well-Architected Framework
In this post, we discuss how following the AWS Cloud Adoption Framework (AWS CAF) and AWS Well-Architected Framework can help reduce these risks through proper implementation of AWS guidance and best practices while taking into consideration the practical challenges organizations face in implementing these best prac...
Software EngineeringCloudflare Developer Platform Changelog
Pipelines, R2, Workers - Cloudflare Pipelines now available in beta
Cloudflare Pipelines is now available in beta, to all users with a Workers Paid plan. Pipelines let you ingest high volumes of real time data, without managing the underlying infrastructure. A single pipeline can ingest up to 100 MB of data per second, via HTTP or from a Worker . Ingested data is automatically batch...
Software EngineeringCloudflare Developer Platform Changelog
Pipelines - Pipelines and R2 Data Catalog now supported in Terraform
Cloudflare Pipelines ingests streaming data via Workers or HTTP endpoints, transforms it with SQL, and writes it to R2 as Apache Iceberg tables. R2 Data Catalog manages those Iceberg tables, compaction, and compatibility with query engines like R2 SQL , Spark , and DuckDB . You can now create and manage both product...
Software EngineeringCloudflare Blog
The AI engineering stack we built internally — on the platform we ship
We built our internal AI engineering stack on the same products we ship. That means 20 million requests routed through AI Gateway, 241 billion tokens processed, and inference running on Workers AI, serving more than 3,683 internal users. Here's how we did it.
Software EngineeringCloudflare Developer Platform Changelog
Browser Run - Introducing pricing for the Browser Rendering API — $0.09 per browser hour
We’ve launched pricing for Browser Rendering , including a free tier and a pay-as-you-go model that scales with your needs. Starting August 20, 2025 , Cloudflare will begin billing for Browser Rendering. There are two ways to use Browser Rendering. Depending on the method you use, here’s how billing will work: REST...
Software EngineeringCloudflare Developer Platform Changelog
Workers - Deploy a Workers application in seconds with one-click
You can now add a Deploy to Cloudflare button to the README of your Git repository containing a Workers application — making it simple for other developers to quickly set up and deploy your project! The Deploy to Cloudflare button: Creates a new Git repository on your GitHub/ GitLab account : Cloudflare will automat...