Super Slurper now transfers data from cloud object storage providers like AWS S3 and Google Cloud Storage to Cloudflare R2 up to 5x faster than it did before. We moved from a centralized service to a distributed system built on the Cloudflare Developer Platform — using Cloudflare Workers , Durable Objects , and Queu...
Software Engineering
R2 - Super Slurper now transfers data to R2 up to 5x faster
Cloudflare Developer Platform Changelog · 2025-02-14
Related items
Software EngineeringCloudflare Developer Platform Changelog
R2 - R2 Data Catalog now supports compaction
You can now enable automatic compaction for Apache Iceberg tables in R2 Data Catalog to improve query performance. Compaction is the process of taking a group of small files and combining them into fewer larger files. This is an important maintenance operation as it helps ensure that query performance remains consis...
Software EngineeringCloudflare Developer Platform Changelog
R2 - Super Slurper now supports migrations from all S3-compatible storage providers
Super Slurper can now migrate data from any S3-compatible object storage provider to Cloudflare R2 . This includes transfers from services like MinIO, Wasabi, Backblaze B2, and DigitalOcean Spaces. For more information on Super Slurper and how to migrate data from your existing S3-compatible storage buckets to R2, r...
Software EngineeringCloudflare Developer Platform Changelog
Pipelines - Pipelines and R2 Data Catalog now supported in Terraform
Cloudflare Pipelines ingests streaming data via Workers or HTTP endpoints, transforms it with SQL, and writes it to R2 as Apache Iceberg tables. R2 Data Catalog manages those Iceberg tables, compaction, and compatibility with query engines like R2 SQL , Spark , and DuckDB . You can now create and manage both product...
Software EngineeringCloudflare Developer Platform Changelog
Hyperdrive - Up to 10x faster cached queries for Hyperdrive
Hyperdrive now caches queries in all Cloudflare locations, decreasing cache hit latency by up to 90%. When you make a query to your database and Hyperdrive has cached the query results, Hyperdrive will now return the results from the nearest cache. By caching data closer to your users, the latency for cache hits red...
Software EngineeringCloudflare Developer Platform Changelog
Vectorize - Vectorize indexes now support up to 10 million vectors
You can now store up to 10 million vectors in a single Vectorize index, doubling the previous limit of 5 million vectors. This enables larger-scale semantic search, recommendation systems, and retrieval-augmented generation (RAG) applications without splitting data across multiple indexes. Vectorize continues to sup...
Software EngineeringCloudflare Developer Platform Changelog
R2 - R2 Data Catalog now supports automatic snapshot expiration
R2 Data Catalog now supports automatic snapshot expiration for Apache Iceberg tables. In Apache Iceberg, a snapshot is metadata that represents the state of a table at a given point in time. Every mutation creates a new snapshot which enable powerful features like time travel queries and rollback capabilities but wi...