Migrating billions of records: moving our active DNS database while it’s in use
2024-10-29
DNS records have moved to a new database, bringing improved performance and reliability to all customers....
Continue reading »
Making zone management more efficient with batch DNS record updates
2024-09-23
In response to customer demand, we now support the ability to DELETE, PATCH, PUT and POST multiple DNS records in a single API call, enabling more efficient and reliable zone management. ...
Cloudflare Workers database integration with Upstash
2023-08-02
Announcing the new Upstash database integrations for Workers. Now it is easier to use Upstash Redis, Kafka and QStash inside your Worker ...
Intelligent, automatic restarts for unhealthy Kafka consumers
2023-01-24
At Cloudflare, we take steps to ensure we are resilient against failure at all levels of our infrastructure. This includes Kafka, which we use for critical workflows such as sending time-sensitive emails and alerts....
Using Apache Kafka to process 1 trillion inter-service messages
2022-07-19
We learnt a lot about Kafka on the way to 1 trillion messages, and built some interesting internal tools to ease adoption that will be explored in this blog post...
MORE POSTS
May 25, 2022 12:59 PM
How we improved DNS record build speed by more than 4,000x
How we redesigned our DNS pipeline to significantly improve DNS propagation speed across all zones....
- By
November 20, 2020 12:00 PM
Getting to the Core: Benchmarking Cloudflare’s Latest Server Hardware
A refresh of the hardware that Cloudflare uses to run analytics provided big efficiency improvements....
- By
May 13, 2018 4:00 PM
Tracing System CPU on Debian Stretch
How an innocent OS upgrade triggered a cascade of issues and forced us into tracing Linux networking internals....
- By
March 06, 2018 1:00 PM
HTTP Analytics for 6M requests per second using ClickHouse
One of our large scale data infrastructure challenges here at Cloudflare is around providing HTTP traffic analytics to our customers. HTTP Analytics is available to all our customers via two options:...
- By
March 05, 2018 4:17 PM
Squeezing the firehose: getting the most from Kafka compression
How Cloudflare was able to save hundreds of gigabits of network bandwidth and terabytes of storage from Kafka....
- By
April 09, 2015 5:32 PM
Scaling out PostgreSQL for CloudFlare Analytics using CitusDB
When I joined CloudFlare about 18 months ago, we had just started to build out our new Data Platform. At that point, the log processing and analytics pipeline built in the early days of the company had reached its limits. ...
- By