Open sourcing h3i: a command line tool and library for low-level HTTP/3 testing and debugging
2024-12-30
h3i is a command line tool and Rust library designed for low-level testing and debugging of HTTP/3, which runs over QUIC....
Continue reading »
Elephants in tunnels: how Hyperdrive connects to databases inside your VPC networks
2024-10-25
Hyperdrive (Cloudflare’s globally distributed SQL connection pooler and cache) recently added support for directing database traffic from Workers across Cloudflare Tunnels. We dive deep on what it took to add this feature....
A good day to trie-hard: saving compute 1% at a time
2024-09-10
Pingora handles 35M+ requests per second, so saving a few microseconds per request can translate to thousands of dollars saved on computing costs. In this post, we share how we freed up over 500 CPU cores by optimizing one function and announce trie-hard, the open source crate that we created to do it....
Go wild: Wildcard support in Rules and a new open-source wildcard crate
2024-08-22
We’re excited to announce wildcard support across our Ruleset Engine-based products and our open-source wildcard crate in Rust. Configuring rules has never been easier, with powerful pattern matching enabling simple and flexible URL redirects and beyond for users on all plans....
Making WAF ML models go brrr: saving decades of processing time
2024-07-25
In this post, we discuss the performance optimizations we've implemented for our WAF ML product. We'll guide you through specific code examples and benchmark numbers, and we'll share the impressive latency reduction numbers observed after the rollout...
MORE POSTS
February 28, 2024 3:00 PM
Open sourcing Pingora: our Rust framework for building programmable network services
Pingora, our framework for building programmable and memory-safe network services, is now open source. Get started using Pingora today...
- By
January 24, 2024 2:00 PM
Introducing Foundations - our open source Rust service foundation library
Foundations is a foundational Rust library, designed to help scale programs for distributed, production-grade systems...
- By
August 14, 2023 1:00 PM
Wasm core dumps and debugging Rust in Cloudflare Workers
Debugging Rust and Wasm with Cloudflare Workers involves a lot of the good old time-consuming and nerve-wracking printf'ing strategy. What if there’s a better way? This blog is about enabling and using Wasm core dumps and how you can easily debug Rust in Cloudflare Workers...
- By
June 19, 2023 1:00 PM
Every request, every microsecond: scalable machine learning at Cloudflare
We'll describe the technical strategies that have enabled us to expand the number of machine learning features and models, all while substantially reducing the processing time for each HTTP request on our network...
- By
June 19, 2023 1:00 PM
How Cloudflare runs machine learning inference in microseconds
How we optimized bot management’s machine learning model execution...
- By
May 12, 2023 1:00 PM
How Pingora keeps count
In this blog post, we explain and open source the counting algorithm that powers Pingora. This will be the first of a series of blog posts that share both the Pingora libraries and the ideas behind them...
- By
April 20, 2023 1:00 PM
Oxy: Fish/Bumblebee/Splicer subsystems to improve reliability
We split a proxy application into multiple services to improve development agility and reliability. This blog also shares some common patterns we are leveraging to design a system supporting zero-downtime restart...
- By
April 04, 2023 1:00 PM
Oxy: the journey of graceful restarts
Deploying new versions of long-lived server software while maintaining a reliable experience is challenging. For oxy, we established several development and operational patterns to increase reliability and reduce friction in deployments...
- By
March 30, 2023 1:00 PM
From IP packets to HTTP: the many faces of our Oxy framework
We have recently introduced Oxy, our Rust-based framework for proxies powering many Cloudflare services and products. Today, we will explain why and how it spans various layers of the OSI model, by handling directly raw IP packets, TCP connections and UDP payloads...
- By
March 02, 2023 3:05 PM
Oxy is Cloudflare's Rust-based next generation proxy framework
In this blog post, we are proud to introduce Oxy - our modern proxy framework, developed using the Rust programming language...
- By
September 14, 2022 1:00 PM
How we built Pingora, the proxy that connects Cloudflare to the Internet
Today we are excited to talk about Pingora, a new HTTP proxy we’ve built in-house using Rust that serves over 1 trillion requests a day...
- By
September 15, 2021 12:59 PM
Building Cloudflare Images in Rust and Cloudflare Workers
Using Rust and Cloudflare Workers helps us quickly iterate and deliver product improvements over the coming weeks and months....
- By
September 09, 2021 1:00 PM
Native Rust support on Cloudflare Workers
Introducing the Cloudflare Workers Rust SDK: write your entire Worker in Rust, no JavaScript required. ...
- By
August 26, 2021 3:04 PM
Pin, Unpin, and why Rust needs them
Using async Rust libraries is usually easy. It's just like using normal Rust code, with a little async or .await here and there. But writing your own async libraries can be hard. ...
- By
December 25, 2020 2:00 PM
Using One Cron Parser Everywhere With Rust and Saffron
Cron parsers are everywhere, each supporting their own extensions on the cron string format, which made consistency between parts of Cron Triggers difficult to achieve. Today we’re showing how we easily solved this problem with Rust without needing to write the same code twice....
- By