Tag
7 posts
Serve the cached value immediately, even if slightly old, and refresh it in the background. Learn the idea, the HTTP Cache-Control directives and an in-process implementation with a freshness window and a grace window.
When a hot cache entry expires, a hundred requests recompute it at once. Coalesce concurrent misses so one loads and the rest wait, with moka get_with, a hand-rolled version and a note on stale-while-revalidate.
Cache the result of an expensive pure function in a HashMap or with the cached crate. Includes the recursion pattern, key design, bounded size and when memoizing is the wrong fix.
Why a one-line change recompiles every crate in Docker, and the fixes in order of effort: copy order, a dummy main trick, cargo-chef, BuildKit cache mounts and a pinned base.
Choose how a cache learns that data changed: TTL, explicit invalidation on write, versioned keys, events, stale while revalidate, and how to stop stampedes.
Data layout and access patterns decide speed more than instructions. Learn cache lines, contiguous iteration, struct of arrays, branch prediction effects and how to test them.
Cache the Cargo registry and target directory in CI with Swatinem/rust-cache. Learn what is cached, the cache key, why caches go stale and how to keep restore times low.