
I make AI compute fast, efficient, and reliable, from the serving layer down to the hardware and the power behind it.
New York, NY | Software Engineer II @ AWS
At AWS I build fault-tolerant, multi-tenant payment and IoT systems. Outside work I build the layer AI runs on: a straggler detector for distributed GPU training, merged fixes in vLLM and Firecracker, a Rust temporal join engine, and a sub-microsecond C++ order book.
Resume (PDF) | LinkedIn | GitHub | ryan.j.hamby@gmail.com
Check out my Personal Tech Blog!
Systems, performance, and the craft of building software. Read more
- Kubernetes' Second Act: From Container Orchestrator to AI Operating System — Introduction There’s a version of this story where Kubernetes “came back.” That framing is wrong. Kubernetes never left—it lost the narrative. Between 2020 and …
- Optical Cables and Multicast: Why Your Network Hardware Matters More Than You Think — The Problem You’ve optimized your multicast application. The code is clean. The algorithm is sound. Yet your latency numbers lag behind competitors, and you can’t …
- Cache Eviction: 30 Years of Improvements — Introduction Cache hierarchies are everywhere—from L1/L2/L3 on your CPU to Redis clusters backing your microservices. But the way we organize and manage these tiers has …
Featured Projects
GPU Flight Recorder
Finds the straggling rank in distributed GPU training and explains why it is slow, joining PyTorch NCCL collective timings with per-GPU hardware telemetry.
Explore →vLLM & Firecracker
Merged fixes in vLLM (Qwen3-Omni multimodal crash and processor-cache false positives) and Firecracker (VMM panic on ACPI device restore).
Explore →FlowState
Rust as-of join engine with zero-copy Arrow, parallel merge scans, and streaming watermark joins for point-in-time ML features.
Explore →Order Book Engine
Order matching engine with slab memory pools and lock-free SPSC ingestion, benchmarked on isolated EC2 cores.
Explore →Stock Screener
Daily Minervini Trend Template scanner over 3,800+ US stocks, automated with GitHub Actions and Git-based caching.
Explore →Java4Java
Cross-platform spaced repetition app for algorithm practice on iOS, Android, and macOS.
Explore →