Distributed systems

Queues, service discovery, sockets and resilience patterns: the infrastructure under AI.

3 articles · 1 talk · All topics

Articles

PipelineOrchestratorEdu: Watch Backpressure Happen in Real-Time

A technical review of an educational multi-stage pipeline built with .NET 9, Blazor Server, and SignalR. Demonstrates backpressure mechanics, circuit breakers, and real-time queue visualization—letting developers watch queue depths fluctuate, backpressure activate, and workers fail and recover, all on their local machine.

Review Distributed systems 12 min

RetrievalAugmentedGenerationEdu: Multi-Model RAG with Enterprise Resilience Monitoring

A technical review of an educational RAG system built with .NET 9 and Semantic Kernel. Demonstrates Clean Architecture applied to AI/ML, multi-model language support (Phi-4, Llama, Mistral, GPT), 5 embedding strategies, and production-grade resilience patterns including circuit breakers, retry with backoff, and timeout protection—all processing real PDF manuals locally.

Review Distributed systems 14 min

Talks and videos

Clustering in Orleans (opens YouTube)

Reuben Bond explains how clustering works inside Microsoft Orleans. Covers how application instances discover each other through a shared membership table (Redis, Azure Table Storage, Cosmos DB), health monitoring via ping/pong probes arranged on a consistent hash ring, the voting mechanism that declares unresponsive nodes as down, handling the distinction between crashed and slow nodes, heterogeneous clusters with different grain types, and indirect probing strategies inspired by the Lifeguard research paper.