Ingesting Live Video Streams at Global Scale (Twitch Engineering)

Description

Twitch engineering case study on replacing static HAProxy routing with "Intelligest," a capacity/network-aware live ingest routing system across ~100 PoPs.

URL

• Visit resource

Related resources

• From ExoPlayer2 to Media3: Rebuilding Android Playback at PatreonEngineering case study on migrating production Android playback stack from ExoPlayer2 to Media3, with real tradeoffs.
• Twitch/AMD/NGCodec FPGA VP9 Encoding Case StudyCase study on FPGA-accelerated VP9 encoding at Twitch, showing 25% bitrate savings and 30x performance over CPU encoding.
• Building Service Topology at Scale (Netflix Tech Blog)Real-time service dependency-mapping system for streaming microservices at scale, architecture and lessons learned.
• High Quality Video Encoding at Scale (Netflix Tech Blog)Deep-dive into Netflix's EC2-based elastic encode pipeline, per-title encoding, and automated quality scoring.
• VisualOn + Axinom Joint Whitepaper: Encoding Cost Optimization2025 joint technical whitepaper covering encoding cost optimization across DASH/HLS/CMAF and DRM (Widevine/PlayReady/FairPlay) tradeoffs.
• A Hitchhiker's Guide to Structural SimilarityNetflix-affiliated deep-dive paper on SSIM quality metrics and their application to streaming QoE evaluation.
• Video Encoding to AV1 Guide (WIP)Long-running community-maintained guide to AV1 software encoding (libaom/aomenc) on the Level1Techs forum.
• Building Your Own Scalable Video Streaming Server (Part 1)Code-along tutorial series building a microservices-based video streaming server with FFmpeg HLS segmenting.
• Building Your First Video Pipeline: FFmpeg & MediaMTX Basics (Part 1)Technical tutorial walking through demux→decode→filter→encode→mux pipeline stages toward building a low-latency streaming setup with FFmpeg…
• Fora Soft: Video Streaming Deep-Dive GuideFree 9-chapter technical guide covering HLS, DASH, WebRTC, CMAF, CDN, and DRM fundamentals.
• OTT Reference Architecture (Fora Soft)Conceptual model framing OTT platforms as data plane (ingest/encode/package/encrypt/origin/CDN/player) vs control plane (identity/entitleme…
• How Disney Built Their Streaming Data Analytics PlatformDisney+ real-time analytics architecture using Kinesis Data Streams, Kinesis Data Analytics (Flink), and Firehose feeding recommendations a…
• Encoding Bitrate Optimization Using Playback Statistics for HTTP-based Adaptive Video StreamingAcademic paper with industry framing on ABR bitrate ladder optimization using real playback statistics.
• Unreeling Netflix: Understanding and Improving Multi-CDN Movie DeliveryAcademic paper (Princeton/Bell Labs) measuring Netflix's multi-CDN delivery architecture, DNS-based CDN selection, and AWS backend.
• Live Streaming Architecture: Ingest, Transcoding, and Delivery at ScaleIndependent technical deep dive into segment chunking, manifest generation, ABR client polling logic, and manifest-as-single-point-of-failu…