RSS System Design Articles

System design decisions, architectures and failures from engineering blogs.

Updated Every Day at 8:00 AM Pacific Time

Showing the last 7 days only. Subscribe to the RSS feed to get every article.

About This Feed · Suggest a blog

  • – Automating agentic AI Well-Architected reviews with the AWS Agentic AI Lens

    Smarsh built a Claude skill that reviews an agentic workload against 150 AWS Agentic AI Lens best practices, using a JSON dataset, an evidence rubric and a deterministic workbook generator.

  • – How Revinate accelerated API adoption with Amazon API Gateway

    Revinate explains why it chose Amazon API Gateway and its portal over self-managed or enterprise gateways, and why it connected to EKS using TargetGroupBinding with Network Load Balancer target groups.

  • – How Uber Built A Gateway For AI Agents To Access Tools

    The article explains how Uber built an MCP Gateway with a registry, a proxy that translates to HTTP, gRPC and TChannel, AutoCrawler tool discovery, tool-level access control and context-saving features.

  • – Adopting Cloud SQL Backup Vault to meet strict backup requirements (DeNA Infra SRE) (translated from Japanese)

    DeNA describes adopting Cloud SQL Backup Vault with a cross-project setup for immutable backups, estimating about 77% lower monthly cost than daily GCS exports and noting plan and billing limits.

  • – 2026 Summer Engineering Intern Projects – Part One

    Summarizes three summer 2026 intern projects on trustworthy LLM systems: a data-quality check suggester, an agent that builds dashboards, and an automated root cause analysis pipeline for multi-agent failures.

  • – eBay Inc. Reports Third Quarter 2026 Results

    eBay reports third quarter 2026 results, with revenue of 3.2 billion dollars, GMV of 23.2 billion dollars, business highlights, guidance and the Depop acquisition.

  • – Behind the scenes, two months later: How we ship Google Agent Skills like products

    Google describes the pull request pipeline for its Agent Skills repository, with linters, semantic versioning checks, eval-suite validation, link checks, an AI review agent and human approval.

  • – Hill-Climbing Agent Quality with Agents CLI Evaluation

    A walkthrough of the Agents CLI eval commands on a LangChain agent, covering baseline scoring, a prompt regression, a model swap, nightly scheduled runs, threshold alerts and prompt optimization.

  • – How GKE networking scales to support high densities of concurrent AI agents

    Google explains how moving high-cardinality pod labels to annotations and filtering labels in GKE Dataplane V2 avoids the 65,536 Cilium identity limit for high-density agent sandboxes.

  • – How to troubleshoot GKE workloads faster with VPC Flow Logs

    Google shows how VPC Flow Logs annotated with GKE metadata and Flow Analyzer can map workload traffic, inspect callers of a service and find cross-zone pod traffic.

  • – Introducing the AlloyDB Omni web UI for easier cluster observability

    Google announces general availability of a read-only AlloyDB Omni web UI showing system telemetry, query performance, columnar engine usage and database flags.

  • – Near-zero downtime upgrades: Announcing Cloud SQL for MySQL blue-green deployments

    Google announces a preview of managed blue-green deployments for Cloud SQL for MySQL, using a replicated green clone and a switchover that keeps the IP address, instance name and backups.

  • – Smaller apps and faster GPU inference with LiteRT in Google Play services

    Google announces that LiteRT in Google Play services now supports GPU inference about 1.4x faster through the CompiledModel API, and that switching makes apps about 8 MB smaller.

  • – Step into a new dimension with XREAL AURA, the first-of-its-kind wired XR glasses

    Google announces XREAL AURA wired XR glasses on Android XR, with a split-compute architecture, a 70-degree field of view and Android Enterprise device management features.

  • – Meta Andromeda: Powering the Next Generation of Ads Retrieval Through Model-System Co-Design

    Meta describes the next Andromeda ads retrieval system, using a mixture-of-experts gating model, a fused GPU kernel and single-GPU co-location to score over one billion ads per second per server.

  • – Agentic harnesses (epilogue): working day to day with a frontier agent (translated from French)

    The epilogue of an OCTO series describes a Claude Code workflow of agent interviews, Opus planning and Sonnet implementation, plus methods to re-audit the harness and reduce token use.

  • – Et si votre super idée “innovante” de projet Agentique avait déjà été pensée par votre éditeur de Data Plateforme ?

    OCTO argues that data platform vendors such as Databricks, Snowflake and Dataiku now package common agentic project patterns, and weighs fast experimentation against vendor dependence.

  • – A JSON schema Is not an AI governance layer

    The author of the PIC protocol explains how duplicate identifiers, input normalization and self-asserted trust made agent action verifiers disagree, and proposes schema, semantic and policy layers with conformance vectors.

  • – How Anchorage Digital and Turnkey verify code with AWS Nitro Enclaves

    Anchorage Digital and Turnkey run the VisualSign transaction parser inside AWS Nitro Enclaves so wallets can verify through attestation and reproducible builds which code parsed a transaction.

  • – Publishing LMS courses with a Kiro SCORM pipeline

    AWS shows how Kiro steering files, specs and hooks turn raw training material into SCORM 1.2 course packages through plan, author, lint, build and validate steps.

  • – Vessel-specific voyage optimization with machine learning: Manta on AWS

    Manta Marine Technologies trains a model per vessel on AWS, using Airflow to run ETL, training and voyage optimization as ECS tasks on EC2 with per-instance-type capacity providers.

  • – How Apple Fits an LLM on Your iPhone

    A summary of how Apple runs a 3-billion-parameter model on the iPhone using palettization, quantization-aware training, cross-layer KV sharing, LoRA adapters and Private Cloud Compute.

  • – Introducing the Cloudflare PHP Capture the Flag challenge

    Cloudflare launches a PHP Capture the Flag challenge on HackerOne inviting researchers to bypass its WAF rules for the php2shell vulnerabilities and recover a flag file.

  • – What took the Internet offline in Q3 2026

    Cloudflare Radar reviews 49 Internet disruptions in Q3 2026, including exam shutdowns in Iraq, power outages in Cuba, Honduras and Ukraine, and earthquakes and floods.

  • – From spot fixes to measured gains: improving document extraction accuracy with ai_extract and MLflow Prompt Registry

    Databricks describes improving ai_extract accuracy on about 40 fields by versioning prompts and schemas in MLflow Prompt Registry and scoring candidates against reviewer-approved ground truth, cutting errors by 32%.

  • – How to make postMessage type-safe in under 350 bytes

    Evil Martians describes typed-channel, a 271-byte library that makes postMessage, event buses and Figma plugin messaging type-safe, and its 0.11 request API with AbortSignal cancellation.

  • – Beyond the Prompt: Engineering the Loop for Software Change at Scale

    Expedia Group describes an agent loop built on a Modularization MCP server, deterministic scripts, build and test gates and persistent memory that modularized its Shared iOS Components Stack in about three months.

  • – Bringing Google TPUs to Oracle Cloud Infrastructure

    Oracle and Google Cloud announce Google TPUs on Oracle Cloud Infrastructure starting in 2027, citing TPU goodput, performance per dollar and proximity to Oracle enterprise data.

  • – Building Conversational Commerce with Multi-Agent Swarms on GCP: A Working Prototype

    The HappyDelivery prototype implements conversational grocery ordering with a Pub/Sub-backed webhook ingress, a Redis session store and a LangGraph agent swarm on Gemini, reporting latency figures and about 4,240 tokens per session.

  • – Fast, reliable A2UI, with swappable inference formats

    Google introduces swappable inference formats for A2UI, making the Python-like A2UI Express the default after comparing four formats, and shows the Jev decision model building fixed-layout screens in the Apparite example.

  • – Gemini Robotics Embodied Reasoning 2 is now available on Google Cloud

    Google announces public preview of Gemini Robotics Embodied Reasoning 2 on the Gemini platform, describing task verification, multi-robot orchestration and tool calling for robots.

  • – Introducing VMware solution on Google Cloud

    Google Cloud announces general availability of a self-managed VMware solution on dedicated Z3 bare metal with VCF license portability, vSAN storage and NVMe memory tiering in 22 regions.

  • – Powering the agentic enterprise with latest innovations in Oracle AI Database@Google Cloud

    Google Cloud and Oracle announce Oracle AI Database@Google Cloud features including a remote MCP server, a Gemini connector, bi-directional Iceberg lakehouse access, GoldenGate CDC and BigQuery federation.

  • – Securely connecting Gemini Enterprise to Snowflake data

    A guide to connecting a Gemini Enterprise agent built with Google ADK to a Snowflake Cortex Agent over MCP, running queries with each user's OAuth session and role.

  • – How Spec-Driven Development Shaped My New Way of Engineering

    A Gusto engineer describes adopting spec-driven development with AI agents, moving from spec-kit to OpenSpec, and adding a reviewer agent that scores spec and implementation alignment before pull requests.

  • – [Intern report] Re-architecting the Settlement Service that supports merchant settlement (translated from Japanese)

    An intern describes the Settlement Service v1 to v2 re-architecture and the design of Transaction Clearing, which uses idempotency keys, ordered side effects, error detection and the Magician workflow engine for retries.

  • – PrivacyLib: Privacy Controls at the Data Access Boundary

    Meta describes PrivacyLib, a library inside the clients of hundreds of data systems that runs privacy modules such as Policy Zones on billions of checks per second, including agent tool calls.

  • – Python Typing Survey 2026: AI Tools and the Shifting Checker Landscape

    The 2026 Python Typing Survey of 1,794 respondents reports stable type hint use, a shift in checker choice, more AI tools writing types, and missing library types as the main difficulty.

  • – 3 Ways to Boost MoE Inference on NVIDIA DGX Spark

    NVIDIA shows how Humming MoE kernels, FP8 LM-head quantization and MTP speculative decoding raised Ling-3.0-flash decode throughput by 42.5% on GSM8K on a DGX Spark.

  • – Fine-Tuning NVIDIA Nemotron to Know Local Rules, Not Just Local Languages

    NVIDIA shows how to fine-tune Nemotron 3.5 Lightning with LoRA on synthetic conversations from Nemotron-Personas-France to build a French public-service support agent and evaluate it.

  • – Memory-Enforced GPU Sharing in Kubernetes with NVIDIA CUDA 13.4

    NVIDIA introduces the open-source gpu-fractioning operator and KAI Scheduler NvFractions mode, which use CUDA 13.4 to enforce per-workload GPU memory limits and compute modes in Kubernetes.

  • – NVIDIA RTX Spark Powers Neural Rendering and AI Characters in Games

    NVIDIA describes game developer technologies for its RTX Spark Windows PC platform, including DLSS 5, the Nemotron 3.5 Bolt E4B 4GB on-device model, RTX Kit SDKs, Nsight tools and MotionBricks.

  • – What happened with npm packages over the last 12 months? (translated from French)

    A French article reviewing npm supply chain attacks from August 2025 to August 2026 and proposing release-age delays, install-script blocking, CI secret separation and OIDC publishing.

  • – How a beagle-shaped AI agent ships code to madewithvuejs.com

    The madewithvuejs.com team describes Milly, an AI agent with access to GitHub, Linear, Sentry and Discord that scouts content, builds features and fixed production bugs under defined safeguards.

  • – Freight Search: Composing a Shared Search Index from Independently Owned Fragments

    Uber Freight explains Freight Search, which builds OpenSearch indices from fragments owned by separate data sources, ingesting over 70 topics into 300 fragments with Spark bootstrap and Flink CDC.

  • – Key Takeaways from Tech at Agoda: From Assistants to AI Agents

    Agoda summarizes five takeaways from its 21 October 2026 Bangkok event on moving from AI assistants to AI agents, covering delivery bottlenecks, context and goals, autonomy matched to risk and accountability.

  • – Data governance with annotations in Amazon S3

    An AWS reference design for keeping classification, retention, residency and PII context as Amazon S3 annotations, written by a Lambda and Bedrock pipeline and queried through an S3 Metadata annotation table with Athena.

  • – Recommended resilience testing in the next generation of AWS Resilience Hub

    AWS introduces recommended resilience testing in Resilience Hub, four FIS-based tests including dependency validation, which uses DNS-based dependency discovery and packet loss injection to check soft and hard dependencies.

  • – A Deep Dive into Salesforce’s Agent Tech Stack

    Salesforce replaced a single-prompt Agentforce design with Agent Script, Data 360 identity resolution, the Agent Context Engine and Agent Identity, and exposed its platform to outside agents through AIforce and an MCP server.

  • – Last chance to get every live course in one membership

    ByteByteGo announces it will stop selling ByteByteGo Live annual memberships on October 28 at 2 PM PT and will sell its live cohort courses individually, citing lower than hoped enrollment.

  • – Cross-request KV cache exposure in the GLM-5.3 Workers AI model, and our remediation with SGLang

    Cloudflare explains how a prefill KV cache pool smaller than the context window and an SGLang disaggregation bug let 155 GLM 5.3 responses on Workers AI include other users' data, and the fixes that followed.

  • – Easy to integrate, compliant by design: Bringing the Swiss Franc to Google Cloud Universal Ledger

    Crypto Finance Group and Google Cloud describe a pilot on Google Cloud Universal Ledger enabling instant transfers between customers of two Swiss banks, using deferred settlement and integration completed in under three months.

  • – Google Cloud and NASA: Testing robotic systems for deep space missions

    Google Public Sector and NASA describe a proof-of-concept robotic system for deep space missions that fine-tuned the Pi0 model in 2.5 hours and reached an 85% baseline pick-and-place success rate.

  • – Preview, edit, and collaborate on markdown (.md) files natively in Google Docs and Drive

    Google announces native viewing, editing and real-time collaboration on markdown files in Google Docs, with rendered previews in Drive, version history and co-editing by teammates and AI agents.

  • – Scale agents securely with IAM Helper Agent Skills and MCP Tools

    Google Cloud introduces IAM Helper, Agent Skills and Google-managed MCP tools that let coding agents troubleshoot 403 errors, author policies, simulate changes against 90 days of logs and request just-in-time access.

  • – Unifying enterprise context and semantics: LookML in Knowledge Catalog is now GA

    Google Cloud announces general availability of LookML semantic indexing in Knowledge Catalog, so Gemini Enterprise and custom agents can use indexed join paths, metric formulas and lineage when generating SQL.

  • – Meta Networking at the 2026 OCP Global Summit: Open Innovation for Scale-Up, Scale-Out, and Scale-Across AI Networks

    Meta lists its networking talks at the 2026 OCP Global Summit, covering IcePack and IceCube switches, the Flattened Planar Fabric, BAG, Tahan, ESUN, OSPA and open-sourcing MetaRoCE.

  • – Making Failure Diagnosis Reliable with Pensive AI

    Netflix describes Pensive AI, which adds LLM error extraction by line ranges and on-demand cached debugging to its rule-based failure diagnosis system, reaching extraction coverage of 100% of failed workloads.

  • – Multi‑Ratio Video Resizing for Mobile Feed and Marketing

    Netflix describes an automated system that crops 16:9 video into 9:16, 4:5 and 1:1 variants using shot detection, active speaker detection, saliency and temporal smoothing, integrated into its Clips tool.

  • – How NVIDIA Minerva Turns Telemetry Chaos Into Peak GPU Yield

    NVIDIA Minerva is an AIOps platform that maps AI factory infrastructure to jobs in a knowledge graph, detects gray failures with machine learning, correlates alert storms into incidents and offers the Sherlock agent.

  • – How NVIDIA Mission Control 2.5 Brings Autonomous Recovery to Kubernetes

    NVIDIA Mission Control 2.5 extends its autonomous recovery engine from Slurm to Kubernetes workloads under NVIDIA Run:ai, combining scheduler placement, job recovery and hardware recovery to handle hardware faults and transient errors.

  • – Agentic harnesses (2/2): eight reflexes to unlearn for a frugal harness (translated from French)

    A French guide to eight habits to unlearn when building agent harnesses for Claude Code, covering concise instructions, Tool Search, effort levels, total task cost, prompt caching, high-level tools, restarts and context compaction.

  • – Advancing Generative Recommendation Inference: our collaboration with NVIDIA on TensorRT LLM

    Spotify describes moving generative recommendation inference from vLLM and SGLang to TensorRT LLM with NVIDIA, adding beam search, scoring and soft-token features, with up to 54% cost reduction for beam search.

  • – AI Changed How Spotify Builds. What We Learned (and Fixed) About Quality at Higher Velocity

    Spotify describes quality problems during its shift to AI-assisted development, including a June 24 publishing delay and failover capacity issues, the fixes it made, and incident and pull request data on AI impact.

  • – Indexing the Data Lake for Online Point Queries

    Spotify describes Random Access Parquet, an external index mapping keys to Parquet files and rows so online services and AI agents can run fast point queries over its GCS data lake.

  • – Introducing: Spotify Technology. Proven at Spotify, now yours.

    Spotify announced Spotify Technology, a brand bringing Portal, Confidence, Xirp and Spotify for Backstage under one roof as a product development system for R&D organizations, proven internally at Spotify.

  • – Portal by Spotify cut my Claude Code token usage by 90%

    A Spotify engineer describes the shunt Claude Code plugin and two AiKA Modes in Portal that route bulk file reads and boilerplate code to Gemini 2.5 Flash, saving around 90% of bulk-read tokens.

  • – When Can LLMs Replace Humans in A/B Tests?

    A paper summary on when LLM predictions can replace human outcomes in A/B tests, defining surrogacy and comparability conditions and testing gpt-4o-mini calibration methods on the Upworthy Research Archive.

  • – Why Spotify Is Not Using Bayesian A/B Testing

    Spotify examined common claims about Bayesian A/B testing, compared Bayesian configurations with frequentist ones, and explained why its experimentation program kept only frequentist inference rather than adding a Bayesian mode.

  • – GHARP: Real-Time Gaussian Head Animation from Large-Scale Reconstruction Prior

    A research abstract presenting GHARP, a two-stage method that animates 3D Gaussian heads in real time from a few images, reporting state-of-the-art quality on Ava-256 and up to 13× faster runtime on an A100.

  • – Agents are ready, but your architecture probably isn't

    An interview with Databricks co-founder Arsalan Tavakoli-Shiraji on why agentic AI fails in enterprise production, citing siloed data, missing governance and batch pipelines, and positioning Lakebase as a transactional database for agents.

  • – AI success starts with clean data, not just better models

    An interview with Kraken's Kristy Mayer-Mejia on unified, documented data as the foundation for AI, sharing metadata with data via Unity Catalog and Delta Sharing, and moves from monthly to hourly dashboards.

  • – Building High-Quality and Trusted Data Products with Databricks

    Databricks outlines recommendations for trusted data products, covering data product owners, five key characteristics, a lifecycle, data contracts, governance teams, certification in Unity Catalog, and customer examples such as Rivian and Walgreens.

  • – Designing effective Genie Agents from a single prompt

    Databricks explains how Genie Agents can be created from a single prompt using Unity Catalog context, and advises starting with a narrow use case and benchmarking before expanding.

  • – Five ways marketers can use Genie One

    Databricks describes five marketing use cases for Genie One, an AI coworker for governed business data: campaign performance analysis, funnel attribution, 360 customer insights, omnichannel planning and mobile reporting.

  • – Genie One MCP: Give any AI Agent the Right Business Context

    Databricks introduces Genie One MCP, which exposes Genie One and the Genie Ontology context layer to MCP-compatible assistants through five tools, with on-behalf-of user authentication and Unity Catalog permission enforcement.

  • – How conversational analytics removes the BI bottleneck

    An interview with Databricks evangelist Ari Kaplan promoting Genie conversational analytics and the Lakebase database, with customer examples such as Etihad Airlines, FordDirect, Fox Sports and iFood.

  • – The challenge of building an exploit-strategy AI for EDGE POKER (translated from Japanese)

    A DeNA intern builds an exploit-strategy AI for six-player poker in EDGE POKER by adding an MLP to the frozen EDGE AI model, raising simulated profit from +27.1 to +52.9 bb/100.

  • – Background Coding Agents: Supercharging Downstream Consumer Dataset Migrations (Honk, Part 4)

    Spotify used its Honk background coding agent with Backstage and Fleetshift to migrate consumers of two deprecated datasets, rolling out 240 automated PRs across dbt and BigQuery Runner pipelines.

  • – Better Experiments with LLM Evals — A funnel, not a fork

    Spotify argues LLM evals belong before A/B tests in an evaluation funnel, citing that about 12% of its tests ship positive results and about 42% of launched experiments are rolled back.

  • – Building a Natural Language Interface to the Spotify Ads API with Claude Code Plugins

    Spotify describes an open-source Claude Code plugin that turns natural language into Spotify Ads API v3 calls using Markdown skills, an agent, a PreToolUse hook and an approximately 8,600-line OpenAPI spec instead of MCP.

  • – Coding Is No Longer the Constraint: Scaling Developer Experience to Teams and Agents at Spotify

    Spotify describes its Fleet Management system Fleetshift, its Claude-based background coding agent Honk, and Backstage standardization, citing more than 2.5 million automated maintenance PRs and a 76% increase in pull request frequency.

  • – Content Ingestion & Podcast Video Incident Report

    Spotify reports on the June 24 video podcast publishing delay caused by transcoding capacity limits, a batch job and a scheduling bug, and the fixes including about 67% more transcoding capacity.

  • – Encoding Your Domain Expert: The Context Layer Behind Spotify's Data Assistant

    Spotify describes the cluster-based context layer behind its Vedder data assistant, where domain experts curate datasets, question-SQL pairs and docs over 70,000+ datasets, with curators accepting only 12.5% of mined pairs.

  • – EP230: RAG vs Agentic RAG

    A ByteByteGo newsletter issue with short explainers on RAG versus agentic RAG, OAuth 2.0 authorization with OIDC authentication, and the Linux directory structure, plus a video on AI building blocks.

  • – Localizing compliance at scale: achieving South Korea’s ISMS certification

    Cloudflare obtained South Korea's ISMS certification and, to enforce itemized consent, removed social sign-up in South Korea rather than build a separate consent gate after authentication.

  • – The AI Bill is coming

    Databricks co-founder Patrick Wendell explains how AI coding agent costs spiraled at Databricks and how a central gateway, model routing and spend visibility cut unit costs by up to 90%.

  • – The Fraud Analyst AI Coworker: Detecting Telecom Fraud in Real-Time on One Platform

    Databricks argues that telecom fraud signals are split across six or seven systems synced by batch jobs, and outlines a unified real-time architecture and AI analyst assistant.

  • – Dark mode was never on our roadmap. Here’s how it got built.

    One Medium web engineer built dark mode using CSS light-dark() tokens instead of caching separate light and dark copies, with a Statsig flag splitting the Cloudflare Workers edge cache during rollout.

  • – Single-tenant Titus: VM-level isolation on a multi-tenant container platform

    Netflix added an allowlisted single-tenant mode to its Titus container platform that gives a task its own right-sized EC2 instance, after weighing shared-kernel tuning, microVMs, gVisor and plain EC2.

  • – How to Read Data into GPU Memory in Python with NVIDIA GPUDirect Storage

    A tutorial on reading data into GPU memory with the NVIDIA KvikIO Python API over GPUDirect Storage and cuFile, verifying the nvidia-fs path with gds_stats and explaining how a 1 GiB read is split.

  • – Running Frontier-Class AI Models Across 8 NVIDIA DGX Spark Nodes

    NVIDIA announces eight-node DGX Spark clusters with 1 TB unified memory and benchmarks inference, the RoCEnante collective backend, ring versus switch topologies, Switchyard model routing and nanochat pre-training scaling.

  • – We gave AI agents a mobile dev environment

    Shopify built Remote Dev, a pool of warm remote Macs that AI agents claim over SSH to build and test its mobile apps, with Android emulators on separate Linux VMs.

  • – Who's reading the code your AI writes?

    Argues that software teams should use AI heavily while watching for risk, citing a Stanford study with smaller gains on established codebases and a Veracode finding that 44% of AI coding tasks introduced a security vulnerability.

  • – We built three memory systems. The most expressive one wasn’t the most useful.

    Tiger Data built three memory systems for its Slack agent Eon, a fact list, a PostgreSQL knowledge graph and an ltree tree with hybrid search, and kept the tree.