Fabric Codex
Browse Microsoft Fabric by capability, inspect cited claims, open source-backed articles, and jump into Advisor prompts grounded in the same registry.
Explore the registry spine
Jump straight to what you need
The reading portal — a topic tree gathering every article, design, and lesson.
Authoritative deep dives, engine internals whitepapers, and interactive traces.
Ask a question, get an answer grounded only in verified claims.
Every approved source, graded by trust tier, searchable and filterable.
What's coming to Microsoft Fabric, tracked against the registry.
Reference Documentation & Whitepapers
Self-contained, production-grade technical whitepapers covering Apache Spark execution internals, Remote Shuffle Manager, Runtime 2.0, and Polaris.
Fabric Spark Engine Internals
Execution Model, Catalyst, Tungsten, AQE, NEE, Memory & Capacity Diagnostics
Comprehensive deep dive into the Apache Spark engine in Microsoft Fabric. Traces the full query execution pipeline, memory allocator boundaries, native execution engine fallbacks, and SKU throttling mechanics.
- •AQE runtime plan adaptation & shuffle partition coalesce
- •Native Execution Engine (NEE) C++ vectorization boundary & fallback matrix
Efficient Scaledown & Remote Shuffle Manager
RSM, Shuffle Migration, Decommission Lifecycle & Enterprise Guidance
Practitioner architectural whitepaper tracing Remote Shuffle Manager (RSM), shuffle data lifecycle across node decommissions, and dynamic scale-down optimization in Fabric Spark.
- •SPARK-20624 decommission lifecycle & BlockManager block migration
- •SortShuffleManager vs Remote Shuffle Manager storage topology
Fabric Runtime 2.0 Deep Dive
Apache Spark 4.1, Delta 4.2 & Migration Architecture
Detailed migration and architecture guide for Fabric Runtime 2.0. Analyzes the Spark 4.x ANSI mode default, Native Execution Engine behavior, %%configure precedence, and production recipes.
- •Spark 4.1 ANSI mode default × NEE fallback interaction matrix
- •V-Order optimization decision tree and write latency tradeoffs
