• Share this post Keep up with us Summary Predictive Optimization now runs by default for new Unity Catalog managed tables and operates at massive scaleNew capabilities in 2025 delivered faster queries, cheaper storage maintenance, and enhanced capabilitiesIn 2026, Predictive Optimization expands into data lifecycle automation and deeper observability Predictive Optimization now runs by default for new Unity Catalog managed tables and operates at massive scale New capabilities in 2025 delivered faster queries, cheaper storage maintenance, and enhanced capabilities In 2026, Predictive Optimization expands into data lifecycle automation and deeper observability Introduction The most performant, cost-effective lakehouse is one that optimizes itself as data volumes, query patterns, and organizational usage continue to evolve. • Predictive Optimization (PO) in Unity Catalog enables this behavior by continuously analyzing how data is written and queried, then applying the appropriate maintenance actions automatically without requiring manual work from users or platform teams. • In 2025, Predictive Optimization moved from an optional automation feature to the default platform behavior, managing performance and storage efficiency across millions of production tables while removing the operational burden traditionally associated with table tuning. • Here’s a look at the milestones that got us here, and what’s coming next in 2026. • Adoption at scale across the lakehouse Throughout 2025, Predictive Optimization saw rapid adoption across the Databricks Platform as customers increasingly relied on autonomous maintenance to manage a growing data estate. • Predictive Optimization has grown rapidly this past year: Exabytes of unreferenced datawerevacuumed, resulting in tens of millions of dollars in storage cost savings Hundreds of petabytes of data were compacted and clustered to improve query performance and file pruning efficiency Millions of tables adoptedAutomatic Liquid Clusteringfor au

Article Summaries:

  • In 2025, Databricks made Predictive Optimization (PO) the default for Unity Catalog, automating performance and storage tuning for millions of tables. PO continuously analyzes write and query patterns, automatically running optimizations such as statistics updates, VACUUM, and liquid clustering without manual scheduling. The result is up to 22 % faster queries and reduced operational costs, with VACUUM now using the Delta transaction log to avoid costly directory scans. Adoption grew rapidly across the platform, and the next year will focus on expanding PO’s capabilities and refining its workload‑driven decision engine.

Sources: