Practical, sourced guides to building and running data platforms on Databricks: Lakeflow pipelines and ingestion, Databricks SQL, Unity Catalog governance, Mosaic AI, and the compute and cost levers data teams actually ship.
Managed Iceberg materialized views let external engines like Trino read your Databricks MVs. Now in Public Preview, they shift the lock-in calculus.
Lakehouse Real-Time is a serverless SQL warehouse for sub-second reads against Unity Catalog tables. It targets thousands of concurrent users but only supports SELECT queries via the Statement Execution API, and it is in Beta.
Unity AI Gateway budgets set shared and per-user AI spend limits for Genie and gateway traffic, with alerts and blocking for admins.
Databricks Lakeflow Designer is GA for visual, governed data prep. Use it for analyst-built transforms, but meter previews and jobs.
Databricks PAT auto-scoping narrows long-lived tokens after 30 days of observed API use. Audit automation now before jobs fail.
The Databricks Data Intelligence Platform is a lakehouse that unifies storage, compute, governance, and AI on open Delta tables. Here is how the pieces fit and where the cost goes.
From the Data Today newsroom
These guides are part of Data Today. Read the wider data & AI coverage on the main site.
Go to Data Today