Databricks
Inside the lakehouse

Databricks, in production

Practical, sourced guides to building and running data platforms on Databricks: Lakeflow pipelines and ingestion, Databricks SQL, Unity Catalog governance, Mosaic AI, and the compute and cost levers data teams actually ship.



All Databricks guides


About the Databricks guides

Databricks ships changes across a wide surface: Lakeflow pipelines and ingestion, Databricks SQL, Unity Catalog, Mosaic AI, serverless compute, and the AI gateway. The Databricks documentation feed lists them as they land, often several a day, and it is hard to tell from the list which ones matter to a team that already has a working lakehouse.

The Engineering Desk reads that feed each week and drafts a guide only when a release changes the way a team builds, governs, or pays for its platform. A typical guide covers what changed, which workloads it affects, the cost or performance numbers Databricks publishes for it, and a clear recommendation on whether to adopt it now.

What you will find here:

  • Lakeflow and ingestion guides that compare the new path with what most teams run today.
  • Governance guides on Unity Catalog permissions, lineage, and the controls that agent features depend on.
  • Compute and cost guides that work through DBU pricing with the published rates, so you can redo the sums for your own workloads.

The section is written for data engineers and platform owners rather than for buyers. Every guide links to the documentation it relies on, and each chart carries the source of its numbers in the caption. Guides are reviewed and signed off by the responsible editor before they go live, and corrections are logged on the corrections page. The filters above group the guides by product area.

From the Data Today newsroom

Enterprise data, told like a newsroom.

These guides are part of Data Today. Read the wider data & AI coverage on the main site.

Go to Data Today