Snowflake
Dynamic Iceberg table replication, costed honestly
Dynamic Iceberg table replication now keeps Snowflake managed Iceberg pipelines in DR plans, but refresh and transfer costs move to the target account.
#pipelines
8 stories tagged pipelines.
Snowflake
Snowflake Dynamic Tables refresh gets a cost test
Snowflake Dynamic Tables now claim up to 2.8x faster refresh on Gen2 warehouses, but the cost win depends on target lag and change volume.
Snowflake
Snowflake Iceberg ADLS writes are finally usable
Snowflake Iceberg ADLS support is the GA path for Azure teams to read and write externally managed Iceberg tables without moving storage.
Snowflake
ICEBERG_MERGE_ON_READ_BEHAVIOR changes Iceberg DML
ICEBERG_MERGE_ON_READ_BEHAVIOR is Snowflake's GA switch for Iceberg DML mode. AUTO sends 3 of 4 table cases to merge-on-read.
Matillion
Matillion's Data Productivity Cloud, explained for builders
The Data Productivity Cloud is Matillion's cloud-native platform for building, running, and orchestrating data pipelines with low-code, code, and AI. Here is how the pieces fit and where the cost goes.
Snowflake
Should you put your data lake in Snowflake Iceberg tables?
Snowflake Iceberg tables store data in open Apache Iceberg format in your own cloud storage, so Snowflake bills zero storage and other engines can read it. The catch: only Snowflake-managed catalog tables get full platform support, external-catalog tables lose clustering, cloning, and replication.
Snowflake
Snowflake Openflow: managed ingestion built on Apache NiFi
Openflow is Snowflake's managed data integration service, built on Apache NiFi, that moves structured and unstructured data from any source into Snowflake. It runs in two modes: inside Snowflake on container services, or in your own cloud VPC, and each bills and isolates differently.
Snowflake
Dynamic Tables vs Streams and Tasks: which Snowflake pipeline to build
Dynamic Tables let you declare a SELECT and a target lag and let Snowflake refresh it; Streams and Tasks give you imperative control. Dynamic Tables bottom out at a 60-second minimum lag, so sub-minute freshness still means Snowpipe Streaming or Tasks.