Running LLMs and ML where the data already lives: Cortex AI functions, what they cost, and an honest read on what is production-ready.
Cortex Agents let you build an AI agent that reasons across structured tables, unstructured documents, and custom tools inside Snowflake. It orchestrates a plan-act-reflect loop, and the bill is the sum of four meters you need to watch.
Snowflake Cortex AI exposes LLMs as SQL functions like AI_COMPLETE and AI_CLASSIFY, so you run inference without moving data out. It is billed per token by model, and cost swings roughly 40x between a small model and a frontier one, so model choice is the budget.
Cortex Analyst is Snowflake's managed text-to-SQL service: business users ask questions in natural language and get answers without writing SQL. The accuracy depends almost entirely on a semantic view you build, and it is billed per message, not per token.
Cortex Search is Snowflake's managed hybrid search service: it embeds your text, runs vector plus keyword retrieval with reranking, and keeps the index fresh, so you can build RAG and enterprise search without standing up a vector database. The cost is several meters, and serving compute bills even when idle.