Practical Steps for Snowflake External Lineage Deployment with OpenLineage
Practical steps for Snowflake external lineage deployment with OpenLineage in 2026. This guide details prerequisites and common challenges for South African…
Read6 minSnowflake partner practice — we design, build and run Snowflake data & AI platforms.
Snowflake is one of our go-to data platforms for scalable, governed analytics — and, since Snowflake's AI Data Cloud went live in the AWS Cape Town region, for AI that runs where South African data already lives. We architect Snowflake warehouses, model data with dbt, and build Cortex AI, CoWork and CoCo workloads on top, governed to financial-services standards.
Snowflake has grown from a cloud data warehouse into what it now calls the AI Data Cloud: one governed platform for storage, elastic compute, data sharing and — since 2024 — large language models and agents running inside the same security perimeter as the data. That last part is the reason our Snowflake partner practice has become one of the busiest in the business.
For South African organisations the timing is unusually good. Snowflake announced general availability on the AWS Africa (Cape Town) Region on 1 September 2025, so customer data can stay in-country for POPIA and the National Policy on Data and Cloud while still using the full platform. Where a particular Cortex model is not yet hosted locally, Snowflake's cross-region inference routes requests over the AWS private backbone — a setting we design for explicitly rather than discover in an audit.
Our practice covers the whole lifecycle: platform architecture, migrations from on-premise SQL Server, Oracle and Postgres, Openflow and Azure Data Factory ingestion, dbt transformation with semantic views, Power BI and Looker on top, and the Cortex AI layer that turns a warehouse into something the business can actually talk to. Several of our data engineering case studies land on Snowflake; the ERP integration pipeline we built with Airflow and dbt is a good example.
We are also an independent member of Anthropic's Claude Partner Network. That matters here because Anthropic's Claude models power a large share of Snowflake Cortex AI, CoCo and CoWork workloads, so we can design the agent layer with one hand on the model and the other on the governed data — and be honest about which piece is limiting you.
Account, database and warehouse design, role-based access, dynamic data masking and row access policies — the controls a bank or insurer expects before a single row lands.
On-premise SQL Server, Oracle and legacy warehouses into Snowflake using Openflow change-data-capture connectors, Azure Data Factory or Airflow, with SnowConvert AI for code conversion.
dbt-managed transformation, Snowflake semantic views so every tool agrees on what 'revenue' means, and Power BI or Looker consumption on one governed source of truth.
Document extraction and classification with Cortex AISQL, retrieval with Cortex Search, text-to-SQL with Cortex Analyst, and Cortex Agents exposed through the REST API into your own apps and WhatsApp assistants.
Enablement for Snowflake CoWork (the business-user agent) and CoCo (the developer coding agent), including semantic models, agent skills, MCP connectors and the guardrails that keep both inside your governance boundary.
Adaptive Compute, resource monitors, query-cost reviews and observability so a rand-denominated budget survives contact with an AI workload.
At Snowflake Summit in June 2026 the company shipped more than 26 new capabilities and renamed both of its flagship agents. Here is the stack as it stands in September 2026, and what each piece is actually for.
The umbrella for Snowflake's managed AI: LLM inference from Anthropic (Claude), OpenAI, Meta, Mistral AI and DeepSeek, served inside Snowflake's security perimeter so data never leaves the platform. Every capability below sits on top of it.
AI functions you call from plain SQL: AI_COMPLETE, AI_CLASSIFY, AI_FILTER, AI_EXTRACT, AI_PARSE_DOCUMENT and AI_TRANSCRIBE. Analysts run classification, extraction and sentiment over text, PDFs, images and call recordings without leaving the query editor — no Python, no separate ML pipeline.
Text-to-SQL grounded in a semantic model, so 'gross margin' means one thing in every tool and every agent. Semantic Studio lets business teams define that logic without SQL, and Semantic View Autopilot can now ingest existing Power BI definitions rather than rebuilding them.
Hybrid vector-plus-keyword search as a managed service. Embedding, indexing and retrieval are handled for you, which makes it the retrieval layer for RAG applications without standing up a separate vector database.
The orchestration layer. An agent breaks a question into steps, routes structured parts to Cortex Analyst and unstructured parts to Cortex Search, calls custom tools or remote MCP connectors (Jira, Salesforce and the like), and returns a cited answer. Exposed through a REST API so you can embed it in your own product.
Formerly Snowflake Intelligence. A personal work agent for knowledge workers: ask questions of governed data in plain English, run multi-step Deep Research reports with citations, publish interactive governed dashboards called Artifacts, and take action in Slack, Gmail and Salesforce through MCP connectors. Available at ai.snowflake.com, in Slack and on iOS.
Formerly Cortex Code. A data-native coding agent for engineers that reads your schemas, role-based access and lineage before it writes a line. It runs in Snowsight, a CLI, the new CoCo Desktop app and VS Code, and ships a plugin for Anthropic's Claude Code. Cloud Agents run tasks such as dbt builds in managed containers, and Automations put CoCo on a schedule.
The context layer that stops agents hallucinating over your data. Horizon Context is the governed store of business definitions, metrics and lineage inside Horizon Catalog; Cortex Sense assembles the relevant context at query time from query history, object metadata, BI dashboards and semantic views, and hands it to CoWork, CoCo and Cortex Agents.
Managed GPU infrastructure for fine-tuning open-source models on your own data without it leaving Snowflake — useful when a domain-specific classifier outperforms a general model at a fraction of the inference cost.
The plumbing that feeds the AI. Openflow is Snowflake's managed ingestion service with change-data-capture connectors for SQL Server and Oracle. Snowflake Postgres brings transactional workloads onto the same platform, and Apache Iceberg V3 with Horizon Catalog keeps the lakehouse open to other engines.
A governed Snowflake warehouse with masking and row-level policies, dbt models with tested lineage, and Power BI on top — built so the audit trail is a query, not a slide deck.
AI_PARSE_DOCUMENT and AI_EXTRACT pull structured fields out of FICA packs, claim forms and supplier invoices at scale, with personal information masked before a model ever sees it.
Snowflake CoWork over a semantic view, so executives ask 'which branches missed target last month and why' and get a cited answer and an Artifact dashboard rather than a ticket in the BI backlog.
Cortex Agents behind a WhatsApp or web assistant, with Cortex Search retrieving policy documents and Cortex Analyst answering account questions — all inside Snowflake's governance boundary.
SQL Server, Oracle or Teradata estates moved to Snowflake using Openflow CDC and SnowConvert AI, validated with automated reconciliation before cut-over so month-end never notices.
Rolling CoCo out to your engineers with dbt, Cloud Agents for builds and tests, and Automations for scheduled maintenance — plus the review discipline that keeps AI-written SQL production-grade.
What we're building, testing and shipping on Snowflake — written up as we go.
Tell us what you're trying to achieve and we'll map the right approach on Snowflake — no obligation.
Book a free AI assessmentSnowflake and the Snowflake logo are trademarks of Snowflake Inc.. Automation Architects is an independent consultancy and is not affiliated with, sponsored by, or endorsed by Snowflake Inc.. References to Snowflake describe the technologies we implement and do not imply certification of any specific outcome.