Product Updates

Version 7.37

by Coalesce
New
Updates
Bug Fix
[Internal] Auto Publish

Google SSO

We've added Google as a Single Sign-On (SSO) provider. You can now log into Coalesce using Google Cloud or Google Workspace credentials Learn how to set up in Google SSO.

Updates

Copilot Create and Update V2 Nodes: When the SQL editor is enabled for your org, Copilot can now create and update V2 Node Types. Copilot writes V2 Nodes in raw SQL and automatically prevents mixing V1 and V2 Node Types.

Copilot Column Datatype and Nullability: Copilot can now change a column's datatype, precision, and nullability.

V2 Node Mapping Grid View: V2 Nodes now include a read-only mapping grid, accessible from the SQL editor. As you write SQL, the grid displays each column's transform, data type, source, nullability, description, and related fields.

Packages

Snowflake

Semantic View 1.0.1: Adds support for AI_SQL_GENERATION and AI_QUESTION_CATEGORIZATION on the Semantic View Node Type.

Dynamic Tables 2.1.8: Fixes Validate Select failures caused by the template rendering error 'ns' is undefined.

Base Node Types Advanced Deploy 2.5.5: Adds incremental loading and soft delete handling for Fact Advanced Deploy and Factless Fact Advanced Deploy Nodes.

Bug Fixes

Multi Source setNode Source Mapping: Fixed a bug where column sources and transforms were lost from all but the first source when using the setNode API on a Multi Source Node with a transformed column.

Force Checkout Data Loss Warning: Force checkout now correctly shows a data-loss warning when your version control repository format is stale, preventing accidental loss of uncommitted Workspace changes.

Azure DevOps Personal Access Token Expiration Error: When an Azure DevOps personal access token expires, you'll now see a clear error message with a direct link to the version control setup documentation.

AI Version Control Commit Message Size Limit: If a diff is too large for the AI commit message generator to process, you'll now see a specific error message instead of a generic 500 error.

V2 Node Is Available

by Coalesce
New

Node Type V2 is available again in Coalesce.

Write a standard`SELECT` statement in the editor and Coalesce infers columns, data types, and upstream dependencies. Because V2 use SQL, use it with your AI agent to quickly create and convert Nodes. V2 nodes work alongside V1 nodes in the same workspace.

View the full documentation

Version 7.33

by Coalesce
New
Updates
Bug Fix
[Internal] Auto Publish

V2 Node Types: SQL-First Authoring

You can now build transformations by writing SQL directly in Coalesce. Node Type V2 lets you paste existing queries, author CTE-heavy logic, or drop in AI-generated SQL and get everything Coalesce offers in return: automatic column extraction, full DAG and column-level lineage, template-driven deployment, and governance. Configuration moves into the file itself via inline annotations like @insertStrategy("MERGE") or @isBusinessKey, keeping your transformation and its metadata in one place. V2 nodes work alongside your existing V1 nodes in the same pipeline, so you can migrate at your own pace, one node type at a time.

Learn more about V2 Node Types.

COA CLI: Local-First Pipeline Development

You can now build and run Coalesce pipelines entirely from your terminal. The COA CLI brings local-first development to Coalesce, letting you author .sql transformation nodes in your editor of choice, run them directly against your warehouse, and deploy to your environment without touching the UI. Install it via npm, point it at your warehouse credentials, and you have the full pipeline workflow at your fingertips: coa create generates your DDL, coa run populates your tables, and coa plan and coa deploy push changes to your Coalesce environment. COA works with your existing Git workflow and supports the same V2 SQL nodes, node types, and ref() dependency graph you already know. Whether you prefer coding locally, integrating with CI/CD, or just want faster iteration cycles, the COA CLI is how you bring that workflow to Coalesce.

Get coa version 7.33.
Read the documentation.

Updates

  • Copilot Downstream Column Descriptions: Copilot now carries column descriptions into downstream columns it creates.

Packages

BigQuery

BigQuery Base Node Types 1.1.0: Added a Last Modified Comparison option to MERGE logic for Persistent Stage, Dimension, and Fact Nodes; UUID visibility moved into the Node definition for column visibility; package tags for marketplace visibility; documentation updates including a config matrix.

Databricks

Databricks Base Node Types 1.1.0: Zero-key Dimension support, a last-modified toggle on Dimension, Persistent Stage, and Fact, soft delete and hard delete on Dimension, documentation updates, and an updated get_clause() macro.

Snowflake

  • Streams and Tasks 2.6.1: Replaces ALLOW_OVERLAPPING_EXECUTION with OVERLAP_POLICY, small UI fixes, and Git documentation updates with impact analysis for task-enabled Node types.

  • Iceberg Tables 3.2.1: Error and success notification integrations, execute as user, suspend after failures, task auto-retry, overlapping task runs, expanded task configuration and schedule fields, serverless warehouse size limits for tasks, and related documentation for Iceberg external tables.

  • Functional Node Types 4.3.2: Node Type switch support and documentation updates.

  • Deferred Merge 2.0.3: Task notification integrations, execute as user, suspend after failures, auto-retry, overlapping runs, richer schedule and configuration fields, serverless task size bounds, and schedule unit expansion.

  • Create or Alter package 1.6.1: Same task-focused improvements as Deferred Merge 2.0.3 for supported Node types.

  • Cortex 4.0.0: Replaces deprecated !PREDICT with AI_EXTRACT, renames Document AI to AI EXTRACT, and updates configuration to match the new function.

Bug Fixes

  • Databricks Token Authentication: Databricks token authentication now shows clearer errors to help with troubleshooting.

  • setNode With Duplicate Table Names: setNode now resolves the correct table when two tables share a name but live in different storage locations.

  • Presync Errors: Presync deploy errors show clearer messaging to help with troubleshooting.

  • Workspace Wizard and Git Permissions: When Git credentials lack permission, the Workspace creation wizard keeps your entries and shows a specific error instead of a generic failure.

  • Re-sync Columns and Descriptions: Re-syncing columns now picks up description changes from your data platform so your Node metadata stays current.

  • Run Details Sorting: Sorting ascending or descending in run details works when some values are missing instead of mis-ordering rows.

Node Graph Improvements

by Coalesce
New

Navigating complex data pipelines just got easier. We've introduced several enhancements to the Node graph view that help you visualize, filter, and explore your DAGs more efficiently. Whether you're tracking down dependencies or understanding your pipeline's structure, these tools work together to give you better control over how you view and interact with your data transformations.

Mini Map

The Mini Map gives you a bird's-eye view of your entire graph at once. Instead of panning around to understand your DAG's size and structure, you can now see the complete layout in a compact overlay.

The colored Nodes in the Mini Map match the Node types in your main view, making it easy to identify sources and targets as you navigate.

Filter Your DAG

You can now refine your view by dragging Nodes directly from the Node list into the filter. Drag a Node into the Include area to focus on it, or into Exclude to hide it from view. This makes filtering faster and keeps your graph focused on what matters most.

Explore Lineage From Any Direction

You now have more control over how you expand lineage directly from the context menu:

  • Upstream: Shows the data sources that flow into your Node.

  • Downstream: Reveals where your data goes next.

  • Related: Displays both directions at once for a complete picture.

This gives you more control over how much lineage you explore at a time.

Node Expansion

Click the plus icon on any Node to expand its lineage one step at a time. If a plus icon appears, there's another Node connected. If the icon isn't there, you've reached the end of that path. You can expand both upstream and downstream connections this way.

The filter automatically updates to show Custom when you add Nodes individually.

Spotlight Navigation

Spotlight helps you navigate large DAGs 4 Nodes at a time. If you have 12 Nodes, Spotlight expands them in manageable chunks. Click Spotlight again to move forward in the direction you want, 4 Nodes at a time.

Collapsed Nodes by Default

All Nodes are now collapsed by default to use screen space more efficiently. If you want to see all the columns in a Node, expand it.

Storage Location in Graph View

Storage Locations now appear directly in the graph view, making it easier to identify where each Node originates.

Alphabetically Sorted Nodes

When you right-click on a Node and select Add Node, all available Nodes now appear in alphabetical order. This matches the sorting order in the left-hand Node list, making it consistent across the interface.

View Column Lineage From the Column Grid

You can now view the lineage of any column directly from the Column Grid. Right-click on a column and select View Lineage to trace where it originates, how it transforms, and where it's used downstream.

Columns are collapsed by default but can be expanded to show full mappings. You can edit columns directly and use Propagation to apply changes consistently across connected Nodes.

Get a quick tour by watching this video or visiting our documentation.

Enhanced Node Type Switching

by Coalesce
New

These features are currently in Private Preview. Please reach out to your Coalesce account manager to sign up.

We've made significant improvements to Node type switching in Coalesce. When changing a Node's type (for example, from View to Dimension), Coalesce now performs a complete metadata reinitialization based on the target type definition. This ensures your Node fully adopts the target type's structure while intelligently preserving your work.

You can also now use the bulk edit to switch Nodes Types across multiple Nodes at once. Each Node displays its own preview, showing the specific metadata changes that will occur for that Node.

Version 7.28.0

by Coalesce
New
Updates
Bug Fix

Starting with this release (7.28), we're rolling out updates in stages over the course of a week to ensure a smooth deployment for all customers. Your app will automatically receive the update as it becomes available. You don't need to take any action. We'll notify you once the release is live in your app. This staged approach helps us monitor each release and address any issues quickly, ensuring the best experience for everyone going forward.

If you have questions, please contact support.


Coalesce Copilot

Coalesce Copilot is an AI assistant that accelerates data pipeline development through natural language interaction. Instead of manually configuring nodes through the UI, simply describe your requirements in plain English or paste existing SQL—Copilot translates your intent into working DAG nodes with proper transformations, columns, and relationships. This intelligent assistant empowers teams to:

  • Build and modify nodes through conversational commands.

  • Import existing SQL queries into structured Coalesce pipelines.

  • Execute multi-step workflows from high-level requirements.

  • Receive guidance on best practices and workspace configurations.

By combining the speed of AI-generated scaffolding with the precision of Coalesce's visual interface, Copilot enables both experienced developers and SQL users to build production-ready data transformations faster than ever before.

Enable Coalesce Copilot in your Organization Settings > Preferences.

UI Changes

  • Improved Error Messaging for Timed Out Runs — Run timeout errors now say "Run timed out. Restart the run, and if this issue persists contact support." Run details now show whether you executed the run using the Coalesce App or Coa CLI in the new "Executed By" field.

  • Readable Add Source Popup After Workspace Creation — The popup that appears after creating a Workspace to guide you on adding sources now has improved text contrast. The message is now easy to read against the blue background.

  • Test Failure Indicator in Build Interface — When you run a Node with tests and a test fails with "Continue on Failure" enabled, you'll now see a visual indicator. An orange indicator appears on the Node, and a yellow indicator appears on the failed test child Node. This makes it easier to spot test failures without checking run details.

Mapping Grid

  • Prevent Accidental Empty Columns — The Mapping Grid no longer creates empty "nameless" columns when you click or tab through the grid. Previously, clicking in the grid could accidentally generate blank column rows without names or data types. You now need to take an explicit action to create new columns, reducing confusion and metadata clutter.

Bug Fixes

  • OAuth Token Storage Issue Resolved — Fixed a scenario where OAuth users with Snowflake connections could be blocked due to a secrets storage issue. The system was unconditionally saving Snowflake tokens in V1 format even when the V2 feature flag was enabled, causing payload size limits to be exceeded in Google Secrets Manager when tokens expired and needed to be reset.

  • Full Deploy History Access — Fixed an issue where some users with correct Environment Reader permissions could only view 2-4 recent deploys or runs in the Deploy tab. All users with Environment Reader permissions and above can now see the complete deployment history.

  • Node Descriptions Support for Databricks — Fixed an issue where adding a Node description to an existing Databricks Node would cause deployment failures. You can now add or update descriptions on Databricks Nodes without deployment errors.

  • Duplicate Column Errors — Fixed a scenario where the deployment process could generate ALTER statements to add columns that already existed, causing production deployments to fail. This issue occurred when certain column metadata changes triggered unnecessary ALTER statements.

Databricks

Incremental Nodes Package

  • Version 1.0.0 - The Coalesce Incremental load Node is a versatile Node that allows you to develop and deploy a Stage table/View in Databricks where we can perform incremental load in comparison with a persistent table added on top of it.

Test Utility Package

  • Version 1.0.0 - This package is inspired by the Great Expectations package for Python.It will allow you to deploy Great Expectations like tests in your data warehouse.

Lakeflow Declarative Pipelines

  • Version 1.0.1 - Parquet file type support added.

Snowflake

Cortex Package

  • Version 3.0.1 - Added blank option to all optional dropdown selector configurations, improving usability. Test documentation updated.

  • Version 3.0.2 - Fixed Document AI stream name handling and added else blocks to prevent Empty SQL errors. Added default blank for Embedding model in Cortex Search Service.

Dynamic Tables Package

  • Version 2.1.4 - Added common column dictionary list macro with logic improvements. Added blank options for Refresh and Initialize configurations.

  • Version 2.1.5 - Fix for Missing Handler for Incoming Node type transitions (View/Table → Dynamic Table).

  • Version 2.1.6 - Adds Advance Warehouse SelectionImmutability Constraint, and Backfill options across Work/Dimension/Latest Record Version. Updates redeploy/ALTER triggers and simplifies materialization-change steps.

Functional Node Types Package

  • Version 4.2.0 - Added new Recursive CTE node type for building recursive queries.

  • Version 4.2.2 - Added aggregation transformation support for Recursive CTE. Fixed Empty SQL statement errors.

  • Version 4.2.3 - Added Populate on deploy section and Pre-SQL/Post-SQL options for View to Date Dimension Node.

  • Version 4.3.0 - New Time Dimension Node for time of day analytics.

Streams and Tasks Package

  • Version 2.4.2 - Fixed Empty SQL statement issue. Test documentation updated.

Deferred Merge Package

  • Version 2.0.1 - Fixed Empty SQL statement issue.

Data Quality Package

  • Version 2.0.1 - Fixed Empty SQL statement issue.

  • Version 2.1.0 - Expands DMF node config to include Universal DMFsCustom DMFs, and Alerting Options; adds static-behavior limitation; updates screenshots and versions table.

Base Node Types Advanced Deploy Package

  • Version 2.2.0 - Enhanced delete logic for Fact and Dimension nodes with three distinct methods:

    • Hard Delete (permanent removal)

    • Soft Delete (marks records as isSystemCurrentFlag = 0 while retaining history)

    • No Delete (prevents delete operations to maintain existing data flows).

    • Added Primary Key management configuration for seamless altering and dropping of constraints.

    • Added Merge Exclude List for SCD Type 1, allowing specific columns to be excluded from the update phase of MERGE operations.

  • Version 2.2.1 - Fixed Empty SQL statement issue.

  • Version 2.3.0 - Added Last Modified comparison to Dimension, Persistent stage, and Fact Nodes.

  • Version 2.3.1 - Added Last Modified Comparison CDC options (including Last Modified ColumnTreat Null as Current timestamp, and Type 2 Dimension note) across Persistent Stage (table/transient), Dimension (table/transient), and Fact (table/transient).

Base Node Types Package

  • Version 1.3.7 - Fixed Empty SQL statement issue.

Iceberg Tables Package

  • Version 3.0.3 - Added dictionary functionality for macros in Dynamic Iceberg Dimension and Dynamic Iceberg LRV node types. Fixed Empty SQL errors in Snowpipe Iceberg Table and External Iceberg Table.

External Data Package

  • Version 2.0.4 - Added case insensitive toggle to CopyInto, Snowpipe, and External Table node types. Modified run templates for Snowpipe, External Table, and InferSchema to fix Empty SQL errors. Modified External Table to not drop temporary file format in infer process.

  • Version 2.0.5 - Adds Snowflake Secrets-based credentials for API node (Bearer/Client ID+Secret) with guidance and images. Adds package tags and updates versions table.

  • Version 2.1.1 - Add Git Seet Node. Loads data files directly from Git repositories into Snowflake tables. It connects your version-controlled seed files including CSVs, reference tables, lookup data to your Coalesce pipelines without manual file transfers or separate staging infrastructure.

Interactive Table Package

  • Version 1.0.0 - Interactive table deliver low-latency query performance for high-concurrency, interactive workloads.

Incremental Loading

  • Version 2.0.1 - Added an else block to the RUN template to handle cases where the materializationType is View.

Speed Up Deployment Planning with Caching

by Coalesce
New

We’ve introduced caching to make deployment plans faster. The new Caching Deployment Plan feature reduces plan generation time by skipping SQL re-renders for Nodes that haven’t changed.

The feature can be enabled in two ways:

  • CLI flag: coa plan --enableCache

  • UI toggle: Available in the "Parameters" step of the deployment wizard.

Learn more about using deployment caching in our documentation.

Metadata Updates Coming in 7.24

by Coalesce
Announcement

Coalesce has introduced updates to improve metadata integrity across Nodes. Starting in the 7.24 release, null values in Node metadata are automatically removed.

When you commit changes, you may notice updates to Nodes that you haven’t directly modified. This is expected, since null fields are being removed. You should commit these changes and continue with your workflow.

What to Expect

  • Git Modal: You may see diffs in the git modal where null values are removed.

No additional action is required. Commit the changes when they appear to keep your project in sync.