Databricks Packages Now Available

Databricks Packages are now live in Coalesce Marketplace. Build faster on your Databricks platform with ready-made packages designed specifically for your data lakehouse needs.

• Databricks optimized Node types - Purpose-built Node types that leverage Databricks capabilities.

• Pre-built templates - Jump start your Databricks projects with tested code patterns.

• Lakehouse-ready components - Access packages designed for modern data architecture on Databricks.

Look for the Supported Platforms symbol to get started.

Private Preview Features

These features are currently in Private Preview. Please reach out to your Coalesce account manager to request access.

Onboarding Wizard

The Onboarding Wizard is back and better aligned with your needs. This step-by-step setup guides you through authentication and storage configuration so you can spend less time on setup and more time building pipelines.

Your Feedback in Action

• Storage & Mapping Optional on Duplication: When you duplicate a Workspace, you can now reuse existing Storage Locations and Storage Mappings. This allows you to skip lengthy configuration.

• Existing Commits: If you’re branching off an existing Workspace with mappings already in your repo, the Onboarding Wizard will automatically pull in those Storage Locations and Storage Mappings for you.

Why You’ll Love It

These tweaks remove unnecessary clicks when duplicating a Workspace, giving you a seamless transition every time.

Deploy Wizard Improvements

We’ve refined the Deploy Wizard to give you clearer visibility into errors and warnings during the Review Plan step. Now, issues are organized into separate Errors and Warnings tabs so you can quickly zero in on what needs fixing before you deploy.

Bug Fixes

• We resolved an issue where permissions for new Projects and Environments weren't applied to API tokens until the token owner logged in.

Private Preview Features

These features are currently in Private Preview. Please reach out to your Coalesce account manager to sign up.

Onboarding Wizard

The Onboarding Wizard is back—and better aligned with your needs. This step-by-step setup guides you through authentication and storage configuration so you can spend less time on setup and more time building pipelines.

Your Feedback in Action

• Storage & Mapping Optional on Duplication: When you duplicate a Workspace, you can now skip Storage Location configuration and Storage Mapping entirely—no need to fill them in unless you want to change them.

• Existing Commits: If you’re branching off an existing Workspace with mappings already in your repo, the Onboarding Wizard will automatically pull in those Storage Locations and Storage Mappings for you.

• Auto-Populate Existing Settings: If your original Workspace already had Storage Locations or Storage Mappings, we’ll carry those over automatically so you don’t have to reconfigure.

Why You’ll Love It

These tweaks remove unnecessary clicks when duplicating a Workspace and ensure your existing settings stick—giving you a seamless transition every time.

Deploy Wizard Improvements

We’ve refined the Deploy Wizard to give you clearer visibility into errors and warnings during the Review Plan step. Now, issues are organized into separate Errors and Warnings tabs—so you can quickly zero in on what needs fixing before you deploy.

Updates

• We've improved the display of Projects and Environments with long names on the Deploy Page to make it easier to filter:

  • Selected environments in the filter now show their full names instead of project-name combinations.

  • Hover tooltips now appear in both the dropdown list and selection textbox to show full names when they're cut off.

  • The “×” remove button is now consistently visible on all selected filter tags, even when their labels are truncated. This ensures users can always remove applied filters without needing to hover or expand the text.

• Syntax highlighting was added to the Parameter pages, making it easier to spot errors and understand the code structure at a glance.

• A next parameter has been added to the List Runs endpoint response, making it easier to track your position while paginating through results.

• Improved support for systemColumns in Node endpoints:

  • The Get Workspace Node endpoint now includes all systemColumns attributes in its response.

  • The Set Workspace Node endpoint has been updated to preserve existing systemColumns attributes when updating a Node.

  • System columns were added to the metadata.column .

Bug Fixes

• Fixed incorrect error message when making change tracking configuration required in UDNs. The message now correctly states "Please select a change tracking column."

• Previously, users were incorrectly prompted to upgrade already-upgraded repositories. Coalesce now properly verifies Git commits and provides clear error messages when Git account testing is needed.

• Environments no longer get stuck in a "Refreshing" state when no jobs are actively running.

• Long Azure DevOps PR descriptions now properly truncate before being included in commit messages, preventing SQL compilation errors during deployment.

Action Required: Upgrade to CLI v7.17.1

We are notifying all Coalesce customers using command-line tools that an immediate upgrade to the Coalesce CLI version 7.17.1 or higher is required. Snowflake's recent 2025_02 release includes changes that may cause service interruptions for users running older versions of the Coalesce CLI.

To prevent any disruption, please check your CLI version by running:

coa --version

If your version is lower than 7.17.1, upgrade your CLI by running:

npm upgrade -g @coalescesoftware/coa

For more information on the Snowflake bundle changes, please visit the Snowflake Release Notes.

Updates

We’ve made several improvements to the Coalesce user experience:

• Nodes in the Build Interface panel and source Node selector are now alphabetically sorted for easier navigation.

• The Deployment page features interconnected filters—selecting a value in one filter automatically updates options in related filters.

• You can now view Column Lineage while in Column Grid view, enabling quick lineage access when working with large graphs.

• When viewing a selected (blue) Node in Column Lineage, you can edit it directly without having to locate and select it again.

• Selecting a Node in the DAG or Graph View now highlights its counterpart in the sidebar, maintaining view consistency and eliminating redundant selections.

Bug Fixes

• Deployments now succeed when a Node's source changes while its name remains unchanged.

• The Node editor now shows an accurate number of Columns that are in a Node.

Packages

Find the right building blocks for your data pipelines and accelerate initial development by using ready-made Packages from Coalesce Marketplace.

New

Delta Stream Merge Node

• Delta Stream Merge Node uses a Delta Stream and handles DELETE operations alongside INSERT and UPDATE.

View-Qualify Advanced Deploy

• View-Qualify advanced deploy UDN is a versatile Node that lets you develop and deploy a Snowflake View with an added QUALIFY filter.

Updates

• Geospatial datatypes are now supported for Dimension Nodes.

• Data quality tests in views now supported in both the Base Nodes package and Base Nodes Advanced Deploy package.

• We've enhanced the InferSchema functionality in Copy Into and Snowpipe Nodes. CSV processing now needs just one file format, not two. The system creates a temporary file format to infer the schema and removes it when the session ends.

Bug Fixes

• A bug in Dimension Zero Key Node related to handling certain edge cases around null value handling has been fixed.

• Persistent Stages change has been made to fix an error caused when all column are chosen as change tracking for Type-2.

New

Create Node Endpoint

You can now create Nodes using the Create Workspace Node endpoint. Create Workspace Nodes supports creating all Node types. Combined with the Set Node endpoint, create and update Nodes programmatically.

Updates

• We’ve made multiple API updates including:

• Added pagination to List Environments. In addition to existing fields, we have added:

  • total - Number of results

  • startingFrom - The id the request starts from.

  • limit - The request page size. 100 is the default.

  • next - The value where the next page of results starts after.

• Added type to List Run Results. Type indicates if it is a sql or sqlTest run.

• When using ref functions, an error message will return if there is a cyclical dependency.

• We’ve made some user interface improvements including:

• Added tooltips for all statuses in the Activity Feed.

• The Fetch button in the Git Modal has moved to be in-line with commit and branches.

• Improved Column Lineage so it's easier to see the Node lineage.

Packages

New - View-Qualify Advanced Deploy Node

We’ve released a new package Node,  View-Qualify Advanced Deploy UDN. This is a versatile Node that allows you to create and deploy views in Snowflake using the QUALIFY filter. It gives you a streamlined way to filter records within a View using window functions such as, RANK or ROW_NUMBER. It supports common use cases like deduplicating data, selecting top and bottom records, and applying customer filters.

Bug Fixes

• Clicking on a Node in the Docs no longer results in an error screen.

7.17.1

We’ve introduced a new feature that lets you know when a Node or Column Test has failed during a refresh.

On the Deploy page, statuses are now color coded for easy review.

• Green - It was successful with no errors.

• Yellow - The Refresh was successful, but had Column or Node test failures.

• Red - The Deploy or Refresh failed.

Take a look at Troubleshooting Deploys and Refreshes.

Power Your Documentation With AI

We’re excited to launch our Intelligent Documentation Assistant –  a smarter, faster way to document your data workflows.

Maintaining clear and consistent documentation across pipelines is always a challenge. Coalesce makes it effortless by automatically generating natural language descriptions from your lineage and transformation metadata to create: 

Node & Column Descriptions: Auto-generated, easy-to-understand explanations of column transformations, logic, and business context — no more manual notes or guesswork.
AI-Generated Git Commit Messages: Helpful, context-aware commit messages to keep your Git history clean, descriptive, and useful.

Benefits

How It Helps:

• Reduce Documentation Overhead: Free up time for development while Coalesce handles the docs.

• Maintain Consistency: Ensure standardized documentation across all data projects, teams, and environments.

• Improve Stakeholder Clarity: Make it easier for business users and analysts to understand transformation logic.

• Accelerate Onboarding: Help new team members ramp up faster with auto-generated, clean documentation.

How to Opt-In

AI Features not enabled by default in Coalesce. Organization admins can opt-in to the AI Documentation Assistant by going to Org Settings > Preferences and toggling AI Features.

Node and Column Test Failures

These features are currently in Private Preview. Please reach out to your Coalesce account manager to sign up.

We’ve introduced a new feature that lets you know when a Node or Column Test has failed during a refresh.

On the Deploy page, statuses are now color coded for easy review.

• Green - It was successful with no errors.

• Yellow - The Refresh was successful, but had Column or Node test failures.

• Red - The Deploy or Refresh failed.

Take a look at Troubleshooting Deploys and Refreshes.

Updates

• You can now use OAuth to run concurrent jobs using the Snowflake Tasks API.

• You can now type to search within all dropdown filter menus on the Deploy page, making it faster and easier to find the option you’re looking for.

Bug Fixes

• Previously credential errors and mismatches would return a 500 for the`startRun` endpoint.`startRun` now returns either a400 or 401.

• We fixed an issue where an invalid project ID would make the application unresponsive.

• [Object Object] no longer appears in the hash column.

Version 7.16.1

• Column Lineage now renders correctly.

• Fixed an issue where createdAt and updatedAt fields in and older version of packages caused deployment failures.

Deprecated node metadata changes were completed with the release of 7.15.

Previous posts

• March 13, 2025 - Upcoming Deprecated Node Metadata Changes

• March 3, 2025 - Deprecated Node Metadata Changes