Understanding how transforms connect back to their source columns is now clearer and more intuitive. This update reduces confusion in the mapping grid by showing source details alongside transforms, giving you a complete and accurate view of column lineage.
Key Improvements
Clear Source Visibility: When a transformation is applied, the corresponding column source details are displayed in a read-only, grayed-out format.
Hover for Full Details: Hovering over the source reveals:
The original table or alias used
All columns included in the transform
Automatic resolution of unqualified column names to their source tables
Hash Column Transparency: Hash columns now expand to show the list of underlying source columns.
Better Alias Handling: Joins using aliases now display clearer lineage, improving traceability.
Deployments should be clear, organized, and easy to follow. We’ve redesigned the Coalesce deployment experience to make it cleaner, more intuitive, and more informative. The new workflow improves everything from commit selection to error handling.
Key Improvements
Streamlined Interface: A cleaner deploy view with more space to review commits and deployment details before execution.
Tabbed Review Experience: Instead of collapsible menus, deployment changes are organized into clear tabs for Nodes, Subgraphs, Jobs, Mappings, Node Types, Macros, and Packages.
Detailed SQL Visibility: Quickly see what’s changing with at-a-glance summaries, then drill into step-by-step SQL changes for each affected element.
Improved Validation & Error Handling:
Parameter validation, for example, JSON format checks, surfaces issues before deployment begins.
Deployment-time issues, like missing or invalid Storage Locations, now have clearer error messages with actionable guidance to resolve them.
We're excited to announce the addition of User Management API and Git Account API endpoints.
User Management
Automate user provisioning workflows, implement bulk role assignments, and manage permissions across organizations, projects, and environments programmatically.
We’ve continued to improve the user experience by:
Adding alphabetical sorting for Storage Locations and Environments.
Sorting the Nodes Panel alphabetically while also considering the Storage Location name. For example, if both Nodes are named analytics_source, the one with the Storage Location of SRC would come before the one with TGT.
We've launched a new Workspace Onboarding Wizard to create a more intuitive and efficient setup experience in Coalesce. This step-by-step process guides you through configuring everything needed to start developing, including authentication, version control, and storage mappings. Our goal is to minimize configuration time so you can begin building data pipelines faster.
Key Improvements
The new Workspace Onboarding Wizard streamlines the creation and duplication of Workspaces with the following enhancements:
Reuse Configurations on Duplication: When you duplicate a Workspace, you can now choose to reuse its existing Storage Locations and Storage Mappings, allowing you to skip this configuration step.
Automate Setup When Branching: When creating a new branch, the wizard automatically imports Storage Mappings from the source branch's commit history, ensuring a seamless transition.
Ref functions now validate inputs during plan rendering. Empty strings or undefined values now throw clear errors identifying problematic Nodes when using the Coalesce App.
We fixed an error where users would get “Error installing package: failed to validate request body” when installing Nodes.
The Problem Scanner now returns the alert "Configure key pair in User Credentials tab” for missing Snowflake Key Pair credentials.
Fixed issue where data type changes to columns in Coalesce would not deploy when the target table contained unexpected columns in the data warehouse. Changes now deploy correctly.
Support for Databricks is now enabled by default across all accounts. Users can connect to Databricks workspaces from Coalesce to build and manage projects. Please reach out to your account team for more information on configuring connections, best practices, and licensing.
Databricks Packages are now live in Coalesce Marketplace. Build faster on your Databricks platform with ready-made packages designed specifically for your data lakehouse needs.
Pre-built templates - Jump start your Databricks projects with tested code patterns.
Lakehouse-ready components - Access packages designed for modern data architecture on Databricks.
Look for the Supported Platforms symbol to get started.
Private Preview Features
These features are currently in Private Preview. Please reach out to your Coalesce account manager to request access.
Onboarding Wizard
The Onboarding Wizard is back and better aligned with your needs. This step-by-step setup guides you through authentication and storage configuration so you can spend less time on setup and more time building pipelines.
Your Feedback in Action
Storage & Mapping Optional on Duplication: When you duplicate a Workspace, you can now reuse existing Storage Locations and Storage Mappings. This allows you to skip lengthy configuration.
Existing Commits: If you’re branching off an existing Workspace with mappings already in your repo, the Onboarding Wizard will automatically pull in those Storage Locations and Storage Mappings for you.
Why You’ll Love It
These tweaks remove unnecessary clicks when duplicating a Workspace, giving you a seamless transition every time.
Deploy Wizard Improvements
We’ve refined the Deploy Wizard to give you clearer visibility into errors and warnings during the Review Plan step. Now, issues are organized into separate Errors and Warnings tabs so you can quickly zero in on what needs fixing before you deploy.
Bug Fixes
We resolved an issue where permissions for new Projects and Environments weren't applied to API tokens until the token owner logged in.
These features are currently in Private Preview. Please reach out to your Coalesce account manager to sign up.
Onboarding Wizard
The Onboarding Wizard is back—and better aligned with your needs. This step-by-step setup guides you through authentication and storage configuration so you can spend less time on setup and more time building pipelines.
Your Feedback in Action
Storage & Mapping Optional on Duplication: When you duplicate a Workspace, you can now skip Storage Location configuration and Storage Mapping entirely—no need to fill them in unless you want to change them.
Existing Commits: If you’re branching off an existing Workspace with mappings already in your repo, the Onboarding Wizard will automatically pull in those Storage Locations and Storage Mappings for you.
Auto-Populate Existing Settings: If your original Workspace already had Storage Locations or Storage Mappings, we’ll carry those over automatically so you don’t have to reconfigure.
Why You’ll Love It
These tweaks remove unnecessary clicks when duplicating a Workspace and ensure your existing settings stick—giving you a seamless transition every time.
Deploy Wizard Improvements
We’ve refined the Deploy Wizard to give you clearer visibility into errors and warnings during the Review Plan step. Now, issues are organized into separate Errors and Warnings tabs—so you can quickly zero in on what needs fixing before you deploy.
Updates
We've improved the display of Projects and Environments with long names on the Deploy Page to make it easier to filter:
Selected environments in the filter now show their full names instead of project-name combinations.
Hover tooltips now appear in both the dropdown list and selection textbox to show full names when they're cut off.
The “×” remove button is now consistently visible on all selected filter tags, even when their labels are truncated. This ensures users can always remove applied filters without needing to hover or expand the text.
Syntax highlighting was added to the Parameter pages, making it easier to spot errors and understand the code structure at a glance.
A next parameter has been added to the List Runs endpoint response, making it easier to track your position while paginating through results.
Improved support for systemColumns in Node endpoints:
The Get Workspace Node endpoint now includes all systemColumns attributes in its response.
The Set Workspace Node endpoint has been updated to preserve existing systemColumns attributes when updating a Node.
System columns were added to the metadata.column .
Bug Fixes
Fixed incorrect error message when making change tracking configuration required in UDNs. The message now correctly states "Please select a change tracking column."
Previously, users were incorrectly prompted to upgrade already-upgraded repositories. Coalesce now properly verifies Git commits and provides clear error messages when Git account testing is needed.
Environments no longer get stuck in a "Refreshing" state when no jobs are actively running.
Long Azure DevOps PR descriptions now properly truncate before being included in commit messages, preventing SQL compilation errors during deployment.
Breaking Change in List Run Endpoint – Version 7.19
Effective in version 7.19, there is a breaking change to the listRun endpoint:
The orderBy parameter is now mandatory whenever the startingFrom parameter is included in a request. This change ensures consistent and predictable pagination behavior when using the startingFrom cursor.
What you need to do:
If your integration uses startingFrom, make sure to include a valid orderBy value in the same request. Requests missing the required orderBy parameter will now return an error.
