We've launched a new Workspace Onboarding Wizard to create a more intuitive and efficient setup experience in Coalesce. This step-by-step process guides you through configuring everything needed to start developing, including authentication, version control, and storage mappings. Our goal is to minimize configuration time so you can begin building data pipelines faster.

Key Improvements

The new Workspace Onboarding Wizard streamlines the creation and duplication of Workspaces with the following enhancements:

• Reuse Configurations on Duplication: When you duplicate a Workspace, you can now choose to reuse its existing Storage Locations and Storage Mappings, allowing you to skip this configuration step.

• Automate Setup When Branching: When creating a new branch, the wizard automatically imports Storage Mappings from the source branch's commit history, ensuring a seamless transition.

New API Endpoints: User Management & Git Accounts

We're excited to announce the addition of User Management API and Git Account API endpoints.

User Management

Automate user provisioning workflows, implement bulk role assignments, and manage permissions across organizations, projects, and environments programmatically.

Review the User Management API documentation.

Git Accounts

Programmatically configure Git connections, manage account credentials, and maintain Git repository associations as part of your CI/CD pipelines.

Review the Git Accounts API documentation.

Updates

We’ve continued to improve the user experience by:

• Adding alphabetical sorting for Storage Locations and Environments.

• Sorting the Nodes Panel alphabetically while also considering the Storage Location name. For example, if both Nodes are named analytics_source, the one with the Storage Location of SRC would come before the one with TGT.

Bug Fixes

• When zoomed in, the Add Member button in the Project settings no longer disappears.

New

We’ve enhanced the API so you can now create and manage your Projects using the /projects endpoint.

Benefits:

• Ensure consistency: Apply naming conventions and configuration standards across all Projects.

• Automate onboarding: Spin up new Projects for teams quickly.

• Integrate with CI/CD: Seamlessly include project creation as part of deployment pipelines and infrastructure-as-code.

Get Started

• Project API reference

Updates

We added alphabetical sorting to:

• Documentation

• Node type selector

• Add new Node

This means locating items faster and reducing scan time for large lists.

Bug Fixes

• Environment Reader roles have read access to the following API endpoints:

  • LIST Environments

  • GET Environments

  • Get Nodes

  • LIST Nodes

  • GET Job Status

  • GET Runs

  • LIST Runs

• Ref functions now validate inputs during plan rendering. Empty strings or undefined values now throw clear errors identifying problematic Nodes when using the Coalesce App.

• We fixed an error where users would get “Error installing package: failed to validate request body” when installing Nodes.

• The Problem Scanner now returns the alert "Configure key pair in User Credentials tab” for missing Snowflake Key Pair credentials.

• Fixed issue where data type changes to columns in Coalesce would not deploy when the target table contained unexpected columns in the data warehouse. Changes now deploy correctly.

Packages

External Data Package

• Removed deploy phase, enhanced external table handling, and added Copy Unload metadata table creation.

Materialized View

• Added deploy phase for Create/Cluster stages and removed it from Alter steps.

Incremental Loading

• Refined deploy phase usage by adding it where needed and removing it from inappropriate stages.

We fixed a bug where the Join tab contents would return after being completely deleted when clicking outside the Node.

We fixed an issue where expired Snowflake OAuth authentication would cause an infinite loading state on the Workspace Connection screen.

Updates

We added alphabetical sorting to:

• Documentation

• Node type selector

• Add new Node

This means locating items faster and reducing scan time for large lists.

Bug Fixes

• Environment Reader roles have read access to the following API endpoints:

  • LIST Environments

  • GET Environments

  • Get Nodes

  • LIST Nodes

  • GET Job Status

  • GET Runs

  • LIST Runs

• Ref functions now validate inputs during plan rendering. Empty strings or undefined values now throw clear errors identifying problematic Nodes when using the Coalesce App.

• We fixed an error that caused users to receive the error message: “Error installing package: failed to validate request body” when installing Nodes.

• The Problem Scanner now returns the alert "Configure key pair in User Credentials tab” for missing Snowflake Key Pair credentials.

• Fixed issue where data type changes to columns in Coalesce would not deploy when the target table contained unexpected columns in the data warehouse. Changes now deploy correctly.

Support for Databricks is now enabled by default across all accounts. Users can connect to Databricks workspaces from Coalesce to build and manage projects. Please reach out to your account team for more information on configuring connections, best practices, and licensing.

Issue Resolved: We have identified and resolved an issue where saved credentials were not being fetched correctly from secure storage, causing deploy and refresh failures. This fix is included in release 7.20.2.

To receive real-time updates about service incidents, maintenance windows, and resolutions, we recommend subscribing to our Status Page notifications.

Databricks Packages Now Available

Databricks Packages are now live in Coalesce Marketplace. Build faster on your Databricks platform with ready-made packages designed specifically for your data lakehouse needs.

• Databricks optimized Node types - Purpose-built Node types that leverage Databricks capabilities.

• Pre-built templates - Jump start your Databricks projects with tested code patterns.

• Lakehouse-ready components - Access packages designed for modern data architecture on Databricks.

Look for the Supported Platforms symbol to get started.

Private Preview Features

These features are currently in Private Preview. Please reach out to your Coalesce account manager to request access.

Onboarding Wizard

The Onboarding Wizard is back and better aligned with your needs. This step-by-step setup guides you through authentication and storage configuration so you can spend less time on setup and more time building pipelines.

Your Feedback in Action

• Storage & Mapping Optional on Duplication: When you duplicate a Workspace, you can now reuse existing Storage Locations and Storage Mappings. This allows you to skip lengthy configuration.

• Existing Commits: If you’re branching off an existing Workspace with mappings already in your repo, the Onboarding Wizard will automatically pull in those Storage Locations and Storage Mappings for you.

Why You’ll Love It

These tweaks remove unnecessary clicks when duplicating a Workspace, giving you a seamless transition every time.

Deploy Wizard Improvements

We’ve refined the Deploy Wizard to give you clearer visibility into errors and warnings during the Review Plan step. Now, issues are organized into separate Errors and Warnings tabs so you can quickly zero in on what needs fixing before you deploy.

Bug Fixes

• We resolved an issue where permissions for new Projects and Environments weren't applied to API tokens until the token owner logged in.