Coalesce cleaning up deprecated metadata fields in Nodes. The change will improve data integrity across Coalesce. This will happen in two stages:

• Release 7.14

• Release 7.15

When doing a commit, you might see changes for Nodes that you haven’t modified. This is expected while deprecated metadata is removed. We suggest making a commit with the changes then continuing on with your workflow. Do not delete, edit, or modify the deprecated fields in any way.

Changes in Release 7.14

Deprecated fields in 7.14  will primarily affect older workspaces that haven't been accessed recently. For actively maintained workspaces, the impact should be minimal. However, if you attempt to commit against previously archived or long-dormant workspaces, you may encounter these changes.

Deprecated Properties Removed

The following properties will be completely removed if present:

Top-level column properties:

• ghostRecordValue

• descendedFrom

• hashColumns

• columnsForHash

Inside hashDetails object:

• hashType

• hubHashes

Properties corrected for Invalid Data

Properties set to empty string (""):

• dataType - if not a string type

• transform - if empty

Properties completely removed if invalid

• appliedColumnTests - if null

• config - if null

• hashDetails - if it's a string (should be an object)

Column Reference Fixes

Column Reference (columnReference)

• stepCounter - if null/undefined, set to the node's ID

• All IDs within column references are converted to strings (previously numbers were allowed - this change has been around for a long time)

Source Column References (sourceColumnReferences)

For each reference in the array:

• All IDs within column references are converted to strings

• stepCounter - if null/undefined, set to empty string ("")

Hashed Columns Fixes

For hashedColumns array:

• All IDs within column references are converted to strings

Upcoming Changes in Release 7.15

Deprecated fields in 7.15 will affect all Source Node Types regardless of age or activity status.

Deprecated Properties Removed:

• dataset

• table

• metadata.join

• metadata.sourceMapping - already absent from most sources

Version 7.13.1

New Workspace Onboarding

Setting up Workspaces in Coalesce just got easier. Our new Workspace onboarding guides you through the processes step-by-step reducing configuration time. Workspace onboarding makes it easier to set up version control, authentication, and Storage Locations/Mappings. This means less setup time and more focus on building pipelines.

Updates

• Our Hash editor automatically displays all columns with proper scrolling functionality.

• Problem Scanner can detect and alert on duplicate Node names and Storage Mappings, making it easier to find potential problems.

• We've made several improvements to enhance platform speed and reliability. These changes are part of our ongoing commitment to deliver the best possible experience for our users.

Bug Fixes

• Source filters now correctly populates and displays all available results.

• Fixed an issue where, “A write batch can no longer be used after commit() has been called.”, was returning when trying to checkout branches.

• Node column details in the lower-left corner now consistently display when clicking Nodes. 

• Node Editor scrolls correctly when the “Node not enabled for deploy” banner is displayed.

Command line users on version 7.5.8 or below should upgrade to coa version 7.10.2 immediately.

Users on`coa` version 7.5.8 and below may encounter deployment and refresh errors. The issue occurs with the presence of`platformKind:snowflake` in the data.yml.

To fix any critical deployment or refresh issues:

• Upgrade to coa version 7.10.2 as soon as possible to prevent further issues.

If you are unable to upgrade your coa version and need to deploy immediately:

• Check your commits for platformKind:snowflake in the data.yml file.

• Manually remove the platformKind:snowflake and commit the changes.

• Deploy as normal

We are working on a change to be delivered within the next 24 hours to allow backwards compatibility for older versions of coa as to not disrupt operations.

New

You can now add a "Re-Sync Columns" button to custom Nodes. This feature allows users to sync columns that are not part of a source Node. Learn more in Custom Node Types.

Updates

We’ve made updates to product feature speed.

MFA

We’ve released Multi-Factor Authentication (MFA) on our platform, a powerful security feature designed to protect your accounts from unauthorized access. MFA adds an extra layer of security by requiring users to verify their identity through an authentication app. Learn how to enable MFA.

Performance Improvements

• Performance improvement for Plan file generation during Deploys which has shown improvements of up to 5X or more.

Bug Fixes

• Fixed an issue which caused unsupported data type changes to fail on first deployment, but succeed on subsequent deployments.

• Fixed a bug which caused concurrent users causing the join text box to overwrite itself.

• Improved performance of copy objects tool when copying objects between Workspaces.

• Fixed a bug related to copying items from the Column Grid.

CLI Version

CLI Version 7.8.3 is available.