AI-Generated Documentation: Automatic Descriptions for Nodes, Columns, and Git Commit Messages

These features are currently in Private Preview. Please reach out to your Coalesce account manager to sign up.

Coalesce is introducing AI-generated descriptions for Node, Columns, and Git Commit messages.

By analyzing your data pipelines lineage and transformation metadata, it creates natural language descriptions. AI-generated descriptions streamlines documentation by creating clear explanations of data transformations and Git commits. Now you can focus on development while making sure your data pipelines are well documented. 

Organization admins can opt-in by going to Organization Settings > Preferences and toggling AI Features.

Updates

• Run results/ Column Headers now support numeric names, ensuring your data displays accurately.

• We've temporarily rolled back Workspace Onboarding based on valuable customer feedback. This change was made to ensure the best customer experience possible. We're working on improvements to deliver a refined version in the future. Sign up for our changelog email to keep to date.

Bug Fixes

• We fixed an issue where, when switching tabs in multi-source Nodes the incorrect join string was saved.

We fixed an issue where a Metadata update message would unintentionally display in deploy plans and run results.

Bug Fixes

• Fixed an issue where Node aliases were unexpectedly removed when modifications were made through the Join tab.

AI-Generated Documentation: Automatic Descriptions for Nodes, Columns, and Git Commit Messages

These features are currently in Private Preview. Please reach out to your Coalesce account manager to sign up.

Coalesce is introducing AI-generated descriptions for Node, Columns, and Git Commit messages.

By analyzing your data pipelines lineage and transformation metadata, it creates natural language descriptions. AI-generated descriptions streamlines documentation by creating clear explanations of data transformations and Git commits. Now you can focus on development while making sure your data pipelines are well documented. 

Organization admins can opt-in by going to Organization Settings > Preferences and toggling AI Features.

Updates

• Run results/ Column Headers now support numeric names, ensuring your data displays accurately.

• We've temporarily rolled back Workspace Onboarding based on valuable customer feedback. This change was made to ensure the best customer experience possible. We're working on improvements to deliver a refined version in the future. Sign up for our changelog email to keep to date.

Bug Fixes

• We fixed an issue where, when switching tabs in multi-source Nodes the incorrect join string was saved.

Coalesce cleaning up deprecated metadata fields in Nodes. The change will improve data integrity across Coalesce. This will happen in two stages:

• Release 7.14

• Release 7.15

When doing a commit, you might see changes for Nodes that you haven’t modified. This is expected while deprecated metadata is removed. We suggest making a commit with the changes then continuing on with your workflow. Do not delete, edit, or modify the deprecated fields in any way.

Changes in Release 7.14

Deprecated fields in 7.14  will primarily affect older workspaces that haven't been accessed recently. For actively maintained workspaces, the impact should be minimal. However, if you attempt to commit against previously archived or long-dormant workspaces, you may encounter these changes.

Deprecated Properties Removed

The following properties will be completely removed if present:

Top-level column properties:

• ghostRecordValue

• descendedFrom

• hashColumns

• columnsForHash

Inside hashDetails object:

• hashType

• hubHashes

Properties corrected for Invalid Data

Properties set to empty string (""):

• dataType - if not a string type

• transform - if empty

Properties completely removed if invalid

• appliedColumnTests - if null

• config - if null

• hashDetails - if it's a string (should be an object)

Column Reference Fixes

Column Reference (columnReference)

• stepCounter - if null/undefined, set to the node's ID

• All IDs within column references are converted to strings (previously numbers were allowed - this change has been around for a long time)

Source Column References (sourceColumnReferences)

For each reference in the array:

• All IDs within column references are converted to strings

• stepCounter - if null/undefined, set to empty string ("")

Hashed Columns Fixes

For hashedColumns array:

• All IDs within column references are converted to strings

Upcoming Changes in Release 7.15

Deprecated fields in 7.15 will affect all Source Node Types regardless of age or activity status.

Deprecated Properties Removed:

• dataset

• table

• metadata.join

• metadata.sourceMapping - already absent from most sources

Version 7.13.1

New Workspace Onboarding

Setting up Workspaces in Coalesce just got easier. Our new Workspace onboarding guides you through the processes step-by-step reducing configuration time. Workspace onboarding makes it easier to set up version control, authentication, and Storage Locations/Mappings. This means less setup time and more focus on building pipelines.

Updates

• Our Hash editor automatically displays all columns with proper scrolling functionality.

• Problem Scanner can detect and alert on duplicate Node names and Storage Mappings, making it easier to find potential problems.

• We've made several improvements to enhance platform speed and reliability. These changes are part of our ongoing commitment to deliver the best possible experience for our users.

Bug Fixes

• Source filters now correctly populates and displays all available results.

• Fixed an issue where, “A write batch can no longer be used after commit() has been called.”, was returning when trying to checkout branches.

• Node column details in the lower-left corner now consistently display when clicking Nodes. 

• Node Editor scrolls correctly when the “Node not enabled for deploy” banner is displayed.

This release bug fixes and performance improvements.

Updates

• Project Architects and Project Contributors can now delete Workspaces in any projects they are part of.

• Our Join string editing capability now saves correctly when rapidly switching between multisource nodes.

• Our Hash editor now displays all columns with proper scrolling functionality.

Command line users on version 7.5.8 or below should upgrade to coa version 7.10.2 immediately.

Users on`coa` version 7.5.8 and below may encounter deployment and refresh errors. The issue occurs with the presence of`platformKind:snowflake` in the data.yml.

To fix any critical deployment or refresh issues:

• Upgrade to coa version 7.10.2 as soon as possible to prevent further issues.

If you are unable to upgrade your coa version and need to deploy immediately:

• Check your commits for platformKind:snowflake in the data.yml file.

• Manually remove the platformKind:snowflake and commit the changes.

• Deploy as normal

We are working on a change to be delivered within the next 24 hours to allow backwards compatibility for older versions of coa as to not disrupt operations.