Preview Release 7.27.0

This release focuses on improving clarity in notifications, error messages, and onboarding, making it easier to understand what's happening in your Projects.

Updates

UI Changes

• Project ID Visible in Settings — You can now see the Project ID directly in the Project Settings modal. This makes it easier to find and reference without checking URLs or using the API.

Onboarding

• Clearer Onboarding Message — When creating a new Workspace, the confirmation message after step 1 now reads "Workspace creation initialized". This more accurately reflects the setup process.

Deployments

• Readable Node Names in Plan Errors — Deployment plan validation errors now show the human-readable Node name instead of just the Node ID. This makes it much faster to find and fix the Node causing the error.

Jobs & Notifications

• Job Notifications Show Test Failures — Job Scheduler notification emails now distinguish between a successful run and a successful run with failed tests. This gives you a clearer status on data quality without having to check the UI.

API

• Set Workspace Node API Database and Schema — The Set Workspace Node API no longer allows database and schema to be set. These fields are derived from your Storage Mappings, and this change prevents them from being accidentally overwritten.

Bug Fixes

• Retry from Failure Uses Environment Parameters — Fixed an issue where using the Retry from Failure button on a job in the UI would not apply the Environment's configured parameters. Retries from the UI now correctly use the same Environment Parameters as a normal job run.

Packages

External Data Package

• Version 2.0.3 - Added support for conditional STORAGE_INTEGRATION in the Copy Into Node type, offering flexible staging logic.

Base Node Types

• Version 1.3.6 - Resolved an issue with toggles in the Base Node Types UI config that caused inconsistent behavior.

Iceberg Tables

• Version 3.0.1 - Iceberg's Copy Into Node now supports conditional logic for STORAGE_INTEGRATION.

• Version 3.0.2 - All optional dropdown selectors now include a blank option, reducing forced selections and improving usability.

Data Security Package

• Version 1.0.1 - Improved runtime processing reliability of masking view templates to enhance sensitive data protection.

Resolved an issue where the deployment plan could incorrectly generate ALTER statements to add columns that already existed in the target schema.

We've made backend improvements to boost system performance and reliability.

This release focuses on improving deployment reliability, user interface validation, and API consistency.

UI Enhancements

• Bulk Edit Validation Improvements – Added validation and error messaging when bulk editing columns in the column grid to prevent invalid input or missing selections. This ensures users receive clear guidance on required fields and attribute selections.

• Parser Sample Size Limit and Error Messaging – Updated JSON and XML parser settings to limit the sample size and provide more helpful error messages when exceeding recommended limits.

• Run Log Drawer Fix – Adjusted the layout so long Node lists no longer overlap the footer when filters or banners are active in the Run Log view.

API Updates

• Dynamic Table Node Creation – Fixed an issue where creating an empty dynamic table Node via the Create Workspace Node API failed due to incorrect validation. Dynamic table Node types can now be created, updated, and managed through all supported APIs.

• Duplicate Node Validation – Added validation to prevent creating Nodes with duplicate names or storage locations when using the Set Node API.

• Get Workspace Node Enhancements – The Get Workspace Node API now correctly returns database and schema values for mapped Nodes in workspaces, ensuring consistency with the UI.

Deployment and Execution

• Presync Column Query Truncation Fix – Resolved an issue that caused column metadata loss during large schema queries. The fix improves data integrity by correctly handling response size limits.

• Deployment Failure Due to Missing Subgraph IDs – Fixed an issue that caused deployment errors when subgraph or folder IDs were missing in request validation.

• Improved Plan Storage – Refactored Plan handling to no longer await storage completion during API operations, improving plan execution efficiency.

Problem Scanner

• Column Dependency Refresh Fix – The Problem Scanner now updates column dependency errors in real time after changes, without requiring a browser refresh. This improves accuracy and workflow speed when resolving column-level issues.

Packages

Dynamic Tables Package

• Version 2.1.3 - Removed all Iceberg-related code from the Dynamic Tables Package. Dynamic Iceberg table creation is now handled through the new Iceberg Package. This update also includes a minor fix that removes redundant sort order logic.

Iceberg Tables Package

• Version 3.0.0 — Introduced three new Dynamic Iceberg Table Node types to support Iceberg table workflows.

  • Dynamic Iceberg Table Work

  • Dynamic Iceberg Table Dimension

  • Dynamic Iceberg Table Latest Record Version

Streams and Tasks Package

• Version 2.4.1 — Added the Task DAG Create Root node type with new triggered task functionality. Fixed an issue where SIM and DSM node types did not correctly detect source information.

We've made backend improvements to boost system performance and reliability.

We've made backend improvements to boost system performance and reliability.

We’ve introduced caching to make deployment plans faster. The new Caching Deployment Plan feature reduces plan generation time by skipping SQL re-renders for Nodes that haven’t changed.

The feature can be enabled in two ways:

• CLI flag: coa plan --enableCache

• UI toggle: Available in the "Parameters" step of the deployment wizard.

Learn more about using deployment caching in our documentation.

We've made backend improvements to boost system performance and reliability.

This release focuses on improving deployment reliability, user interface validation, and API consistency.

UI Enhancements

• Bulk Edit Validation Improvements – Added validation and error messaging when bulk editing columns in the column grid to prevent invalid input or missing selections. This ensures users receive clear guidance on required fields and attribute selections.

• Parser Sample Size Limit and Error Messaging – Updated JSON and XML parser settings to limit the sample size and provide more helpful error messages when exceeding recommended limits.

• Run Log Drawer Fix – Adjusted the layout so long Node lists no longer overlap the footer when filters or banners are active in the Run Log view.

API Updates

• Dynamic Table Node Creation – Fixed an issue where creating an empty dynamic table Node via the Create Workspace Node API failed due to incorrect validation. Dynamic table Node types can now be created, updated, and managed through all supported APIs.

• Duplicate Node Validation – Added validation to prevent creating Nodes with duplicate names or storage locations when using the Set Node API.

• Get Workspace Node Enhancements – The Get Workspace Node API now correctly returns database and schema values for mapped Nodes in workspaces, ensuring consistency with the UI.

Deployment and Execution

• Presync Column Query Truncation Fix – Resolved an issue that caused column metadata loss during large schema queries. The fix improves data integrity by correctly handling response size limits.

• Deployment Failure Due to Missing Subgraph IDs – Fixed an issue that caused deployment errors when subgraph or folder IDs were missing in request validation.

• Improved Plan Storage – Refactored Plan handling to no longer await storage completion during API operations, improving plan execution efficiency.

Problem Scanner

• Column Dependency Refresh Fix – The Problem Scanner now updates column dependency errors in real time after changes, without requiring a browser refresh. This improves accuracy and workflow speed when resolving column-level issues.

Packages

Dynamic Tables Package

• Version 2.1.3 - Removed all Iceberg-related code from the Dynamic Tables Package. Dynamic Iceberg table creation is now handled through the new Iceberg Package. This update also includes a minor fix that removes redundant sort order logic.

Iceberg Tables Package

• Version 3.0.0 — Introduced three new Dynamic Iceberg Table Node types to support Iceberg table workflows.

  • Dynamic Iceberg Table Work

  • Dynamic Iceberg Table Dimension

  • Dynamic Iceberg Table Latest Record Version

Streams and Tasks Package

• Version 2.4.1 — Added the Task DAG Create Root node type with new triggered task functionality. Fixed an issue where SIM and DSM node types did not correctly detect source information.