Updates

• Copilot File Upload: Copilot now accepts file uploads and drag and drop. This makes it easier to convert existing SQL.

• Copilot Organization Instructions: Organization administrators can now set instructions for Copilot such as naming conventions and architectural patterns. Configure Copilot in the Organization Settings**.**

• BigQuery Run Error Visibility: BigQuery run errors are now clearly surfaced in the UI. Rows with errors are highlighted with an icon, and a badge at the top displays detailed error information on hover. The modal distinguishes between empty but accessible schemas and inaccessible schemas that return errors, and tables with no rows show a clear placeholder. Specific handling is included for permission denied, invalid or missing storage mappings or schemas, and general errors, making troubleshooting significantly easier and more self-serve.

• Run Page Render Failure Visibility: Failures that occur during the rendering stage of a refresh are now surfaced directly on the Run page, similar to other run failures. Errors collected by the renderer are no longer limited to logs or the Deploy Wizard.

• Workspace Settings Dropdown Icons: Added icons for Copy Objects, Duplicate Settings, and Delete Workspace to make actions easier to recognize at a glance.

• Readable Workspace Creation Dates: Workspace creation dates now use a new format, for example, “August 9, 2024” instead of “8/9/24,” reducing regional ambiguity.

• Run Details Full Step Visibility: Run Details now display queued, running, successful, failed, and skipped stages. For both deploys and refreshes, all Node steps are visible, even before they start, making it easier to track overall progress.

• Redesigned Copilot Composer: The Copilot composer features a refreshed layout with a dedicated input area, separate actions bar, context usage indicator, relocated Allow edits toggle, square buttons with rounded corners, and an auto-resizing textarea for a more natural typing experience.

• Builder Deep Links with Node ID: Builder URLs now include the Node ID at /projects/<project-id>/workspaces/<workspace-id>/build/nodes/<node-id>, enabling reliable deep linking directly to specific Nodes from documentation, tickets, or shared links.

Packages

BigQuery

• Base Node Types - Advanced Deploy 1.0.0: Initial release.

Databricks

• External Data Package 1.0.1: Added support for loading Excel file format.

• Lakeflow Declarative Pipelines (LDP) Node Type 1.1.0: Added support for AVRO, ORC, TEXT, and XML file formats. Advanced file format options are now available across all supported file formats.

Snowflake

• External Data Package 2.1.2: Added support for API key authentication, including a toggle to forcibly add credentials in the request header.

• Incremental Loading 2.1.0: Added data quality support and Test Passed/Failed records node type.

• Base Node Types Advanced Deploy 2.4.0: Added node type switch support, package tags, and node config matrix with business summary in readme. Fixed truncate description in readme.

• Materialized View 2.0.1: Added node type switch support and package tags. Added node type switch details in readme.

• Create or Alter 1.5.0: Added Last Modified Comparison toggle.

• Data Quality 2.2.0: Added node type switch support in Advanced Deploy Templates and package tags. Fixed truncate description in readme.

Bug Fixes

• Authentication Type Dropdown Behavior: Fixed an issue where the Authentication Type dropdown caret in Workspace or Environment Settings under User Credentials did not reliably open. Alignment issues in the tab were also corrected.

• Refresh Results Missing Nodes: SQL Nodes that do not execute SQL, such as views now appear in refresh results, ensuring the results list accurately reflects all participating nodes.

• Storage Mapping on Partial Deployment Failures: When deployments fail partway through, successfully deployed nodes now correctly write their location and mapping to environment metadata. This prevents environments from entering a blocked state and reduces manual intervention.

• Encrypted SSH Key Reliability: Improved the SSH private key experience with clearer input states, real-time validation, encrypted key detection, and required passphrase enforcement. Encrypted keys now work reliably across sessions.

• listRuns API Failure Reasons: The listRuns API now returns runFailureReason, including when detail: true is set, enabling external dashboards and monitoring tools to surface failure reasons without additional per-run API calls.

• Logging Redaction Performance: Optimized the redactSensitiveData logging layer to prevent long delays when processing large error payloads, resulting in more responsive query runs and error handling.

This release includes bug fixes and performance improvements.

This release includes bug fixes and performance improvements.

This release includes bug fixes and performance improvements.

We fixed an issue where the Deploy Page would continuously spin if the user didn’t the correct RBAC permissions.

We fixed an issue where the Deploy Page would continuously spin if the user didn’t the correct RBAC permissions.

BigQuery in Private Preview

Big Query support in Coalesce Transform is now available in private preview. Reach out to your account team to enable it.

UI Changes

• Project and Workspace ID in URL — URLs now include the Project and Workspace ID, making it easy to share direct links to specific Workspaces. For example /projects/<project-id>/workspaces/<workspace-id>/build

• Redesigned Copilot Chat History — The Copilot chat history now uses a card-style design with improved hover states. History items show "X messages · Xh ago" instead of full timestamps, and the delete button only appears on hover for a cleaner look.

Copilot

• Message Feedback — You can now provide feedback on specific Copilot messages using like and dislike buttons, helping improve AI response quality.

• Improved Abort Functionality — The Copilot abort button now properly stops the UI spinner when you cancel a request. Previously, the spinner continued even after aborting.

Packages

BigQuery

• Base Node Types 1.0.0 is available — Sign up for our private preview by contacting your account manager.

Bug Fixes

• Preserved Thread Titles — Fixed an issue where Copilot thread titles were overwritten when starting a new chat. Existing thread titles are now preserved correctly.

• Runtime Parameter Warning Consistency — Fixed an issue in the Node Type Editor where after correcting invalid runtime parameters and saving, the error popup wouldn't automatically clear until you left and re-entered the editor. The warning now updates correctly when parameters are fixed.

• Copilot Text Overflow — Fixed an issue where text content in Copilot responses overflowed horizontally beyond the shaded content area. Content now displays within proper boundaries.

• Subgraph Tab Handling — Fixed an issue where deleting a Subgraph while its tab was active resulted in a blank white tab. The interface now handles Subgraph deletion gracefully.

• Code Editor Line Numbers — Fixed a CSS conflict where duplicate line numbers would appear.

• Invalid runtime parameters are now caught and surfaced in Workspace Settings before saving.

• Fixed an issue where the scroll bar in the JOINS section would stop midway when working with Views containing numerous joins or lengthy join logic. Users can now scroll to view and access all join definitions.

Navigating complex data pipelines just got easier. We've introduced several enhancements to the Node graph view that help you visualize, filter, and explore your DAGs more efficiently. Whether you're tracking down dependencies or understanding your pipeline's structure, these tools work together to give you better control over how you view and interact with your data transformations.

Mini Map

The Mini Map gives you a bird's-eye view of your entire graph at once. Instead of panning around to understand your DAG's size and structure, you can now see the complete layout in a compact overlay. Click any area on the Mini Map to jump directly to that section of your graph.

The colored Nodes in the Mini Map match the Node types in your main view, making it easy to identify sources and targets as you navigate.

Filter Your DAG

You can now refine your view by dragging Nodes directly from the Node list into the filter. Drag a Node into the Include area to focus on it, or into Exclude to hide it from view. This makes filtering faster and keeps your graph focused on what matters most.

Explore Lineage From Any Direction

You now have more control over how you expand lineage directly from the context menu:

• Upstream: Shows the data sources that flow into your Node.

• Downstream: Reveals where your data goes next.

• Related: Displays both directions at once for a complete picture.

This gives you more control over how much lineage you explore at a time.

Node Expansion

Click the plus icon on any Node to expand its lineage one step at a time. If a plus icon appears, there's another Node connected. If the icon isn't there, you've reached the end of that path. You can expand both upstream and downstream connections this way.

The filter automatically updates to show Custom when you add Nodes individually.

Spotlight Navigation

Spotlight helps you navigate large DAGs 4 Nodes at a time. If you have 12 Nodes, Spotlight expands them in manageable chunks. Click Spotlight again to move forward in the direction you want, 4 Nodes at a time.

Collapsed Nodes by Default

All Nodes are now collapsed by default to use screen space more efficiently. If you want to see all the columns in a Node, expand it.

Storage Location in Graph View

Storage Locations now appear directly in the graph view, making it easier to identify where each Node originates.

Alphabetically Sorted Nodes

When you right-click on a Node and select Add Node, all available Nodes now appear in alphabetical order. This matches the sorting order in the left-hand Node list, making it consistent across the interface.

View Column Lineage From the Column Grid

You can now view the lineage of any column directly from the Column Grid. Right-click on a column and select View Lineage to trace where it originates, how it transforms, and where it's used downstream.

Columns are collapsed by default but can be expanded to show full mappings. You can edit columns directly and use Propagation to apply changes consistently across connected Nodes.

Get a quick tour by watching this video or visiting our documentation.