v7.2 Release Notes
Here's what's new in version 7.2.
New Features
Hierarchy Manager
The first of our new embedded applications is now available: the Hierarchy Manager. This application allows you to import or manually create hierarchies for use directly within the Databricks ecosystem.
Improved Workflows
We've made several improvements to workflows:
- Easier task creation from context menus: The context menu now provides direct options for adding new tasks with specific dependency types (On Success, On Failed, On Completion), making it faster to build out your workflow logic.
- Automatic downstream cancellation: When you cancel a running task, all downstream tasks are now automatically set to Cancelled. This prevents dependent tasks from running with incomplete upstream data.
Enhancements
- Task Freshness: You can now enable freshness tracking on a task by setting the Freshness Hours Threshold. After a successful task run exceeds this threshold, the data is marked as stale. Use this to ensure downstream processes aren't working with outdated upstream data.
Bug Fixes
- Tweaked the loading times of various pages
- Fixed various validation issues
New Activities
- Execute Azure Batch Task
- Run tasks on Azure Batch compute.
Decommissioned Features
None.