Treasure Workflow is a multi-cloud workflow engine that can orchestrate tasks not only on Treasure Data but across a variety of cloud infrastructures such as AWS and Google Cloud Platform. Treasure Workflow extends and enhances the capabilities of the highly reputable open-source workflow program, Digdag.
The development of data applications such as smart retargeting, A/B testing with customer goals, and omnichannel marketing can involve hundreds of steps, each of which might require complex transformations or dependencies. These challenges to data management and collaboration can quickly become cumbersome.
Treasure Workflow resolves these challenges with a data engineer that enables you to define analytics processing formulas that are separate from the underlying code, data, and environment. With Treasure Workflow, you can:
- Parameterize Modules: Rather than one gigantic, ungainly script, Treasure workflow allows you to break queries into manageable, well-identified modules, to aid in collaboration, updates, and maintenance.
- Group Tasks: Enable query writers to specify dependencies easily, without having to slog through hundreds of lines of codes to make a change.
- Automate Validation: Verify results in-between steps of a complex query to ensure that as data changes, you can trust the results.