You can use Treasure Workflows from the TD Console and from the command line. With this flexibility, it’s possible to create workflows in your local environment and run the same workflows in Treasure Data’s environment.
You might want to store your data in Treasure Data’s cloud-based database and query the data locally or from within the Treasure Data platform or you might create queries and workflows in the cloud, but perform analysis, using in-house tools, locally.
Treasure Data makes it easy for you to move between the interface options with ease and continuum.
Other typical usage scenarios are:
Develop locally with TD Workflow > Push into Treasure Data > Manage in Treasure Data GUI
Develop locally with TD Workflow > Manage on GitHub > Autodeploy to Treasure Data GUI to view and monitor. Refer to Continuous Deployment of Workflow definitions from GitHub to Treasure Data.
Develop, view, and manage in TD Console and Workflow UI
Review workflow syntax to understand how to configure tasks and build repeatable workflows. You use a set of code pieces repeatedly when building and managing workflows.
This topic includes:
- About Workflow Incremental Data Processing
- Checking the Status of your Workflow
- Creating a Directory for your Workflow Files
- Creating a Directory of Saved Workflows and Queries
- Creating a Workflow
- Creating Workflow Notifications
- Deleting a Workflow
- Exporting and Running a Daily Query
- Exporting Data with Parameters
- Grouping Tasks in Workflow and Enabling Parallel Execution
- Recovering a Deleted Workflow Project
- Running a Workflow from the Command Line
- Running a Workflow Session
- Scheduling a Workflow from within the Workflow Definition
- Scheduling Workflows from the Command Line
- Setting Workflow Secrets from the Command Line
- Setting your API Key and Endpoints
- Using the Workflow Project Editor
- Viewing Workflow Error via the Command-Line Interface