The Data Connector for Box enables you to import files stored on your Box server to Treasure Data.
Continue to the following topics:
Basic knowledge of Treasure Data
Configure the Connection
Open the TD Console.
Navigate to the Integrations Hub > Catalog.
- Click the search icon on the far-right of the Catalog screen, and enter Box.
- Hover over the Box connector and select Create Authentication.
Enter your OAuth token or select Click here to authorize the connection with Box.
You are redirected to Box to login if you haven't logged in yet, or to the consent page to grant access to Treasure Data from your Box account.
Select Grant access to Box and you are redirected back to Treasure Data Connection screen. Choose the Box connector again, go to the OAuth connection field. You see an OAuth connection with your account name in the dropdown list.
Choose the account you want to use and then proceed to create the connection.
Select Continue and enter name for the authentication.
Select Done to finish or select New Source to start new transfer data.
OAuth (and the only authentication) is only supported in treasuredata.com and its subdomains.
Transfer Data into Treasure Data
To get the data from your Box server into Treasure Data, you can set up a one time transfer or a recurring transfer at a regular interval. The following steps are required.
Enter Box Transfer Details
You can choose to import from a Box File or from a Box Folder. The Box input import plugin supports csv or tsv files. If you import from FileID then this file should be csv or tsv. If you import from FolderID then this folder should contain csv or tsv file.
Import from a File ID
Box File from the Import from drop-down box. Then, provide the File ID from Box and select Next.
Import from Folder ID
Box Folder from the Import from drop-down box. Then, provide the Folder ID from Box (required).
If the folder you specify contains multiple files and you want to filter the files that are to be imported, specify the prefix in Filter by File Name Prefix. The connector collects all files that start with a specified prefix, even files contained in Box subfolders.
You see a preview of your data.
To make changes to the specified transfer or select additional options for your import, select Advanced Settings. Otherwise, select Next.
Choose the Target Database and Table
In the Transfer To tab, select the Treasure Data target database and table that you want to import your data to. You can create a new database or table using the Create new database or Create new table checkboxes.
Append – Add records into the existing table.
Replace – Replace the existing data in the table with the data being imported.
Partition key Seed: Choose the long or timestamp column that you would like to use as the partitioning time column. If you do not specify a time column, the upload time of the transfer is used in conjunction with the addition of a
Data Storage Timezone: Timezone the data is stored in
In the Schedule tab, you can specify a one-time transfer, or you can schedule an automated recurring transfer. If you select Once now, select Start Transfer. If you select Repeat… specify your schedule options, then select Schedule Transfer.
Once now: Run the transfer only once.
Schedule: accepts these three options:
Delay Transfer: add a delay of execution time.
Scheduling Timezone: Timezone the data is stored in; data is also displayed in this timezone. Supports extended timezone formats like ‘Asia/Tokyo’.
After your transfer has run, you can see the results of your transfer in the Databases tab.
Retrieve the File ID or Folder ID from Box
Log into Box at the root folder.
Select the file or folder for which you want to get the ID.
This is folder ID.
This is file ID