Learn more about Box Export Integration.

The Data Connector for Box enables you to import files stored on your Box server to Treasure Data.

Continue to the following topics:

Prerequisites

  • Basic knowledge of Treasure Data

  • Box account

Configure the Connection

Go to Integrations Hub > Catalog and search and select Box data connector.

Select Click here to connect to a new account.



You are redirected to Box to login if you haven't logged in yet, or to the consent page to grant access to Treasure Data from your Box account.


Select Grant access to Box and you are redirected back to Treasure Data Connection screen. Choose the Box connector again, go to the OAuth connection field. You see an OAuth connection with your account name in the dropdown list.

Choose the account you want to use and then proceed to create the connection.

Select Continue and enter name for the authentication.


Select Done to finish or select New Source to start new transfer data.

OAuth (and the only authentication) is only supported in treasuredata.com and its subdomains.

Transfer Data into Treasure Data

To get the data from your Box server into Treasure Data, you can set up a one time transfer or a recurring transfer at a regular interval. The following steps are required.

Enter Box Transfer Details

You can choose to import from a Box File or from a Box Folder. The Box input import plugin supports csv or tsv files. If you import from FileID then this file should be csv or tsv. If you import from FolderID then this folder should contain csv or tsv file.

Steps to Retrieve the File ID or Folder ID from Box.

Import from a File ID

Select Box File from the Import from drop-down box. Then, provide the File ID from Box and select Next.

Import from Folder ID

Select Box Folder from the Import from drop-down box. Then, provide the Folder ID from Box (required).

If the folder you specify contains multiple files and you want to filter the files that are to be imported, specify the prefix in Filter by File Name Prefix. The connector collects all files that start with a specified prefix, even files contained in Box subfolders.

Select Next.

Preview Step

You see a preview of your data.

To make changes to the specified transfer or select additional options for your import, select Advanced Settings. Otherwise, select Next.

Choose the Target Database and Table

In the Transfer To tab, select the Treasure Data target database and table that you want to import your data to. You can create a new database or table using the Create new database or Create new table checkboxes.

  • Append – Add records into the existing table.

  • Replace – Replace the existing data in the table with the data being imported.

  • Partition key Seed: Choose the long or timestamp column that you would like to use as the partitioning time column. If you do not specify a time column, the upload time of the transfer is used in conjunction with the addition of a timecolumn.

  • Data Storage Timezone: Timezone the data is stored in



Schedule

In the Schedule tab, you can specify a one-time transfer, or you can schedule an automated recurring transfer. If you select Once now, select Start Transfer. If you select Repeat… specify your schedule options, then select Schedule Transfer.

  • Once now: Run the transfer only once.



  • Repeat…

    • Schedule: accepts these three options: @hourly, @daily and @monthly and custom cron.

    • Delay Transfer: add a delay of execution time.

  • Scheduling Timezone: Timezone the data is stored in; data is also displayed in this timezone. Supports extended timezone formats like ‘Asia/Tokyo’.

After your transfer has run, you can see the results of your transfer in the Databases tab.

Retrieve the File ID or Folder ID from Box

Log into Box at the root folder.

Select the file or folder for which you want to get the ID.

This is folder ID.



This is file ID


  • No labels