Learn more about Repro Export Integration.

You can use Repro Import Integration to ingest files from your Amazon S3 buckets with customized parameters for an easy configuration.


Prerequisites

Limitations

Using the TD Console to Create Your Connection

Create a New Connection

When you create a data connection, you must provide authentication to access the integration. In Treasure Data, configure the authentication and then specify the source information.

  1. Open TD Console.

  2. Navigate to Integrations Hub >  Catalog.

  3. Search for and select Repro.


    The following dialog opens:

  4. Enter the required information:

  5. Select Continue.

  6. Enter a name for your connection.

  7. Select Done.

Transfer Your Repro Account Data to Treasure Data

After creating the authenticated connection, you are automatically taken to Authentications.

  1. Search for the connection you created. 

  2. Select New Source.

Create Your Source

  1. Type a name for your Source in the Data Transfer field.

  2. Select Next

  1. Edit the following parameters in your source table.


Parameters

Description

Bucket

The bucket where your Repro application is located, for example, repro-data-for-outer-production.

App ID

Your Repro application id.

Upload Time

 The specific time you would like to ingest the data (YYYYMMDDHH format).

Filename pattern

Use regexp to match file paths. If a file path doesn’t match the specified pattern, the file is skipped. For example, if you specify the pattern .csv$ # , then a file is skipped if its path doesn’t match the pattern. Read more about regular expressions.

Filter by Modified Time

Select if you would like to use modified time as the main criteria to load data.

Insert these parameters so that the first executions skip files that were modified before that specified timestamp. For example, 2019-06-03T10:30:19.806Z.

Incremental by Modified Time

(Available if Filter by Modified Time is selected)

Select to ingest only new data since the previous ingestion.

Incremental?

(Available if Filter by Modified Time is selected)

Select to ingest only new data since the previous ingestion.

Configure Your Data

  1. Select Next.
    The Data Settings page opens.

  2. Optionally, edit the data settings or skip this page.

Preview Your Data 



Data Placement