Informatica Cloud with Treasure Data

This article explains how to use the Treasure Data JDBC with Informatica Cloud through the Informatica’s Secure Agent and setup a ‘Data Synchronization’ task that pulls records from a Treasure Data table into a different target destination of your choice.

Untitled-3
This is a **Premium** plan feature. If you are interested in using it, please contact us.

Table of Contents

Create the Informatica Cloud Account

First of all, please create an Informatica Cloud account here.




Set up Informatica Cloud Secure Agent

Second, please set up the Secure Agent on your computer.




Here’s relevant documentation.

Set up the Treasure Data JDBC Connection

Third, let’s install and configure the Treasure Data’s JDBC driver in Informatica Cloud.

Download JDBC Driver

Please download Treasure Data’s JDBC Driver.

Set up JDBC Driver

Please navigate to Configuration -> Connectors, and click the New button. Please configure the fields as follows.


  • Type: JDBC
  • Username: Your account email
  • Password: Your account password
  • Connection URL: jdbc:td://api.treasuredata.com/< YOUR_DATABASE_NAME >;useSSL=true;type=presto
  • Schema: “public”
  • JdbcDriver: com.treasuredata.jdbc.TreasureDataDriver
  • JdbcDriverFolder: /path/to/download/directory/

Add a Synchronization Task

Finally, let’s create a data synchronization task using Treasure Data. Please navigate to Apps > Data Synchronization and create a new Task. Then, please fill out the Task Name and Operation fields and click the Next button.


Source

Let’s establish a connection so that Informatica Cloud can extract data from Treasure Data – this sets up Treasure Data as a ‘Source’ through the our JDBC driver.

To do this, please select the connection established in the previous steps. Then Informatica Cloud shows a list of tables under your database as ‘Source’ objects.


Once you select the table name, Informatica Cloud shows a Data Preview, which show a few records from the target table.




Target

Next, please setup a target for the data synchronization. This can be any of the supported Connections.

Untitled-3
Since the Treasure Data JDBC driver does not support INSERT statements it cannot be used to write data into Treasure Data - that is it cannot be used as a 'Target' of a 'Data Synchronization' task/schedule. This functionality is not supported.

Data Filters

In the ‘Data Filters’ phase, you can specify how many records you want to process.




Also, data can be filtered by specifying filter conditions via the Web UI.




Field Mapping

Finally, please specify the ‘Field Mapping’ between Treasure Data and the target.


Schedule

If you want the selected Treasure Data table to synchronize periodically, please specify a schedule in the ‘Schedule’ tab.

Further Readings


Last modified: Aug 21 2015 23:46:19 UTC

If this article is incorrect or outdated, or omits critical information, please let us know. For all other issues, please see our support channels.