This feature is in BETA. Contact your Customer Success Representative for more information.
You can use this data connector to import Contact and Activity data into Treasure Data.
Basic knowledge and access to:
a Treasure Data account
an Oracle Eloqua account
Use the TD Console to Create Your Connection
Create a New Connection
In Treasure Data, you configure the authentication and then specify the source information.
Go to Integrations Hub -> Catalog and search and select Oracle Eloqua.
Provide the following information:
Eloqua Site Name
Then click Continue and give your connection a name:
After entering your authentication name, click Create Source.
Create a New Source
Complete each tab page to define your incoming source data and schedule for import.
Contact or Activity
On the Source Table tab, choose
Activity for the Data Type, and enter a Start Time and End Time, and then click Next.
When Incremental loading option is checked, it incrementally imports new and updated contacts
In Data Settings, you specify import parameters. You can also select to see a Data Preview of your data or you can choose to Skip This Step.
The next step is to select the database and table to where you want to transfer the data, as shown in the following dialog:
If you are creating a new database, check
Create new database and give your database a name. Do the same with
Create New Table
Select whether to
append records to an existing table or
replace your existing table.
If you want to set a different
partition key seed than the default key, you can specify one from the drop-down menu.
Finally, specify the schedule of the data transfer using the following dialog and click Save or Save & Run Now:
Specify the frequency of your data import, and the timezone the data is stored in
You can choose from the following options:
Run the transfer only once.
Select an automated recurring transfer
After your transfer runs, you can see the results of your transfer in Data Workbench > Databases.
Use Command Line
Install ‘td’ Command v0.11.9 or Later
You can install the latest TD Toolbelt.
Create a Configuration File
Prepare configuration file (for example:
load.yml) as shown in the following example, with your Eloqua credential and transfer information.
Optionally Preview Data to Import
You can preview data to be imported using the command
Execute Load Job
Submit the load job. It may take a couple of hours depending on the data size.
$ td connector:issue load.yml --database td_sample_db --table td_sample_table --time-column activity_date
You must specify the database and table where the data is stored.
It is recommended to specify
option, because Treasure Data’s storage is partitioned by time (see also data partitioning). If the option is not given, the data connector selects the first
timestampcolumn as the partitioning time. The type of the column specified by
must be either of
If your data doesn’t have a time column you can add it using
add_time filter option. More details at add_time filter function.
You can assign a Time Format column to the "Partitioning Key" by "--time-column" option.
td connector:issue command assumes that you have already created database(td_sample_db) and table(td_sample_table). If the database or the table do not exist in TD, then this command will not succeed, so create the database and table manually or use
td connector:issuecommand to auto create the database and table:
You can schedule periodic data connector execution for periodic Eloqua import. We configure our scheduler carefully to ensure high availability. By using this feature, you no longer need a
cron daemon on your local data center.
A new schedule can be created using the
td connector:create command. You must specify the name of the schedule, a cron-style schedule, the database and table where the data will be stored, and the data connector configuration file.
The `cron` parameter also accepts these three options: `@hourly`, `@daily` and `@monthly`.
By default, schedule is setup in UTC timezone. You can set the schedule in a timezone using -t or --timezone option. The `--timezone` option only supports extended timezone formats like 'Asia/Tokyo', 'America/Los_Angeles' etc. Timezone abbreviations like PST, CST are *not* supported and may lead to unexpected schedules.
List the Schedules
You can see the list of scheduled entries by using the command
Show the Setting and History of Schedules
td connector:show shows the execution setting of a schedule entry.
td connector:history shows the execution history of a schedule entry. To investigate the results of each individual execution, use
td job <jobid>.
Delete the Schedule
td connector:delete removes the schedule.
See the following table for more details on available
Eloqua Site name
contact or activity
yes for activity target
Specify the date and time to fetch records from. Formatted
Specify the allowable duration to fetch records. formatted
Modes for Out Plugin
You can specify the file import mode in the
out section of seed.yml.
This is the default mode, which appends records to the target table.
Replace (In td 0.11.10 and Later)
This mode replaces data in the target table. Any manual schema changes made to the target table remains intact with this mode.