Skip to content
Last updated

Salesforce Marketing Cloud V2 Export Integration

Treasure Data can publish user segments into Salesforce Marketing Cloud (ExactTarget), and enable you to send personalized emails to your customers. You can run data-driven email campaigns by using your first-party data from Web, Mobile, CRM, and other data sources.

For sample workflows of this, view Treasure Boxes.

Treasure Data provides two methods to write job results to Salesforce Marketing Cloud (SFMC), our SFTP and SFMC plugins.

This SFMC plugin can be used for small and medium data sets. We recommend you use SFTP for large data sets.

Synchronous or Asynchronous API

This integration supports two kinds of APIs to put records into SFMC: Synchronous APIs and Asynchronous APIs.

As a best practice, if you are trying to put a result set with less than 100,000 records into SFMC, Synchronous APIs is a great fit. However, if you are planning to send a million+ data set, then consider using Asynchronous APIs because it provides higher availability and reliability in comparison with Synchronous APIs.

In order to use the Asynchronous APIs, ensure that your SFMC account is enabled as a Data Extensions Async REST API from Salesforce Marketing Cloud. You can also create a support case in Salesforce Marketing Cloud to have them enable it.

Replace or Upsert Existing Audience Data in a Data Extension

This integration also supports Upsert and Replace.

Upsert Audience Data

Upsert updates existing dataand inserts any new additional data in the data extension. Both the update and insert operation use the data extension primary key to determine if a record existed or not to perform the update or insert. All the existing data in the target data extension remains.

Replace Audience Data

Replace which means before updating data, we will clear all existing data in the target data extension. This mode useful if you need only the newest data in the data extension each time in order to send email for targeted customers every time.

When replace is selected for this integration:

  • If there is a data error (NULL value, wrong data type, invalid primary key) in the exported results, all the records in the Data Extension are cleared and not recoverable, but the invalid data is not exported.
  • If there is a schema error (missing primary_key) in the exported results, the existing records in the data extension are not cleared.

When you use replace, the deleted data is unrecoverable. The connector clears all the data before pushing new data. Therefore, whether your job succeeds or fails, the data is cleared. As a best practice, use replace with data that is temporary and when data history is not important.

To use replace, your account must be an Enterprise 2.0 account and the installed package must have admin privileges. Contact your Customer Success representative to find out more.

Prerequisites

  • Basic knowledge of Treasure Data
  • Basic knowledge of Salesforce Marketing Cloud
  • TD account

This connector also requires that the Data Extension have a primary key that uniquely identifies each record. In addition, the Data Extension needs to have 2 fields or more if you use Synchronous API. If you specify 'Create Data Extension' in order to create a new Data Extension, only 1 column as primary key is supported. Specify the multiple columns will cause an error.

Create an Installed App in Salesforce Marketing Cloud

Treasure Data supports both Legacy and Enhanced Package in Salesforce Marketing Cloud.

We highly recommend you create an Enhanced Package.

Create Enhanced Functionality Package

  1. Log on to your Salesforce Marketing Cloud account.
  2. On the Welcome Page, select your name on top right corner. Select Setup.

3. On the left side menu of new screen, navigate to App > Installed Packages.

4. On the Installed Packages screen. Select New.

5. Type the Name and Description. 6. Select Save.

7. Select Add Component. 8. Select API Integration. 9. Select Next.

10. Select Server-to-Server. 11. Select Next.

  1. Locate Contacts > Audiences and to Contacts > List and Subscribers.
  2. Select Read and Write under both to use Replace Audience feature.
  3. Locate Data > Data Extensions.
  4. Select Read and Write. You need these permissions to write data to Salesforce Marketing Cloud.
  5. Select Save.

  1. Locate the Components panel.
  2. Make note of the Client Id, Client Secret and Authentication Base URI. You use the information to write the data from Treasure Data to Salesforce Marketing Cloud.

Using TD Console

Complete the following steps to export TD query results to a Salesforce Marketing Cloud Data Extension:

Create a New Data Connection

When you configure a data connection, you provide authentication to access the integration. In Treasure Data, you configure the authentication and then specify the source information.

  1. Open TD Console.
  2. Navigate to Integrations HubCatalog.
  3. Search for and select Salesforce Marketing Cloud Version 2.

4. Select Enhanced Package Integration.

  1. Select Enhanced Functionality Package, then enter the Client Id, Client Secret and Authentication Base URI (which you obtained when you created the enhanced package in SFMC). Optionally, you could specify:
  • Account identifier or MID to access multiple BUs.
  • Scope to limit the token's scope (more detail in API scopes).
  1. Select Continue.

Name the Connection

  1. Type a name for your connection.
  2. Select Done.

Configure Export Results

In this step, you create or reuse a query. In the query, you configure the data connection.

Sometimes you need to define the column mapping in the query.

  1. Open TD Console.
  2. Navigate to Data Workbench > Queries > New Query.

  1. Type your query in the query editor. For example:
SELECT
 name as customer_name,
 email as primary_key
FROM
 data_extension
limit 10

The primary key can be a text field.

  1. Select Export Results located at top of your query editor.

  1. Select an existing connection.
  2. Specify a Data Extension Name. Optionally, if your Data Extension does not exist, select Create Data Extension to create a brand new data extension.

  1. Specify a Folder Path. Optionally, if any Folder in Folder Path does not exist, select Create New Folder if not Existsto create folder.

  1. If using an existing Data Extension Name and you want to use Asynchronous API**,** select Using Async API. To use the Synchronous API,leave the box unchecked.
  2. If creating a new data extension, select Create Data Extension. With the newly created data extension, input your Data Extension Nameand name the Primary Column in your new data extension.

  1. Long & Text are two supported data types for Primary Column. If Text is Primary Column, you can specify Text length for Primary Key to optimize data extension performance by not unnecessarily allocating unused space.
  2. Select the Is Sendable option, if your data extension is sendable.
  3. Set your Sendable Rule by Subscriber Key or Email Address.
  4. Select your Sendable Column as a sendable property in your data extension.

  1. Select Data Operation for your data extension
  • Upsert to add when there are new records or update when records are duplicated.
  • Replace to delete records and completely replace them for each new export. Replaced data will not be recoverable.

15. Select Done.

Run the Query

  1. Select Run to run the query.
  2. Check the query results are written to the configured data extension.

As there is no time zone setting for the Salesforce Marketing Cloud V2 Export integration, the integration uses the time zone setting of your SFMC account.

Activate a Segment in Audience Studio

You can also send segment data to the target platform by creating an activation in the Audience Studio.

  1. Navigate to Audience Studio.
  2. Select a parent segment.
  3. Open the target segment, right-mouse click, and then select Create Activation.
  4. In the Details panel, enter an Activation name and configure the activation according to the previous section on Configuration Parameters.
  5. Customize the activation output in the Output Mapping panel.

  • Attribute Columns
    • Select Export All Columns to export all columns without making any changes.
    • Select + Add Columns to add specific columns for the export. The Output Column Name pre-populates with the same Source column name. You can update the Output Column Name. Continue to select + Add Columnsto add new columns for your activation output.
  • String Builder
    • + Add string to create strings for export. Select from the following values:
      • String: Choose any value; use text to create a custom value.
      • Timestamp: The date and time of the export.
      • Segment Id: The segment ID number.
      • Segment Name: The segment name.
      • Audience Id: The parent segment number.
  1. Set a Schedule.

  • Select the values to define your schedule and optionally include email notifications.
  1. Select Create.

If you need to create an activation for a batch journey, review Creating a Batch Journey Activation.

Plugin Configuration and Options

Available Configurations

Configuration nameDescriptionTypeSample value
client_idInstalled package client keystringTh1s1s4n3x4mpl3Cl13nt1ds
client_secretInstalled package client secretstringTh1s1s4F4k3dCl13ntS3cr3t
auth_typeAuthenticate typestringv1 (for legacy package) v2 (for enhanced package)
auth_uriAuthenticate URI (required if auth_type=v2)stringhttps://th1s1sf4k3d1nst4nc3h0st.auth.marketingcloudapis.com/
folder_pathFolder Path to export Data Extension Folder Path must satisfy these requirements:- Start with a slash - Have maximum 8 level of folder - Have NO multiple consecutive slashes - Folder name in Folder Path could not exceed 128 characters in lengthstring/Data Extensions/FolderPath2/FolderPath3/FolderPath3
create_folder_if_not_existsFlag to indicate created new folder in folder_path or not Only effect if folder_path is provided (and not empty)boolean default is falsetrue (Any and all directories specified in path are created, unless they already exist or unless some part of path is invalid) false (do not create new Folder if doesn’t exist)
de_nameData Extension namestringdata_extension_name
create_new_deFlag to indicate create new data extension if it is not existedboolean default is falsetrue (create new DE if it doesn’t exist) false (do not create new DE if doesn’t exist)
primary_columnName of primary column (required of create_new_de=true) Only 1 column can be specified.string
primary_text_lengthLength of text field when it is selected as primary columnintegermax: 4000, min: 10 (default: 4000)
is_sendableFlag to indicate created DE is sendable or notboolean default is falsetrue false
sendable_ruleYour account’s configured sendable business rule (required if is_sendable=true)stringSubscriber Key (if the business rule is Subscriber Key) Email Address (if the business rule is Email Address)
sendable_columnColumn name to use as sendable property (required if is_sendable=truestringmy_sendable_column
data_operationDetermine whether clear data in DE before insertingstring default is upsertupsertreplace
asyncFlag to indicate using asynchronous or synchronous API from SFMCboolean default is falsetrue (using Async API) false (using Synchronous API)
continue_on_failureFlag to indicate continue running if there is an insertion error (applied only for synchronous API) (Jobs will only continue when they encounter SFMC server side errors, if an error occurs on the Treasure Data side e.g. wrong credentials, record invalid format ...).  the job will fail with error
records_per_batchNumber of records that will be sent in one API call. (This option is only applied to asynchronous APIs.)integermax: 32000 (default), min: 100

Example Configurations

Example configuration for using Synchronous APIs to upsert data extension using Enhanced package.

out:
 type: salesforce_marketing_cloud_v2
 client_id: Th1s1s4n3x4mpl3Cl13nt1ds
 client_secret: Th1s1s4F4k3dCl13ntS3cr3t
 auth_type: v2
 auth_uri: https://th1s1sf4k3d1nst4nc3h0st.auth.marketingcloudapis.com/
 de_name: data_extension_name
 continue_on_failure: false

Example configuration for Asynchronous APIs to upsert data extension using Enhanced package.

out:
 type: salesforce_marketing_cloud_v2
 client_id: Th1s1s4n3x4mpl3Cl13nt1ds
 client_secret: Th1s1s4F4k3dCl13ntS3cr3t
 auth_type: v2
 auth_uri: https://th1s1sf4k3d1nst4nc3h0st.auth.marketingcloudapis.com/
 de_name: data_extension_name
 async: true

Example configuration for Asynchronous APIs to upsert data extension using Enhanced package and create new Sendable data Extension if not existed.

out:
 type: salesforce_marketing_cloud_v2
 client_id: Th1s1s4n3x4mpl3Cl13nt1ds
 client_secret: Th1s1s4F4k3dCl13ntS3cr3t
 auth_type: v2
 auth_uri: https://th1s1sf4k3d1nst4nc3h0st.auth.marketingcloudapis.com/
 de_name: data_extension_name
 create_new_de: true
 primary_column: primary_key
 primary_text_length: 32
 is_sendable: true
 sendable_column: mytext
 sendable_rule: Subscriber Key
 async: true
 records_per_batch: 32000

Example configuration for Export data extension to a specific folder

out:
 type: salesforce_marketing_cloud_v2
 client_id: xxxxxxxxxxxxxxxxxxxxxxxxx
 client_secret: xxxxxxxxxxxxxxxxxxxxxxxxx  
 auth_type: v2
 auth_uri: https://th1s1sf4k3d1nst4nc3h0st.auth.marketingcloudapis.com/
 folder_path: /Data Extensions/FolderPath2/FolderPath3/FolderPath3
 create_folder_if_not_exists: true
 de_name: data_extension_name
 create_new_de: true
 primary_column: primary_key
 primary_text_length: 32
 is_sendable: true
 sendable_column: mytext
 sendable_rule: Subscriber Key
 async: true
 records_per_batch: 32000

Appendix

  • The connector communicates with the SFMC v2 server/instance endpoint via HTTPS.
  • The HTTPS and SSL/TLS encryption are enforced by SFMC v2 servers and are checked by our connector before processing.