This feature is in Beta.

SAP Marketing Cloud (previously Hybris Marketing) is a marketing solution that provides real-time context-based data about individual customers and anonymous visitors by unifying user data into a centralized hub.

This allows brands to deliver consistent, contextual, and relevant experiences throughout a customer journey, regardless of the marketing channel or device.

  • Data Management: provides you with a 360 view of people interacting with your brand enabling you to target them within the right context, in real-time.

  • Recommendation: delivers timely and highly relevant recommendations to your customers, helping you translate interest into conversion.

  • Segmentation: offers high-performing audience segmentation in real-time enabling you to personalize campaigns across multiple channels.


  • Basic Knowledge of Treasure Data
  • Communication user

About Incremental Data Loading

  • When incremental loading is enabled, the query issued to SAP Marketing Cloud contains the $filter statement. The $filter queries data for desired criteria
    • $filter is generated based on the filter_column, start_time, and end_time configurations
  • The first value received will be kept as a reference for the next job filter. The next job $filter excludes previous job data and fetches new data only.
  • The process repeats for subsequence executions.
  • If the end_time value is empty when incremental loading is enabled, it will automatically set to the time job is executed
  • The filter_column should satisfy the following conditions in metadata: 
    • Contain Type Edm.DateTimeOffset or Edm.DateTime
    • Contain Nullable="false"
    • Does not contain sap:sortable="false" 
    • Does not contain sap:filterable="false"
  • Currently, incremental loading only supports Timestamp columns(Edm.DateTimeOffset and Edm.DateTime)
  • All record containing empty value for filter_column field will be ignored

Obtaining Communication User

  • The Communication User is defined in the SAP Marketing Cloud system (for example, INTEGRATION_TREASURE_DATA is username and password is xxxx). The username and password here will be used as basic authentication to get x-csrf-token.

  • The Communication System is created and set up for this Communication User. Learn more about SAP's Communication System setup.

  • Learn about setting up communication with Other Systems for SAP Marketing Cloud.

Use the TD Console to Create Your Connection

Create a New Connection

In Treasure Data, you must create and configure the data connection prior to running your query. As part of the data connection, you provide authentication to access the integration.

  1. Open TD Console
  2. Navigate to Integrations Hub >  Catalog
  3. Search for and select SAP Marketing Cloud
  4. Select Create Authentication
  5. Input Authentication data:
    1. Username: Your SAP Marketing Cloud communication username
    2. Password: Your SAP Marketing Cloud communication user's password
    3. Tenant ID: Your SAP Marketing Cloud tenant id
  6. Click Continue 
  7. Input the name for this authentication
  8. Click Done

Transfer Your Data to Treasure Data

After creating the authenticated connection, you are automatically taken to Authentications.

  1. Search for the connection you created.

  2. Select New Source

  3. Type a name for your Source in the Data Transfer field

  4. Select Next, The Source Table dialog opens

  5. Edit the following parameters

    Configuration Name

    Service NameStringTarget SAP Marketing Cloud service name
    Api VersionString

    The version of service you would like to use

    Entity NameString

    Entity which you would like to ingest data from


    When run repeatedly, attempt to only import new data since the last import

    Filter ColumnString

    DateTime/DateTimeOffset column for incremental load or filtering (Case sensitive)

    Start TimeDateTime

    Import data since this time

    End TimeDateTimeImport data until this time
  6. Select Next, The Data Settings page can be modified for your needs or you can skip the page.

  7. Optionally, edit the following parameters:

    Batch SizeNumber of records to ingest per API call
    Retry LimitMaximum retry times for each API call
    Initial retry time wait in millisWait time for the first retry (in milliseconds)
    Max retry wait in millsMaximum wait time for an API call before it gives up
  8. Click Next, Data Preview dialog opens

    1. Click Generate Preview to preview data or Skip this step to move to next page
  9. Click Next, Data Placement dialog opens
  10. Click Create & Run Now or Create

Import via Workflow

You can import data from MS Dynamics 365 Sale by using td_load>: operator of workflow. If you have already created a SOURCE, you can run it

  1. Identify your source

  2. To obtain a unique ID, open the Source list and then filter bySAP Marketing Cloud

  3. Open the menu and select Copy Unique ID

  4. Define a workflow task using td_load> operator

      td_load>: unique_id_of_your_source
      database: ${td.dest_db}
      Table: ${td.dest_table}
  5. Run a workflow

  • No labels