...
Continue to the following topics:
| Table of Contents |
|---|
Limitations
Unsupported SOQL (Salesforce Object Query Language) syntax. As a limitation, our data connector doesn’t support SOQL syntax such as count() FROM Object.
Bulk API limits. Bulk API offers faster ingestion but also has a limitation of 10,000 batch allocations within a 24-hour period. If your target is large, your entire available batch allocation might be consumed, causing your job to fail eventually. If you try to use the Bulk API, and the result is the ingestion of all records, consider enabling the synchronous transfer only option and using REST API. The use of REST API avoids the batch allocation limitation but might be slower.
Support
SFDC import supports these authentication types:
Credential
OAuth
Connect to Salesforce Using TD Console
Connecting to Salesforce using the TD Console is quick and easy. Alternatively, create Salesforce connection using the command line. The import integration supports credentials; you need a client ID and client secret to authenticate using credentials.
Allow TD to Access Salesforce using Salesforce
These instructions guide you to locate the client ID and client secret that is necessary to authenticate using credentials.
Go to Setup > Apps > App Manage.
Select New Connected App.
The steps may vary depending on the version of Salesforce you are running. In Spring 19 classic UI: Setup > Build > Create > Apps > Connected Apps > New.
Navigate to Setup > Build > Create (Apps), and validate all your connected apps:
Select your app name to go to the page where you can view and manage all information about your connected app.
Write down or copy your Consumer Key (client_id) and Consumer Secret (client_secret).
For secure account access, get a Salesforce Security Token. If you don’t have a security token, go to Account > Settings > Reset My Security Token and select Reset Security Token. You’ll receive your Security Token by email.
In Spring 19 classic UI: My account > My Settings > Personal > Reset My Security Token.
Create New Connection in TD Console
Open TD Console.
Navigate to Integrations Hub > Catalog and search for Salesforce.
...
6. Give your connection a descriptive name and select Create Connection.
Validate Your Salesforce Connection
To validate the user permission, make sure to use Salesforce to validate:
...
| Code Block |
|---|
Response not 2xx:
400 Bad Request {"error":"invalid_grant","error_description":"authentication failure"} |
Transfer Your Salesforce Account Data in Treasure Data
After creating the authenticated connection, you are automatically taken to Authentications.
...
Parameters | Description |
Source | Name of the object you want to import |
Include deleted records | Enables including deleted records |
Use synchronous transfer only | Enables synchronous transfer using REST API |
Incremental | Imports only new data since the last import |
Data Settings
Select Next. The Data Settings page opens.
You can edit the SOQL query, WHERE conditions and Schema settings here.
Optionally, skip this page of the dialog.
Data Preview
| Excerpt Include | ||||||
|---|---|---|---|---|---|---|
|
Data Placement
| Excerpt Include | ||||||
|---|---|---|---|---|---|---|
|
...