Data Connector for Facebook Ads reporting

The Data Connector for Facebook Ads reporting enables import of data from your Facebook Advertising campaign results.

Table of Contents

Prerequisites

Untitled-3
Currently this feature is in Beta. For more information, please contact support@treasuredata.com .
  • Basic knowledge of Treasure Data

Step 0: Install ‘td’ command

Install the newest Treasure Data Toolbelt.

Step 1: Obtain Facebook Token

Facebook provides 3 types of token. We recommend to use the never-expiring Page Access Token. You could also use User Token but it expires after 2 months even if it is extended. It is not batch-friendly.

How to get the never-expiring Page Access Token is described in here: https://www.rocketmarketinginc.com/blog/get-never-expiring-facebook-page-access-token/

Step 2: Prepare Configuration and Preview Data

First, prepare config.yml as below.

in:
  type: "facebook_ads_reporting"
  ad_account_id: '[your ad account id]'
  access_token: "[your Facebook access token]"
  api_version: "v2.8" #optional parameter, defaults v2.7
out:
  mode: append

For more details on available out modes, see Appendix.

Then, you can see a preview of the data using the preview command.

$ td connector:preview config.yml
+-----------------+---------------------+---------------+----------------+------------------+----------------------+---------------+------------------------------------+------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--------------------+---------------------------+-------------------------+------------------+-------------------------+-------------+--------------------+-------------------------+--------------------------------+--------------------+---------------------------+--------------+----------------+----------------------+-----------------------+---------------------+----------------------------------------+-------------------------+---------------------------------+-----------------------------+--------------------------------+----------------------------------------+----------------------------+-----------------------------------+------------+-------------------+------------------+-----------------+-----------------------------+------------+-----------------+----------+------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+----------------------------+-------------------------------+-------------------------------------------+-------------------------------------------+--------------------------------------+---------------------------+------------------------------+---------------------------+---------------------------+--------------------------------------------------------+---------------------------+
| account_id:long | account_name:string | ad_id:long    | ad_name:string | campaign_id:long | campaign_name:string | adset_id:long | adset_name:string                  | objective:string | actions:json                                                                                                                                                                                         | total_actions:long | total_unique_actions:long | total_action_value:long | impressions:long | social_impressions:long | clicks:long | social_clicks:long | unique_impressions:long | unique_social_impressions:long | unique_clicks:long | unique_social_clicks:long | spend:double | frequency:long | deeplink_clicks:long | app_store_clicks:long | website_clicks:long | cost_per_inline_post_engagement:double | inline_link_clicks:long | cost_per_inline_link_click:long | inline_post_engagement:long | unique_inline_link_clicks:long | cost_per_unique_inline_link_click:long | inline_link_click_ctr:long | unique_inline_link_click_ctr:long | reach:long | social_reach:long | ctr:double       | unique_ctr:long | unique_link_clicks_ctr:long | cpc:double | cpm:double      | cpp:long | cost_per_total_action:string | cost_per_action_type:json                                                                                                                                                                                                                            | cost_per_unique_click:long | estimated_ad_recall_rate:long | estimated_ad_recall_rate_lower_bound:long | estimated_ad_recall_rate_upper_bound:long | cost_per_estimated_ad_recallers:long | canvas_avg_view_time:long | canvas_avg_view_percent:long | date_start:timestamp      | date_stop:timestamp       | hourly_stats_aggregated_by_advertiser_time_zone:string | time:timestamp            |
+-----------------+---------------------+---------------+----------------+------------------+----------------------+---------------+------------------------------------+------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--------------------+---------------------------+-------------------------+------------------+-------------------------+-------------+--------------------+-------------------------+--------------------------------+--------------------+---------------------------+--------------+----------------+----------------------+-----------------------+---------------------+----------------------------------------+-------------------------+---------------------------------+-----------------------------+--------------------------------+----------------------------------------+----------------------------+-----------------------------------+------------+-------------------+------------------+-----------------+-----------------------------+------------+-----------------+----------+------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+----------------------------+-------------------------------+-------------------------------------------+-------------------------------------------+--------------------------------------+---------------------------+------------------------------+---------------------------+---------------------------+--------------------------------------------------------+---------------------------+
| 2xxxxxxxx       | "Foo Bar"           | 6xxxxxxxxxxxx | "FooBar"       | 6xxxxxxxxxxxx    | "Campaign"           | 6xxxxxxxxxxxx | "Campaign  (Web Remarketing)"      | "VIDEO_VIEWS"    | "[{\"action_type\":\"video_view\",\"value\":5},{\"action_type\":\"page_engagement\",\"value\":5},{\"action_type\":\"post_engagement\",\"value\":5}]"                                                 | 5                  | 0                         | 0                       | 25               | 0                       | 0           | 0                  | 0                       | 0                              | 0                  | 0                         | 0.23         | 0              | 0                    | 0                     | 0                   | 0.0                                    | 0                       | 0                               | 0                           | 0                              | 0                                      | 0                          | 0                                 | 0          | 0                 | 0.0              | 0               | 0                           | 0.0        | 9.2             | 0        | "0.046"                      | "[{\"action_type\":\"video_view\",\"value\":0.046},{\"action_type\":\"page_engagement\",\"value\":0.046},{\"action_type\":\"post_engagement\",\"value\":0.046}]"                                                                                     | 0                          | 0                             | 0                                         | 0                                         | 0                                    | 0                         | 0                            | "2016-07-28 07:00:00 UTC" | "2016-07-28 07:00:00 UTC" | "19:00:00 - 19:59:59"                                  | "2016-07-29 02:00:00 UTC" |
| 2xxxxxxxx       | "Foo Bar"           | 6xxxxxxxxxxxx | "FooBar"       | 6xxxxxxxxxxxx    | "Campaign"           | 6xxxxxxxxxxxx | "Campaign  (Web Remarketing)"      | "VIDEO_VIEWS"    | "[{\"action_type\":\"video_play\",\"value\":1},{\"action_type\":\"video_view\",\"value\":15},{\"action_type\":\"page_engagement\",\"value\":15},{\"action_type\":\"post_engagement\",\"value\":15}]" | 15                 | 0                         | 0                       | 114              | 1                       | 1           | 0                  | 0                       | 0                              | 0                  | 0                         | 0.32         | 0              | 0                    | 0                     | 0                   | 0.0                                    | 0                       | 0                               | 0                           | 0                              | 0                                      | 0                          | 0                                 | 0          | 0                 | 0.87719298245614 | 0               | 0                           | 0.32       | 2.8070175438596 | 0        | "0.021333333333333"          | "[{\"action_type\":\"video_play\",\"value\":0.32},{\"action_type\":\"video_view\",\"value\":0.021333333333333},{\"action_type\":\"page_engagement\",\"value\":0.021333333333333},{\"action_type\":\"post_engagement\",\"value\":0.021333333333333}]" | 0                          | 0                             | 0                                         | 0                                         | 0                                    | 0                         | 0                            | "2016-07-28 07:00:00 UTC" | "2016-07-28 07:00:00 UTC" | "20:00:00 - 20:59:59"                                  | "2016-07-29 03:00:00 UTC" |
| 2xxxxxxxx       | "Foo Bar"           | 6xxxxxxxxxxxx | "FooBar"       | 6xxxxxxxxxxxx    | "Campaign"           | 6xxxxxxxxxxxx | "Campaign  (Web Remarketing)"      | "VIDEO_VIEWS"    | "[{\"action_type\":\"video_play\",\"value\":1},{\"action_type\":\"video_view\",\"value\":87},{\"action_type\":\"page_engagement\",\"value\":87},{\"action_type\":\"post_engagement\",\"value\":87}]" | 87                 | 0                         | 0                       | 452              | 9                       | 4           | 0                  | 0                       | 0                              | 0                  | 0                         | 1.95         | 0              | 0                    | 0                     | 0                   | 0.4875                                 | 0                       | 0                               | 4                           | 0                              | 0                                      | 0                          | 0                                 | 0          | 0                 | 0.88495575221239 | 0               | 0                           | 0.4875     | 4.3141592920354 | 0        | "0.022413793103448"          | "[{\"action_type\":\"video_play\",\"value\":1.95},{\"action_type\":\"video_view\",\"value\":0.022413793103448},{\"action_type\":\"page_engagement\",\"value\":0.022413793103448},{\"action_type\":\"post_engagement\",\"value\":0.022413793103448}]" | 0                          | 0                             | 0                                         | 0                                         | 0                                    | 0                         | 0                            | "2016-07-28 07:00:00 UTC" | "2016-07-28 07:00:00 UTC" | "21:00:00 - 21:59:59"                                  | "2016-07-29 04:00:00 UTC" |
| 2xxxxxxxx       | "Foo Bar"           | 6xxxxxxxxxxxx | "FooBar"       | 6xxxxxxxxxxxx    | "Campaign"           | 6xxxxxxxxxxxx | "Campaign  (Web Remarketing)"      | "VIDEO_VIEWS"    | "[{\"action_type\":\"video_view\",\"value\":3},{\"action_type\":\"page_engagement\",\"value\":3},{\"action_type\":\"post_engagement\",\"value\":3}]"                                                 | 3                  | 0                         | 0                       | 9                | 1                       | 0           | 0                  | 0                       | 0                              | 0                  | 0                         | 0.01         | 0              | 0                    | 0                     | 0                   | 0.0                                    | 0                       | 0                               | 0                           | 0                              | 0                                      | 0                          | 0                                 | 0          | 0                 | 0.0              | 0               | 0                           | 0.0        | 1.1111111111111 | 0        | "0.0033333333333333"         | "[{\"action_type\":\"video_view\",\"value\":0.0033333333333333},{\"action_type\":\"page_engagement\",\"value\":0.0033333333333333},{\"action_type\":\"post_engagement\",\"value\":0.0033333333333333}]"                                              | 0                          | 0                             | 0                                         | 0                                         | 0                                    | 0                         | 0                            | "2016-07-28 07:00:00 UTC" | "2016-07-28 07:00:00 UTC" | "22:00:00 - 22:59:59"                                  | "2016-07-29 05:00:00 UTC" |
| 2xxxxxxxx       | "Foo Bar"           | 6xxxxxxxxxxxx | "FooBar"       | 6xxxxxxxxxxxx    | "Campaign"           | 6xxxxxxxxxxxx | "Campaign  (Web Remarketing)"      | "VIDEO_VIEWS"    | "[{\"action_type\":\"video_view\",\"value\":40},{\"action_type\":\"page_engagement\",\"value\":40},{\"action_type\":\"post_engagement\",\"value\":40}]"                                              | 40                 | 0                         | 0                       | 230              | 8                       | 0           | 0                  | 0                       | 0                              | 0                  | 0                         | 1.16         | 0              | 0                    | 0                     | 0                   | 0.0                                    | 0                       | 0                               | 0                           | 0                              | 0                                      | 0                          | 0                                 | 0          | 0                 | 0.0              | 0               | 0                           | 0.0        | 5.0434782608696 | 0        | "0.029"                      | "[{\"action_type\":\"video_view\",\"value\":0.029},{\"action_type\":\"page_engagement\",\"value\":0.029},{\"action_type\":\"post_engagement\",\"value\":0.029}]"                                                                                     | 0                          | 0                             | 0                                         | 0                                         | 0                                    | 0                         | 0                            | "2016-07-28 07:00:00 UTC" | "2016-07-28 07:00:00 UTC" | "23:00:00 - 23:59:59"                                  | "2016-07-29 06:00:00 UTC" |
| 2xxxxxxxx       | "Foo Bar"           | 6xxxxxxxxxxxx | "FooBar"       | 6xxxxxxxxxxxx    | "Campaign"           | 6xxxxxxxxxxxx | "Campaign  (Web Remarketing)"      | "VIDEO_VIEWS"    | "[{\"action_type\":\"video_view\",\"value\":1},{\"action_type\":\"page_engagement\",\"value\":1},{\"action_type\":\"post_engagement\",\"value\":1}]"                                                 | 1                  | 0                         | 0                       | 17               | 0                       | 0           | 0                  | 0                       | 0                              | 0                  | 0                         | 0.06         | 0              | 0                    | 0                     | 0                   | 0.0                                    | 0                       | 0                               | 0                           | 0                              | 0                                      | 0                          | 0                                 | 0          | 0                 | 0.0              | 0               | 0                           | 0.0        | 3.5294117647059 | 0        | "0.06"                       | "[{\"action_type\":\"video_view\",\"value\":0.06},{\"action_type\":\"page_engagement\",\"value\":0.06},{\"action_type\":\"post_engagement\",\"value\":0.06}]"                                                                                        | 0                          | 0                             | 0                                         | 0                                         | 0                                    | 0                         | 0                            | "2016-07-29 07:00:00 UTC" | "2016-07-29 07:00:00 UTC" | "00:00:00 - 00:59:59"                                  | "2016-07-29 07:00:00 UTC" |
| 2xxxxxxxx       | "Foo Bar"           | 6xxxxxxxxxxxx | "FooBar"       | 6xxxxxxxxxxxx    | "Campaign"           | 6xxxxxxxxxxxx | "Campaign  (Web Remarketing)"      | "VIDEO_VIEWS"    | "[{\"action_type\":\"video_view\",\"value\":14},{\"action_type\":\"page_engagement\",\"value\":14},{\"action_type\":\"post_engagement\",\"value\":14}]"                                              | 14                 | 0                         | 0                       | 72               | 2                       | 0           | 0                  | 0                       | 0                              | 0                  | 0                         | 0.36         | 0              | 0                    | 0                     | 0                   | 0.0                                    | 0                       | 0                               | 0                           | 0                              | 0                                      | 0                          | 0                                 | 0          | 0                 | 0.0              | 0               | 0                           | 0.0        | 5.0             | 0        | "0.025714285714286"          | "[{\"action_type\":\"video_view\",\"value\":0.025714285714286},{\"action_type\":\"page_engagement\",\"value\":0.025714285714286},{\"action_type\":\"post_engagement\",\"value\":0.025714285714286}]"                                                 | 0                          | 0                             | 0                                         | 0                                         | 0                                    | 0                         | 0                            | "2016-07-29 07:00:00 UTC" | "2016-07-29 07:00:00 UTC" | "01:00:00 - 01:59:59"                                  | "2016-07-29 08:00:00 UTC" |
| 2xxxxxxxx       | "Foo Bar"           | 6xxxxxxxxxxxx | "FooBar"       | 6xxxxxxxxxxxx    | "Campaign"           | 6xxxxxxxxxxxx | "Campaign  (Web Remarketing)"      | "VIDEO_VIEWS"    | "[{\"action_type\":\"video_view\",\"value\":23},{\"action_type\":\"page_engagement\",\"value\":23},{\"action_type\":\"post_engagement\",\"value\":23}]"                                              | 23                 | 0                         | 0                       | 96               | 4                       | 0           | 0                  | 0                       | 0                              | 0                  | 0                         | 0.47         | 0              | 0                    | 0                     | 0                   | 0.0                                    | 0                       | 0                               | 0                           | 0                              | 0                                      | 0                          | 0                                 | 0          | 0                 | 0.0              | 0               | 0                           | 0.0        | 4.8958333333333 | 0        | "0.020434782608696"          | "[{\"action_type\":\"video_view\",\"value\":0.020434782608696},{\"action_type\":\"page_engagement\",\"value\":0.020434782608696},{\"action_type\":\"post_engagement\",\"value\":0.020434782608696}]"                                                 | 0                          | 0                             | 0                                         | 0                                         | 0                                    | 0                         | 0                            | "2016-07-29 07:00:00 UTC" | "2016-07-29 07:00:00 UTC" | "10:00:00 - 10:59:59"                                  | "2016-07-29 17:00:00 UTC" |
| 2xxxxxxxx       | "Foo Bar"           | 6xxxxxxxxxxxx | "FooBar"       | 6xxxxxxxxxxxx    | "Campaign"           | 6xxxxxxxxxxxx | "Campaign  (Web Remarketing)"      | "VIDEO_VIEWS"    | "[{\"action_type\":\"video_view\",\"value\":33},{\"action_type\":\"page_engagement\",\"value\":33},{\"action_type\":\"post_engagement\",\"value\":33}]"                                              | 33                 | 0                         | 0                       | 112              | 1                       | 0           | 0                  | 0                       | 0                              | 0                  | 0                         | 0.64         | 0              | 0                    | 0                     | 0                   | 0.0                                    | 0                       | 0                               | 0                           | 0                              | 0                                      | 0                          | 0                                 | 0          | 0                 | 0.0              | 0               | 0                           | 0.0        | 5.7142857142857 | 0        | "0.019393939393939"          | "[{\"action_type\":\"video_view\",\"value\":0.019393939393939},{\"action_type\":\"page_engagement\",\"value\":0.019393939393939},{\"action_type\":\"post_engagement\",\"value\":0.019393939393939}]"                                                 | 0                          | 0                             | 0                                         | 0                                         | 0                                    | 0                         | 0                            | "2016-07-29 07:00:00 UTC" | "2016-07-29 07:00:00 UTC" | "11:00:00 - 11:59:59"                                  | "2016-07-29 18:00:00 UTC" |
| 2xxxxxxxx       | "Foo Bar"           | 6xxxxxxxxxxxx | "FooBar"       | 6xxxxxxxxxxxx    | "Campaign"           | 6xxxxxxxxxxxx | "Campaign  (Web Remarketing)"      | "VIDEO_VIEWS"    | "[{\"action_type\":\"video_view\",\"value\":23},{\"action_type\":\"page_engagement\",\"value\":23},{\"action_type\":\"post_engagement\",\"value\":23}]"                                              | 23                 | 0                         | 0                       | 83               | 2                       | 1           | 0                  | 0                       | 0                              | 0                  | 0                         | 0.43         | 0              | 0                    | 0                     | 0                   | 0.43                                   | 0                       | 0                               | 1                           | 0                              | 0                                      | 0                          | 0                                 | 0          | 0                 | 1.2048192771084  | 0               | 0                           | 0.43       | 5.1807228915663 | 0        | "0.018695652173913"          | "[{\"action_type\":\"video_view\",\"value\":0.018695652173913},{\"action_type\":\"page_engagement\",\"value\":0.018695652173913},{\"action_type\":\"post_engagement\",\"value\":0.018695652173913}]"                                                 | 0                          | 0                             | 0                                         | 0                                         | 0                                    | 0                         | 0                            | "2016-07-29 07:00:00 UTC" | "2016-07-29 07:00:00 UTC" | "12:00:00 - 12:59:59"                                  | "2016-07-29 19:00:00 UTC" |
| 2xxxxxxxx       | "Foo Bar"           | 6xxxxxxxxxxxx | "FooBar"       | 6xxxxxxxxxxxx    | "Campaign"           | 6xxxxxxxxxxxx | "Campaign  (Web Remarketing)"      | "VIDEO_VIEWS"    | "[{\"action_type\":\"video_view\",\"value\":49},{\"action_type\":\"page_engagement\",\"value\":49},{\"action_type\":\"post_engagement\",\"value\":49}]"                                              | 49                 | 0                         | 0                       | 199              | 2                       | 1           | 0                  | 0                       | 0                              | 0                  | 0                         | 1.23         | 0              | 0                    | 0                     | 0                   | 0.0                                    | 0                       | 0                               | 0                           | 0                              | 0                                      | 0                          | 0                                 | 0          | 0                 | 0.50251256281407 | 0               | 0                           | 1.23       | 6.1809045226131 | 0        | "0.025102040816327"          | "[{\"action_type\":\"video_view\",\"value\":0.025102040816327},{\"action_type\":\"page_engagement\",\"value\":0.025102040816327},{\"action_type\":\"post_engagement\",\"value\":0.025102040816327}]"                                                 | 0                          | 0                             | 0                                         | 0                                         | 0                                    | 0                         | 0                            | "2016-07-29 07:00:00 UTC" | "2016-07-29 07:00:00 UTC" | "13:00:00 - 13:59:59"                                  | "2016-07-29 20:00:00 UTC" |
| 2xxxxxxxx       | "Foo Bar"           | 6xxxxxxxxxxxx | "FooBar"       | 6xxxxxxxxxxxx    | "Campaign"           | 6xxxxxxxxxxxx | "Campaign  (Web Remarketing)"      | "VIDEO_VIEWS"    | "[{\"action_type\":\"video_view\",\"value\":22},{\"action_type\":\"page_engagement\",\"value\":22},{\"action_type\":\"post_engagement\",\"value\":22}]"                                              | 22                 | 0                         | 0                       | 119              | 3                       | 0           | 0                  | 0                       | 0                              | 0                  | 0                         | 0.66         | 0              | 0                    | 0                     | 0                   | 0.0                                    | 0                       | 0                               | 0                           | 0                              | 0                                      | 0                          | 0                                 | 0          | 0                 | 0.0              | 0               | 0                           | 0.0        | 5.546218487395  | 0        | "0.03"                       | "[{\"action_type\":\"video_view\",\"value\":0.03},{\"action_type\":\"page_engagement\",\"value\":0.03},{\"action_type\":\"post_engagement\",\"value\":0.03}]"                                                                                        | 0                          | 0                             | 0                                         | 0                                         | 0                                    | 0                         | 0                            | "2016-07-29 07:00:00 UTC" | "2016-07-29 07:00:00 UTC" | "14:00:00 - 14:59:59"                                  | "2016-07-29 21:00:00 UTC" |
| 2xxxxxxxx       | "Foo Bar"           | 6xxxxxxxxxxxx | "FooBar"       | 6xxxxxxxxxxxx    | "Campaign"           | 6xxxxxxxxxxxx | "Campaign  (Web Remarketing)"      | "VIDEO_VIEWS"    | "[{\"action_type\":\"video_view\",\"value\":27},{\"action_type\":\"page_engagement\",\"value\":27},{\"action_type\":\"post_engagement\",\"value\":27}]"                                              | 27                 | 0                         | 0                       | 97               | 2                       | 2           | 0                  | 0                       | 0                              | 0                  | 0                         | 0.81         | 0              | 0                    | 0                     | 0                   | 0.81                                   | 0                       | 0                               | 1                           | 0                              | 0                                      | 0                          | 0                                 | 0          | 0                 | 2.0618556701031  | 0               | 0                           | 0.405      | 8.3505154639175 | 0        | "0.03"                       | "[{\"action_type\":\"video_view\",\"value\":0.03},{\"action_type\":\"page_engagement\",\"value\":0.03},{\"action_type\":\"post_engagement\",\"value\":0.03}]"                                                                                        | 0                          | 0                             | 0                                         | 0                                         | 0                                    | 0                         | 0                            | "2016-07-29 07:00:00 UTC" | "2016-07-29 07:00:00 UTC" | "15:00:00 - 15:59:59"                                  | "2016-07-29 22:00:00 UTC" |
| 2xxxxxxxx       | "Foo Bar"           | 6xxxxxxxxxxxx | "FooBar"       | 6xxxxxxxxxxxx    | "Campaign"           | 6xxxxxxxxxxxx | "Campaign  (Web Remarketing)"      | "VIDEO_VIEWS"    | "[{\"action_type\":\"video_view\",\"value\":40},{\"action_type\":\"page_engagement\",\"value\":40},{\"action_type\":\"post_engagement\",\"value\":40}]"                                              | 40                 | 0                         | 0                       | 172              | 4                       | 1           | 0                  | 0                       | 0                              | 0                  | 0                         | 1.18         | 0              | 0                    | 0                     | 0                   | 1.18                                   | 0                       | 0                               | 1                           | 0                              | 0                                      | 0                          | 0                                 | 0          | 0                 | 0.58139534883721 | 0               | 0                           | 1.18       | 6.8604651162791 | 0        | "0.0295"                     | "[{\"action_type\":\"video_view\",\"value\":0.0295},{\"action_type\":\"page_engagement\",\"value\":0.0295},{\"action_type\":\"post_engagement\",\"value\":0.0295}]"                                                                                  | 0                          | 0                             | 0                                         | 0                                         | 0                                    | 0                         | 0                            | "2016-07-29 07:00:00 UTC" | "2016-07-29 07:00:00 UTC" | "16:00:00 - 16:59:59"                                  | "2016-07-29 23:00:00 UTC" |
| 2xxxxxxxx       | "Foo Bar"           | 6xxxxxxxxxxxx | "FooBar"       | 6xxxxxxxxxxxx    | "Campaign"           | 6xxxxxxxxxxxx | "Campaign  (Web Remarketing)"      | "VIDEO_VIEWS"    | "[{\"action_type\":\"video_view\",\"value\":20},{\"action_type\":\"page_engagement\",\"value\":20},{\"action_type\":\"post_engagement\",\"value\":20}]"                                              | 20                 | 0                         | 0                       | 126              | 0                       | 1           | 0                  | 0                       | 0                              | 0                  | 0                         | 2.35         | 0              | 0                    | 0                     | 0                   | 2.35                                   | 0                       | 0                               | 1                           | 0                              | 0                                      | 0                          | 0                                 | 0          | 0                 | 0.79365079365079 | 0               | 0                           | 2.35       | 18.650793650794 | 0        | "0.1175"                     | "[{\"action_type\":\"video_view\",\"value\":0.1175},{\"action_type\":\"page_engagement\",\"value\":0.1175},{\"action_type\":\"post_engagement\",\"value\":0.1175}]"                                                                                  | 0                          | 0                             | 0                                         | 0                                         | 0                                    | 0                         | 0                            | "2016-07-29 07:00:00 UTC" | "2016-07-29 07:00:00 UTC" | "17:00:00 - 17:59:59"                                  | "2016-07-30 00:00:00 UTC" |
+-----------------+---------------------+---------------+----------------+------------------+----------------------+---------------+------------------------------------+------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--------------------+---------------------------+-------------------------+------------------+-------------------------+-------------+--------------------+-------------------------+--------------------------------+--------------------+---------------------------+--------------+----------------+----------------------+-----------------------+---------------------+----------------------------------------+-------------------------+---------------------------------+-----------------------------+--------------------------------+----------------------------------------+----------------------------+-----------------------------------+------------+-------------------+------------------+-----------------+-----------------------------+------------+-----------------+----------+------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+----------------------------+-------------------------------+-------------------------------------------+-------------------------------------------+--------------------------------------+---------------------------+------------------------------+---------------------------+---------------------------+--------------------------------------------------------+---------------------------+
15 rows in set
Untitled-3
We don't need to run td connector:guess for the facebook_ads_reporting connector.

Step 3: Execute Load Job

Finally, submit the load job. It may take a couple of hours depending on the size of the data.

Facebook connector provides time column automatically. You don’t have to specify the --time-column option.

$ td connector:issue load.yml --database td_sample_db --table td_sample_table

Scheduled Execution

You can schedule periodic Data Connector execution for incremental Facebook Ads reporting data. We take great care in distributing and operating our scheduler in order to achieve high availability. By using this feature, you no longer need a cron daemon on your local datacenter.

For the scheduled import at first run, the Data Connector for Facebook Ads reporting imports all of your ad data.

On the second and subsequent runs, it will only import data that is newer than the last load.

Create the schedule

A new schedule can be created using the td connector:create command. The following are required: the name of the schedule, the cron-style schedule, the database and table where their data will be stored, and the Data Connector configuration file.

$ td connector:create \
    daily_import \
    "10 0 * * *" \
    td_sample_db \
    td_sample_table \
    config.yml
Untitled-3
The `cron` parameter also accepts three special options: `@hourly`, `@daily` and `@monthly`.
Untitled-3
By default, schedule is setup in UTC timezone. You can set the schedule in a timezone using -t or --timezone option. Please note that `--timezone` option only supports extended timezone formats like 'Asia/Tokyo', 'America/Los_Angeles' etc. Timezone abbreviations like PST, CST are *not* supported and may lead to unexpected schedules.

List All Schedules

You can see the list of all current schedule entries with the command td connector:list.

$ td connector:list
+--------------+------------+----------+-------+--------------+-----------------+----------------------------+
| Name         | Cron       | Timezone | Delay | Database     | Table           | Config                     |
+--------------+------------+----------+-------+--------------+-----------------+----------------------------+
| daily_import | 10 0 * * * | UTC      | 0     | td_sample_db | td_sample_table | {"in"=>{"type"=>"fac", ... |
+--------------+------------+----------+-------+--------------+-----------------+----------------------------+

Show Schedule Settings And History

td connector:show shows the execution settings of a schedule entry.

% td connector:show daily_import
Name     : daily_import
Cron     : 10 0 * * *
Timezone : UTC
Delay    : 0
Database : td_sample_db
Table    : td_sample_table
Config
---
in:
  type: "facebook_ads_reporting"
  ad_account_id: '[your ad account id]'
  access_token: "[your Facebook access token]"
  api_version: "v2.8" #optional parameter, defaults v2.7
out:
  mode: append

td connector:history shows the execution history of a schedule entry. To investigate the results of each individual run, please use td job <jobid>.

% td connector:history daily_import
+--------+---------+---------+--------------+-----------------+----------+---------------------------+----------+
| JobID  | Status  | Records | Database     | Table           | Priority | Started                   | Duration |
+--------+---------+---------+--------------+-----------------+----------+---------------------------+----------+
| 578066 | success | 10000   | td_sample_db | td_sample_table | 0        | 2015-04-18 00:10:05 +0000 | 160      |
| 577968 | success | 10000   | td_sample_db | td_sample_table | 0        | 2015-04-17 00:10:07 +0000 | 161      |
| 577914 | success | 10000   | td_sample_db | td_sample_table | 0        | 2015-04-16 00:10:03 +0000 | 152      |
| 577872 | success | 10000   | td_sample_db | td_sample_table | 0        | 2015-04-15 00:10:04 +0000 | 163      |
| 577810 | success | 10000   | td_sample_db | td_sample_table | 0        | 2015-04-14 00:10:04 +0000 | 164      |
| 577766 | success | 10000   | td_sample_db | td_sample_table | 0        | 2015-04-13 00:10:04 +0000 | 155      |
| 577710 | success | 10000   | td_sample_db | td_sample_table | 0        | 2015-04-12 00:10:05 +0000 | 156      |
| 577610 | success | 10000   | td_sample_db | td_sample_table | 0        | 2015-04-11 00:10:04 +0000 | 157      |
+--------+---------+---------+--------------+-----------------+----------+---------------------------+----------+
8 rows in set

Delete Schedule

td connector:delete will remove the schedule.

$ td connector:delete daily_import

Configuration

See the following table for more details on available in modes.

Option name Description Type Required? Default value
ad_account_id Ad account ID of access_token string yes — |
access_token Access Token. We recommend to use won’t expired token (see below section) string yes
app_secret If set, appsecret_proof parameter will be used to access API string optional
fields What you want to obtain fields. Available fields are here array optional All of fields except two; action_canvas_component_name and action_type
retry_limit Trying maximum retry times integer optional 5
retry_initial_wait_sec Wait seconds for exponential backoff initial value integer optional 10
last_fetched_at Added by config diff for incremental downloading. string optional
incremental true for generate “config_diff” with embulk run -c config.diff bool optional true
data_level Obtain data level. Facebook ad structure is Campaign –> Adset –> Ad –> Ad Creative. Available options are “ad” or “ad_creative”. string optional “ad”
api_version Use Facebook API version. Default is v2.7 but some Facebook apps require more higher version. string optional “v2.7”

Appendix

A) Modes for out plugin

You can specify file import mode in out section of seed.yml.

append (default)

This is the default mode and records are appended to the target table.

in:
  ...
out:
  mode: append

replace (In td 0.11.10 and later)

This mode replaces data in the target table. Please note that any manual schema changes made to the target table will remain intact with this mode.

in:
  ...
out:
  mode: replace

Last modified: Dec 19 2016 05:49:02 UTC

If this article is incorrect or outdated, or omits critical information, please let us know. For all other issues, please see our support channels.