Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

It’s also recommended to specify --time-column option, because Treasure Data’s storage is partitioned by time (see data partitioning) If the option is not provided, the data connector chooses the first long or timestamp column as the partitioning time. The type of the column specified by --time-column must be either of long and timestamp type.

If your data doesn’t have a time column you can add a time column by using add_time filter option. For more details see add_time filter plugin

Code Block
$ td connector:issue load.yml --database td_sample_db --table td_sample_table --time-column created_at

The connector:issue command assumes that you have already created a database(td_sample_db)and a table(td_sample_table). If the database or the table do not exist in TD, the connector:issue command fails, so create the database and table manually or use --auto-create-table option with td connector:issue command to auto create the database and table:

...

It’s also recommended to specify the --time-column option, because Treasure Data’s storage is partitioned by time (see data partitioning).

Code Block
$ td connector:create \
    daily_import \
    "10 0 * * *" \
    td_sample_db \
    td_sample_table \
    load.yml \
    --time-column created_at

...

Code Block
$ td connector:delete daily_import

...

Modes for out plugin

You can specify file import mode in out section of seed.yml.

...

  • Check what is valid protocol. If you intend to SFTP, you can use this Data Connector for SFTP. If FTP/FTPS, try connect with FTP Data Connector.

    • If you’re using firewall, check your accepted IP range/port. Server administrators sometimes change the default port number from TCP/22 for the security reasonreasons.

    • Be sure that your private key has OpenSSH format. We don’t support other formats like “PuTTY”.

...