Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: fix link

...

  • Basic knowledge of Treasure Data, including the toolbelt

  • An SFTP server


Basic Usage


You can limit

the

access to your endpoint by using a list of static IPs. Contact support@treasuredata.com if you need it.


Get your credential for your SFTP server

...

The key type ed25519 is not supported but the ecdsa key type is supported.

Rename

...

Remote File after

...

Upload

If you select the “Rename file after upload finish” option, SFTP result output renames the file on the remote SFTP server from “.xxx.tmp” to “.xxx” after all the data is transferred. Some MA tools will try to import data when a file with a specific name exists on the SFTP server. The temp name option is useful for such cases.


Execute the

...

Query

Either save the query with a name and run , or just run the query. Upon successful completion of the query, the query result is automatically imported to the specified container destination.

...

You can also use CLI for Result Export to SFTP.


secret_key_file case

The following example has the

escape

escaped newline with backslash in the key.


Code Block
linenumberstrue
$ td query --result '{"type":"sftp","host":"xx.xx.xx.xx","port":22,"username":"xxxx","secret_key_file":"{\"content\":\"-----BEGIN RSA PRIVATE KEY-----\nABCDEFJ\nABCDEFJ\n-----END RSA PRIVATE KEY-----\"}","secret_key_passphrase":"xxxxxx", "user_directory_is_root":true,"path_prefix":"/path/to/file.csv","rename_file_after_upload":false,"header_line":true,"quote_policy":"MINIMAL","delimiter":",","null_string":"","newline":"CRLF"}' -d sample_datasets "select * from www_access" -T presto

...

  • Check what is valid protocol. If you intend to SFTP, you can use this Data Connector for SFTP. If FTP/FTPS, try to connect with FTP Data Connector.

    • If you are using a firewall, check your accepted IP range/port. Server administrators sometimes change the default port number from TCP/22 for security reasons.

    • Be sure that your private key has an OpenSSH format. We don’t support other formats like “PuTTY”.

    • We do not support the default format of the private key since OpenSSH 7.8. Please re-generate the key using '-m PEM' option.