Writing Job Results to a SFTP Server

This article explains how to send job results directly to your sftp server.

Table of Contents

Prerequisites

  • Basic knowledge of Treasure Data, including the toolbelt.
  • An sftp server

Basic Usage



Untitled-3
You can limit the access to your endpoint by using a list of static IPs. Please contact support@treasuredata.com if you need it.

Get your credential for your SFTP server

First, please obtain your credential to access your SFTP server.

Write the query

Please visit the Treasure Data Console query editor page and compile your query.

Specify the Result Export target

In the same window, click the Add button in the Result Export section and select SFTP from the drop down menu. Please fill out all the information, including your Host, Port, Username, Private Keyfile, and Passphrase of keyfile (if available).



Execute the query

Finally, either save the query with a name and run or just run the query. Upon successful completion of the query, its result will be automatically imported to the specified Container destination:

Usage from CLI

You can also use CLI for Result Export to SFTP.

secret_key_file case

Untitled-3
Please note that escape newline with backslash in key.

Example,

$ td query --result '{"type":"sftp","host":"xx.xx.xx.xx","port":22,"username":"xxxx","secret_key_file":"{\"content\":\"-----BEGIN RSA PRIVATE KEY-----\nABCDEFJ\nABCDEFJ\n-----END RSA PRIVATE KEY-----\"}","secret_key_passphrase":"xxxxxx", "user_directory_is_root":true,"path_prefix":"/path/to/file.csv","sequence_format":"","header_line":true,"quote_policy":"MINIMAL","delimiter":",","null_string":"","newline":"CRLF"}' -d sample_datasets "select * from www_access" -T presto

user/password case

Example,

$ td query --result '{"type":"sftp","host":"xx.xx.xx.xx","port":22,"auth_method":"Password","username":"xxxx","password":"xxxxx","user_directory_is_root":true,"path_prefix":"/path/to/file.csv","sequence_format":"","header_line":true,"quote_policy":"MINIMAL","delimiter":",","null_string":"","newline":"CRLF"}' -d sample_datasets "select * from www_access" -T presto

Last modified: Mar 22 2017 18:53:16 UTC

If this article is incorrect or outdated, or omits critical information, please let us know. For all other issues, please see our support channels.