Data Retention Policy

We are adjusting our data retention period to 30 days for the following items.

Table of Contents

Query Results

You may download the result set of any query in CSV, TSV or any other supported format for 30 days after the initial query is run. After this, we will expire the result data. The query itself and its execution logs will be retained indefinitely, so you may always re-execute it to rebuild the result set and retain it for another 90 days. Please take care to note that queries executed against regularly updated time-series data will yield different results on each execution unless a time window is specified in the query.

Bulk Import Sessions

Any data uploaded to Treasure Data through a Bulk Import Session but not imported into a Treasure Data table will be expired after 30 days.

Table Expiration

You may set an expiration date on your Treasure Data tables. If you do so, your data will be retained for an additional 30 days after the set expiration date. If you make a mistake in setting the expiration, the data can be restored any time within this 30 day window.

Table Deletion

When you delete a table on Treasure Data, the data is retained for 30 days and can be recovered any time during this period.

Account Cancellation

We preserve all account data for 30 days after an account deletion, unless explicitly stated otherwise in your contract. This includes all databases, tables, user accounts, queries, and job histories. Please note that a failed “Proof of Concept” or “Demo Account” is considered a cancelled account and, as such, is subject to this same policy.

We enforce some limit on how much of the Job History can be accessed by all our customers.

Page Term
Jobs list Jobs history for past 14 days
Job history in Query editor History of runs in past 90 days
Job history via Support Jobs history of any give

FAQs

Will we be able to see a job and his result by job_id?

You will always be able to retrieve the job by job_id. Per our query’s data retention policy, you will continue to be able to retrieve the result of a job up to 90 days past its execution.

Can we see the history of a scheduled job (e.g. weekly job)?

Yes, you can see the history of that scheduled query and the corresponding result for up to 90 days after each job executed.

Can we retrieve the job list on the CLI?

Yes, you can use td job:list command to access jobs within the last 14 days.

What to Expect

According to our research on existing usage patterns, 99.9% of the current usages would not be affected by this migration. On the other hand, we believe our users will get greater value from the new features and performance improvements that this change will enable us to introduce.


Last modified: Mar 09 2017 05:06:31 UTC

If this article is incorrect or outdated, or omits critical information, please let us know. For all other issues, please see our support channels.