Treasure Agent (td-agent) is a stable distribution package of Fluentd, which is maintained by Treasure Data and the Cloud Native Computing Foundation.

Before Installation

You can learn more about how to prepare for the installation at Fluentd Installation Guide.

Install or Upgrade td-agent

You can install or upgrade from a previous version using the following methods.  We recommend the latest version of td-agent, which can be downloaded from the www.fluentd.org website.

Learn more about how this version compares to earlier versions.

Platform

Platform Version

Package or Installer

Ubuntu/Debian

2.6+ Linux kernel (64-bit)

td-agent v4

td-agent4

We currently provide td-agent4.x packages for Ubuntu Focal, Bionic, Xenial, and Debian Buster. 

A shell script is provided to automate the installation process for each version. The shell script registers a new apt repository at /etc/apt/sources.list.d/treasure-data.list and installs the td-agent deb package.

For Ubuntu Focal,

# Ubuntu 20.4 Focal -- td-agent4
$ curl -L https://toolbelt.treasuredata.com/sh/install-ubuntu-focal-td-agent4.sh | sh

For Ubuntu Bionic,

# Ubuntu 18.4 Bionic -- td-agent4
$ curl -L https://toolbelt.treasuredata.com/sh/install-ubuntu-bionic-td-agent4.sh | sh

For Ubuntu Xenial,

# Ubuntu 16.04 Xenial -- td-agent4
$ curl -L https://toolbelt.treasuredata.com/sh/install-ubuntu-xenial-td-agent4.sh | sh

For Debian Buster,

# Debian Buster
$ curl -L https://toolbelt.treasuredata.com/sh/install-debian-buster-td-agent4.sh | sh

td-agent3

Legacy td-agent3.x is available for EOL versions Ubuntu Trusty, Debian Stretch, and Debian Jessie.

A shell script is provided to automate the installation process for each version. The shell script registers a new apt repository at /etc/apt/sources.list.d/treasure-data.list and installs the td-agent deb package.

These commands set up td-agent package for you:

For Ubuntu Trusty,

$ curl -L https://toolbelt.treasuredata.com/sh/install-ubuntu-trusty-td-agent3.sh | sh

For Debian Stretch,

$ curl -L https://toolbelt.treasuredata.com/sh/install-debian-stretch-td-agent3.sh | sh

For Debian Jessie,

$ curl -L https://toolbelt.treasuredata.com/sh/install-debian-jessie-td-agent3.sh | sh


Launch Daemon by systemd

The /lib/systemd/system/td-agent script is provided to start, stop, or restart the agent.

$ sudo systemctl start td-agent.service
$ sudo systemctl status td-agent.service
● td-agent.service - td-agent: Fluentd based data collector for Treasure Data
   Loaded: loaded (/lib/systemd/system/td-agent.service; disabled; vendor preset: enabled)
   Active: active (running) since Thu 2017-12-07 15:12:27 PST; 6min ago
     Docs: https://docs.treasuredata.com/articles/td-agent
  Process: 53192 ExecStart = /opt/td-agent/embedded/bin/fluentd --log /var/log/td-agent/td-agent.log --daemon /var/run/td-agent/td-agent.pid (code = exited, statu
 Main PID: 53198 (fluentd)
   CGroup: /system.slice/td-agent.service
           ├─53198 /opt/td-agent/embedded/bin/ruby /opt/td-agent/embedded/bin/fluentd --log /var/log/td-agent/td-agent.log --daemon /var/run/td-agent/td-agent
           └─53203 /opt/td-agent/embedded/bin/ruby -Eascii-8bit:ascii-8bit /opt/td-agent/embedded/bin/fluentd --log /var/log/td-agent/td-agent.log --daemon /v

Dec 07 15:12:27 ubuntu systemd[1]: Starting td-agent: Fluentd based data collector for Treasure Data...
Dec 07 15:12:27 ubuntu systemd[1]: Started td-agent: Fluentd based data collector for Treasure Data.

If you want to customize systemd behavior, put your td-agent.service into /etc/systemd/system

Launch Daemon by init.d

The /etc/init.d/td-agent script is provided to start, stop, or restart the agent.

$ sudo /etc/init.d/td-agent restart
$ sudo /etc/init.d/td-agent status
td-agent (pid  21678) is running...

The following commands are supported:

$ sudo /etc/init.d/td-agent start
$ sudo /etc/init.d/td-agent stop
$ sudo /etc/init.d/td-agent restart
$ sudo /etc/init.d/td-agent status

Make sure your configuration file is located at /etc/td-agent/td-agent.conf.

The logs are located under /var/log/td-agent. The daemon is running in td-agent user and td-agent group.

The config file is located at /etc/td-agent/td-agent.conf. After its modification, restart the agent.

Cookbook

See the OpsCode chef cookbook, to automate this process. Refer to: https://github.com/treasure-data/chef-td-agent.

Other Resources

The ChangeLog for td-agent.

Continuous Data Import with td-agent

  • No labels