You can stream very large amounts of data from multiple devices into Treasure Data using a single MQTT broker. The MQTT broker works with your device management credentials to securely accept streaming data, and make the data available for queries in Treasure Data.
You can ingest data directly from individual devices into Treasure Data. Contact our Support team for more information.
Certification from your Device Manager and a Pipeline with MQTT Broker
You can use device management to authenticate your end devices and then push data into Treasure Data using device management. You configure your devices to send data to both your device manager and TD MQTT broker.
You can create multiple keys for your data collecting device but need only one authentication certificate.
For example, Pelion Device Management services are presented as one connection to the MQTT broker. The MQTT broker enables you to pipe the data collected from your Mbed Cloud to any destination that you want, including the Treasure Data platform.
You can stream device activities into TD. You create a query that captures device activity.
The following image shows a device panel on the right and the query in Treasure Data that captures device activity:
Treasure Data Account (contact us if you have an interest in IoT Platform)
Devices from which you gather data
(Optional) Device Management system such as Pelion Device Management
Access to the TD MQTT broker endpoint
Get your Treasure Data API Key
Retrieve your Write-Only API key from your profile in Treasure Data.
Obtain your TD MQTT Broker endpoint
Treasure Data assigns an endpoint to your account. Read more about Treasure Data Endpoints.
Prepare your MQTT Client to Talk to MQTT Broker
Prepare Configuration File
Prepare your configuration file by specifying: your TD Write-Only API key, the destination database, and table name. An example configuration is as follows.
Embed MQTT into your Device Management System
You can retrieve the source code example from GitHub.
Here’s an example code that you use to enable credentialing at your device management endpoint.
Create Your Query