Using Docker images of td-spark .

  1. Optionally, if you don't have Docker, install Docker on your machine.

  2. Use TD Console to retrieve your TD API key.

  3. Set your TD API key environment variable using the following syntax:

    $ export TD_API_KEY=<your TD API key>
  4. Run Spark shell using your TD API key. For example:

    $ docker run -it -e TD_API_KEY=$TD_API_KEY armtd/td-spark-shell:latest
  5. Run PySpark shell. For example:

    $ docker run -it -e TD_API_KEY=$TD_API_KEY armtd/td-spark-pyspark:lates
  • No labels