Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Luigi is a powerful, easy-to-use open-source framework for building data pipelines with Python. It handles dependency resolution, workflow management, visualization etc.

Image Modified


Luigi helps to build the data pipeline, typically associated with long-running batch processes. You want to chain many tasks together, automate them, and gracefully handle any failures.

...

Luigi-TD is a helper library to make it easier to issue Arm Treasure Data queries from Luigi tasks. This will allow you to create complex pipelines on top of TD easily.

...