Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.
-
Updated
May 31, 2024 - Python
Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.
A light-weight wrapper library around Spotify's Luigi workflow library to make writing scientific workflows more fluent, flexible and modular
Gokart solves reproducibility, task dependencies, constraints of good code, and ease of use for Machine Learning Pipeline.
An NLP framework for clinical phenotyping. Docker | Python | Solr | OMOP. http://claritynlp.readthedocs.io/en/latest/
Content for architecting a data science platform for products using Luigi, Spark & Flask.
A web frontend for scheduling Jupyter notebook reports
A project to help develop Luigi pipelines using Docker ✳️
🐍 🐳 Luigi in Docker - alpine and ubuntu images available
A luigi powered analytics / warehouse stack
Automated ML pipeline with Python, Docker, Luigi, SciKit-Learn and Pandas to predict wine quality ratings
The FAQ management service allows customers to manage a list of frequently asked questions through an SAP Fiori interface. For this, it leverages multiple SAP technologies such as the Kyma runtime, SAP Cloud Application Programming Model (CAP), SAP Application Router, Luigi, Fundamental Vue, and SAP Fiori elements.
Migrated to: https://gitlab.com/Oslandia/osm-data-classification
ETL Pipeline using Luigi
A simple project to analyse Malaysian airports - an opportunity to play with tools like Luigi, Docker, and Metabase as part of an end-to-end analytics framework.
collection of python scripts for a toolchain to feed an ElasticSearch-Index with bibliographic metadata and harvest RDF out of it
Luigi pipeline to download VoxCeleb(2) audio from YouTube and extract speaker segments
Add a description, image, and links to the luigi topic page so that developers can more easily learn about it.
To associate your repository with the luigi topic, visit your repo's landing page and select "manage topics."