Skip to content
This repository has been archived by the owner on Apr 17, 2021. It is now read-only.

joocer/cronicl

Repository files navigation

cronicl: data pipelines.

License Security Rating Bugs Maintainability Rating bandit test_suite PyPI Latest Release Known Vulnerabilities Code style: black

cronicl is a simple data processing library written in Python.

No additional infrastructure or tools needed, if you can run Python, you can process data through cronicl.

Programatically author, connect, monitor and run workflows in Python.

Features

  • Programatically define pipeline flow and processing operations
  • Record the number of times each operation is executed and execution time
  • Automatic version tracking of processing operations
  • Trace messages through the pipeline (random sampling), including santization of sensitive information from trace logs
  • Monitor via HTTP interface
  • Automatic retry of operations

Install

From PyPi (recommended)

pip install cronicl

From GitHub

pip install https://github.com/joocer/cronicl/releases/download/v0.1.0/cronicl-0.1.0-py3-none-any.whl

Dependencies

NetworkX
Flask

License

Apache 2.0