A poor-man's data lake fill with ducks
-
Updated
Jun 22, 2023 - Python
A poor-man's data lake fill with ducks
A Dagster project that contains the data pipelines of the MODERATE project
Dagster Education Model using Dagster 1.3.11 and Python 3.7.17.
Data Engineering Stack with Dagster, Trino, Nessie and Superset
Dagster Cloud code for the Hooli Data Engineering organization.
Software-defined stock market assets derived from Börsdata excel files
Template for a DuckDB-based, Codespace-oriented sandbox project that is also dbt Cloud compatible, and includes code-first BI tooling via Evidence. Have also added Dagster and DBTs semantic layer.
Gov Transparency Hub is a data pipeline project built using Dagster to collect information from transparency portals of multiple cities. It focuses on gathering data like revenue and expenses, and aims to create a consolidated database that can be accessed via an API by third-party applications.
A simple etl pipeline orchestrated with dagster, to run both locally and/or on k8s. Uses minIO as both IOManager and destination when on k8s
A small Dagster example using S3 faked resource to check S3 code at offline local.
I created this repo to follow along with the examples in the Dagster University Essentials course.
An example project demonstrating how to submit data to Seafowl from a dagster job.
Add a description, image, and links to the dagster topic page so that developers can more easily learn about it.
To associate your repository with the dagster topic, visit your repo's landing page and select "manage topics."