Skip to content

Modern Data Stack in a box with dbt-duckdb and Apache Superset

License

Notifications You must be signed in to change notification settings

kyaukyuai/jaffle_shop_duckdb_superset

Repository files navigation

jaffle_shop_duckdb_superset


This is a simple project using dbt-duckdb and Apache Superset to build an all-in-one Modern Data Stack which can be used on your laptop without Cloud Stacks.

It's inspired by this article: Modern Data Stack in a Box with DuckDB. The specific configuration for implementation is as follows. This time, the focus is on simplification, and parts such as ORCHESTRATION and INGESTION are omitted. Considering the developer productivity in a local environment, ORCHESTRATION is unnecessary, and for INGESTION, DuckDB's httpfs or scanner extension is considered sufficient. Of course, it is possible to expand as necessary.

Modern Data Stack in a Box

Requirements

Setup

Just 2 steps!

  1. Rename .env.example file to .env and set your desired password. Remember to never commit files containing passwords or any other sensitive information.

  2. With Docker engine and Docker-Compose installed, change directory to the root folder of the project (also the one that contains docker-compose.yml) and run.o

    docker-compose up --build

Screenshots

Apache Superset

Apache Superset

dbt

Overview Lineage Graph

References

About

Modern Data Stack in a box with dbt-duckdb and Apache Superset

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published