A curated list of awesome big data frameworks, ressources and other awesomeness.

Greenplum Database - Massively Parallel PostgreSQL for Analytics. An open-source massively parallel data platform for analytics, machine learning and AI.

The data warehouse for operational workloads.

Privacy and Security focused Segment-alternative, in Golang and React

Hydra: Column-oriented Postgres. Add scalable analytics to your project in minutes.

2019新型冠状病毒疫情时间序列数据仓库 | COVID-19/2019-nCoV Infection Time Series Data Warehouse

data load tool (dlt) is an open source Python library that makes data loading easy 🛠️

The dbt-native data observability solution for data & analytics engineers. Monitor your data pipelines in minutes. Available as self-hosted or cloud service with premium features.

[NOT MAINTAINED] Light-weight Python OLAP framework for multi-dimensional data analysis

TensorBase is a new big data warehousing with modern efforts.

Few projects related to Data Engineering including Data Modeling, Infrastructure setup on cloud, Data Warehousing and Data Lake development.

Open source SQL Query Assistant service for Databases/Warehouses

Scratch is a swiss army knife for big data.

Useful scripts, udfs, views, and other utilities for migration and data warehouse operations in BigQuery.

Optimus is an easy-to-use, reliable, and performant workflow orchestrator for data transformation, data modeling, pipelines, and data quality management.

Personal Data Engineering Projects

🔥🔥🔥 Open Source Alternative to Hightouch, Census, and RudderStack. Leading Reverse ETL and Customer Data Platform (CDP) for Data Teams.

Data API Framework for AI Agents and Data Apps

Supercharge BigQuery with BigFunctions

DomainMOD is an open source application written in PHP & MySQL used to manage your domains and other internet assets in a central location. DomainMOD also includes a Data Warehouse framework that allows you to import your web server data so that you can view, export, and report on your live data.