SQL stream processing, analytics, and management. We decouple storage and compute to offer instant failover, dynamic scaling, speedy bootstrapping, and efficient joins.
-
Updated
May 21, 2024 - Rust
SQL stream processing, analytics, and management. We decouple storage and compute to offer instant failover, dynamic scaling, speedy bootstrapping, and efficient joins.
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
My personal project for data engineering zoomcamp
Apache DevLake is an open-source dev data platform to ingest, analyze, and visualize the fragmented data from DevOps tools, extracting insights for engineering excellence, developer experience, and community growth.
Open Source Feature Flagging and A/B Testing Platform
Apache Superset is a Data Visualization and Data Exploration Platform
Workflow Engine for Kubernetes
Welcome to my solutions-hub. You can view my README, you can clone my repo and execute following the readme instructions. Thanks
Blazing-fast query execution engine speaks Apache Spark language and has Arrow-DataFusion at its core.
Distributed DataFrame for Python designed for the cloud, powered by Rust
CSVs sliced, diced & analyzed.
The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
🧙 Build, run, and manage data pipelines for integrating and transforming data.
Always know what to expect from your data.
Prefect is a workflow orchestration tool empowering developers to build, observe, and react to data pipelines
Big Data Modeling, MapReduce, Spark, PySpark @ Santa Clara University
Conduit streams data between data stores. Kafka Connect replacement. No JVM required.
An orchestration platform for the development, production, and observation of data assets.
Add a description, image, and links to the data-engineering topic page so that developers can more easily learn about it.
To associate your repository with the data-engineering topic, visit your repo's landing page and select "manage topics."