XL-LightHouse是一套支持超大数据量、支持超高并发的通用型流式大数据统计系统。常见的应用场景包括：PV、UV统计；电商销售额、下单用户数统计；日志量统计；接口调用量、异常量、耗时情况统计；服务器运维指标监控等功能。系统支持多维度统计，支持各种复杂的条件筛选和逻辑判断，一键部署，一行代码接入，轻松实现各种海量数据实时统计，帮助企业以更低的成本快速搭建起数据指标体系，是企业降本增效的好帮手！

YTsaurus is a scalable and fault-tolerant open-source big data platform.

Apache Spark - A unified analytics engine for large-scale data processing

A large-scale entity and relation database supporting aggregation of properties

Apache Celeborn is an elastic and high-performance service for shuffle and spilled data.

Apache Doris is an easy-to-use, high performance and unified analytics database.

Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.

REST API for Apache Spark on K8S or YARN

Spark-Dashboard is a solution for monitoring Apache Spark jobs. This repository provides the tooling and configuration for deploying an Apache Spark Performance Dashboard using containers technology.

An open source framework for building data analytic applications.

🧙 Build, run, and manage data pipelines for integrating and transforming data.

Uniffle is a high performance, general purpose Remote Shuffle Service.

Nessie: Transactional Catalog for Data Lakes with Git-like semantics

Resilient data pipeline framework running on Apache Spark

Spark RAPIDS plugin - accelerate Apache Spark with GPUs

Apache DataFusion Comet Spark Accelerator

An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs

Python SQL Parser and Transpiler