A distributed data integration framework that simplifies common aspects of big data integration such as data ingestion, replication, organization and lifecycle management for both streaming and batch data ecosystems.
-
Updated
Jun 17, 2024 - Java
A distributed data integration framework that simplifies common aspects of big data integration such as data ingestion, replication, organization and lifecycle management for both streaming and batch data ecosystems.
Data Prepper is a component of the OpenSearch project that accepts, filters, transforms, enriches, and routes data at scale.
Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs
Service for bulk-loading data to databases with automatic schema management (Redshift, Snowflake, BigQuery, ClickHouse, Postgres, MySQL)
Use local files or public GitHub repository as a source and ask questions through ChatGPT about it
A free, open-source, web-based self-service BI tailor-made for clickhouse, google bigquery, mysql, postgresql, vertica
IBIS is a workflow creation-engine that abstracts the Hadoop internals of ingesting RDBMS data.
Extensible streaming ingestion pipeline on top of Apache Spark
Media Management System: ingestion, processing, encoding, delivery, ...
A simple demo application for uploading, ingesting, embedding videos and converting them to mp4s. From api.video (https://api.video)
Spark in Action, 2e - chapter 9 - Advanced ingestion: finding data sources and building your own
Periodically ingest incremental updates (inserts / deletes) into BigQuery using Cloud Composer / Airflow orchestration workflow
Parallel Streaming Transformation Loader
tagbase-server is a data management web service for working with eTUFF and nc-eTAG files.
Read-only mirror of https://gitlab.com/sorcero/community/ingestum
Add a description, image, and links to the ingestion topic page so that developers can more easily learn about it.
To associate your repository with the ingestion topic, visit your repo's landing page and select "manage topics."