🏆 Spark4You Design patterns
-
Updated
Jun 3, 2024 - Shell
🏆 Spark4You Design patterns
🎓 Repositório com a solução de IoT Analytics desenvolvida como parte do Trabalho de Conclusão de Curso (TCC) do curso de Ciência da Computação da Universidade Federal de Campina Grande (UFCG)
Spark structured streaming examples with using of version 3.5.1
Simple datalake
Spark Structured Streaming data pipeline that processes movie ratings data in real-time.
A data pipeline with Docker, Airflow, Kafka, Spark Streaming, cassandra
Examples of IT ruling technologies
Spark Structured Streaming with Kafka Integration
Elastic scaling is a library that allows to control the number of resources (executors or workers) instantiated by a Spark Structured Streaming Job in order to optimize the effective microbatch duration.
In this solution, the issue of creating a table with case-sensitive columns (in the scenario where the table doesn't exist or when writing the table in overwrite mode) in Oracle has been addressed by developing a custom Oracle dialect and registering it.
Exploring Spark Structured Streaming features by making use of Jupiter notebooks, Pyspark and interacting with a Kafka cluster.
Kafka streaming job from iomete. This streaming job copies data from Kafka to Iceberg.
spark structured streaming appending only file source based on datasource apiv2. Spark增量日志流式抓取
Building a scalable solution using Spark and Kafka to discover trending topics within Meetup data using Z-Score analysis.
Spark Structured Streaming vs Kafka Streams
Spark Structured Streaming with State Store
A real-time reddit data streaming pipeline for sentiment analysis of various subreddits
This project provides Apache Spark SQL, Flink DataStream API examples in Scala language
Credit Card Fraudulent Detection with Random Forest
Add a description, image, and links to the spark-structured-streaming topic page so that developers can more easily learn about it.
To associate your repository with the spark-structured-streaming topic, visit your repo's landing page and select "manage topics."