Tests with Spark local, kafka streaming and socket streaming
-
Updated
Feb 1, 2018 - Java
Tests with Spark local, kafka streaming and socket streaming
Using kafka streaming to implement the streaming ETL job, append data onto GCP Big Query after formatting.
Example from Designing Event-driven Applications Using Apache Kafka Ecosystem By Bogdan Sucaciu m 5
This repository is a comprehensive guide and toolkit for anyone looking to understand and implement data streaming solutions using Apache Kafka.
Consumer Producer Components
Kafka integration in Springboot, including producer, consumer, streaming, and interactive query of Ktable.
Machine Learning (Streaming) with KAFKA, Debezium and BentoML Service.
studying pyspark with various external applications
The purpose of this project is to learn, develop and explore microservices using spring boot, spring cloud, event streaming
Base project for kafka-streams development and testing
The objectives of this project are to get experience of coding with: Spark, Spark SQL, Spark Streaming, Kafka, Scala and functional programming
Scripts for music feature analysis, model training, and real-time recommendation using Apache Kafka. Extract features with Librosa, store in MongoDB, and process with Apache Spark. Web interface included. Contributors: Tashfeen Abbasi, Laiba Mazhar, Rafia Khan.
Kafka streaming performance tests.
Data streaming project with Apache Druid & Grafana: Real-time data processing, alerts, integration with AWS. It uses a combination of technologies and services, including Confluent-Kafka, Apache Druid, AWS SNS, EC2, Athena, S3, Glue and EventBridge, StepFunctions. Contribute to this powerful solution!
A pipeline that consumes twitter data to extract meaningful insights about a variety of topics using the following technologies: twitter API, Kafka, MongoDB, and Tableau.
This project implements an end-to-end pipeline for batch to stream processing using Kafka on Docker images. Besides that, there are exercises for a full course in Kafka.
Add a description, image, and links to the kafka-streaming topic page so that developers can more easily learn about it.
To associate your repository with the kafka-streaming topic, visit your repo's landing page and select "manage topics."