Skip to content

AWS Kinesis Analytics gather metrics from various computers (cpu, memory), perform aggregation on Kinesis stream data using Kinesis Analytics (with flink) and store the stream data into AWS S3 bucket which is used by Amazon Athena for running various Analytics queries and rending charts using Grafana.

Notifications You must be signed in to change notification settings

pranav-patil/aws-kinesis-analytics

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

AWS Kinesis Analytics

AWS Kinesis Analytics is a demo project were metric data from computers (machines) are collected and processed using AWS Kinesis Analytics to ultimately store in Athena Database. This computer metric data in Athena can be used further to drive alerts and also for monitoring using tools such as Grafana.

Kinesis Data Analytics

Kinesis Data Analytics uses Flink operations to pe-process, aggregate and calculate derivative for metric data.

$ gradle clean build -x test

Kinesis Data Analytics

Infrastructure Setup

Execute the below terraform commands to deploy the resources.

$ terraform init
$ terraform plan
$ terraform apply -auto-approve -input=false

Follow the instructions in Metrics Generator repository to generate mock data that is added to Kinesis Firehose.

About

AWS Kinesis Analytics gather metrics from various computers (cpu, memory), perform aggregation on Kinesis stream data using Kinesis Analytics (with flink) and store the stream data into AWS S3 bucket which is used by Amazon Athena for running various Analytics queries and rending charts using Grafana.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published