Very simple library to consume aws athena from spark or lambda services
-
Updated
Jan 10, 2023 - Python
Very simple library to consume aws athena from spark or lambda services
AWS CloudTrail Hands-on Lab
Este projeto tem como objetivo realizar a coleta, catalogo, governança, processamento e visualização de dados.
User, Event, and Predictive Metric Dashboard on 2GB/month of log files from Brackets IDE
Unveiling job market trends with Scrapy and AWS
This project aims to securely manage, streamline, and perform analysis on the structured and semi-structured YouTube videos data based on the video categories and the trending metrics.
An end-to-end data pipeline built with AWS S3, Glue, Crawler, Athena, Tableau visulization
This project combines some of my favorite technologies - open data, cloud computing, and Jupyter notebooks.
Continuing with my case study on reading a big data file, this is the fifth part of my trilogy :-) on how I got on reading a big'ish file with C, Python, spark-python and spark-scala, AWS Elastic Map reduce and AWS Athena.
The project is to simulate Real-time streaming for movie details using Kafka. We used different technologies such as Python, Amazon EC2, Apache Kafka, Glue, Athena, and SQL.
Stream CDC into an Amazon S3 data lake in Apache Iceberg format with AWS Glue Streaming and MSK Connect (Debezium)
This project is about building a data lake and creating an ETL pipeline in Spark that loads data from Amazon S3, processes the data into analytics tables, and loads them back into S3
Cloud Development Kit (AWS CDK) using TypeScript, Python and Java
How to setup an AWS Athena Database connection in DBVisualizer!
Batch datapipeline on aws using glue
An end-to-end solution for managing and analyzing YouTube video data from Kaggle, leveraging AWS services and visualized through Quicksight and Tableau
Get the dataset intro a S3 bucket, use AWS glue to transform the dataset, write a Lambda script to clean the dataset, query the dataset via AWS Athena then build a dashboard using AWS Quicksight.
A small walkthrough how to create an AWS Glue Job Pipeline with AWS CDK
Add a description, image, and links to the aws-athena topic page so that developers can more easily learn about it.
To associate your repository with the aws-athena topic, visit your repo's landing page and select "manage topics."