A compilation of work completed in the Big Data course I took during my master's program.
- acm_citation_analysis (final project) - using the weighted page rank algorithm, understand which papers in the ACM database get cited most frequently and are most 'important' in the network. Read more here.
- common_followers - explore which social media users mutually follow one another.
- common_movies - identify people with the highest overlap in common movie viewing.
- wikipedia_and_higgs - find symmetric wikipedia URLs. Create in-degree distribution of the higgs social media data set.
- yelp_average_stars - calculate the average stars per business on Yelp using MapReduce and Map-Combine-Reduce.
- yelp_restaurant_ml - Use text mining techniques and machine learning to predict the star rating of restaurants on Yelp using the raw text reviews.
- Hadoop
- Scala
- Spark/PySpark
- Java