Reddit post searcher with given subreddit
!Heroky deployment is not working!
Usage:
-
Make sure to install nltk libraries! (You will see what you should install when trying to use scripts)
-
Use crawler.py for crawling your subreddit with arguments --r - Subreddit to crawl --storage_dir Directory to store posts --count_of_crawl Number of crawled posts It's safe to use storage_dir: crawled_data
-
Now, use indexer.py for data you crawled in 1. with arguments --crawled_data - Crawled data directory --index_dir - Index directory It's safe to use crawled_data: crawled_data, index_dir: indexes
-
Finally, use web_ui.api and you can search for given query in data you crawled (Available with non-fancy design :))