Fakepilot

Trustpilot scrapping Python package. Extract online business reviews and integrate it on your code. It is based on BeautifulSoup.

Features

• Simple searching functionalitites.
• Support the selection of any country available in Trustpilot.
• Extraction of fine-grained data from business reviews.
• Use Trustpilot URLs or local file from where extract the information.

Installation

fakepilot is available on pip. You can install fakepilot from pip with

pip install fakepilot

To install fakepilot from the GitHub source, clone the repository with git:

git clone https://github.com/phoenixsite/fakepilot.git

Then, change your current directory to the one you cloned and install it with pip:

cd fakepilot
pip install .

Usage

The function search can be used to mimic the search bar functionality of Trustpilot. It limits the number of results and you can indicate whether some reviews should be extracted for each company result. For example, the following code search for two companies that match the expression 'starbucks' and two of its reviews.

import fakepilot as fp
fp.search("starbucks", 2, with_reviews=True, nreviews=2)

All the Trustpilot country-specific sites can be used to make the queries. For instance, the Norwegian Trustpilot site can be used:

fp.search("starbucks", 1, "norge")

If it is required that all the results include a specific parameter, e.g. the phone number of the company, you can specify in the search function:

fp.search("starbucks", 1, "norge",
		       with_reviews=False, nreviews=1, required_attrs="phone")

Also, the reviews of a Trustpilot company page can be directly extracted using `extract_reviews``from a given URL or a local file. The following block extracts ten reviews from the specified page:

get_reviews("https://www.trustpilot.com/review/www.starbucks.com", 10)

Documentation

For a detail description of all the options, you can build yourself the documentation in docs with Sphinx or visit the faekpilot documentation page.

Warning

I strongly recomment using this scrapper with moderation and carefully. Searching for multiple expressions in a short period of time can generate a lot of requests and connections to the Trustpilot servers and may affect the operation of the website. Be careful, respectful and responsible with scrappers online.