Skip to content

edgarrmondragon/tap-google-play

Repository files navigation

tap-google-play

Singer tap for Google Play Reviews. Built with the Meltano Singer SDK.

Based on hotglue/tap-google-play.

Capabilities

  • catalog
  • state
  • discover
  • about
  • stream-maps
  • schema-flattening
  • batch

Settings

Setting Required Default Description
app_id False None The app ID to extract reviews from.
app_id_list False None A list of app IDs to extract reviews from.
start_date False None The date to start extracting reviews from
stream_maps False None Config object for stream maps capability. For more information check out Stream Maps.
stream_map_config False None User-defined config values to be used within map expressions.
flattening_enabled False None 'True' to enable schema flattening and automatically expand nested properties.
flattening_max_depth False None The max depth to flatten schemas.
batch_config False None

A full list of supported settings and capabilities is available by running: tap-google-play --about

Usage

You can easily run tap-google-play by itself or in a pipeline using Meltano.

Executing the Tap Directly

tap-google-play --version
tap-google-play --help
tap-google-play --config CONFIG --discover > ./catalog.json

Developer Resources

Initialize your Development Environment

pipx install poetry
poetry install

Create and Run Tests

Create tests within the tests subfolder and then run:

poetry run pytest

You can also test the tap-google-play CLI interface directly using poetry run:

poetry run tap-google-play --help

Testing with Meltano

Note: This tap will work in any Singer environment and does not require Meltano. Examples here are for convenience and to streamline end-to-end orchestration scenarios.

Your project comes with a custom meltano.yml project file already created. Open the meltano.yml and follow any "TODO" items listed in the file.

Next, install Meltano (if you haven't already) and any needed plugins:

# Install meltano
pipx install meltano
# Initialize meltano within this directory
cd tap-google-play
meltano install

Now you can test and orchestrate using Meltano:

# Test invocation:
meltano invoke tap-google-play --version
# OR run a test `elt` pipeline:
meltano elt tap-google-play target-jsonl

SDK Dev Guide

See the dev guide for more instructions on how to use the SDK to develop your own taps and targets.