Skip to content

Commit

Permalink
Adds extractors tap-playstore (haleemur)
Browse files Browse the repository at this point in the history
  • Loading branch information
pnadolny13 committed Feb 27, 2024
1 parent 69df3e9 commit 9671e57
Show file tree
Hide file tree
Showing 7 changed files with 116 additions and 41 deletions.
1 change: 1 addition & 0 deletions _data/default_variants.yml
Original file line number Diff line number Diff line change
Expand Up @@ -375,6 +375,7 @@ extractors:
tap-planfix: epoch8
tap-platformpurple: singer-io
tap-plausible: airbyte
tap-playstore: haleemur
tap-plentymarkets: hotgluexyz
tap-podbean: slalom-consulting
tap-pokeapi: airbyte
Expand Down
4 changes: 4 additions & 0 deletions _data/maintainers.yml
Original file line number Diff line number Diff line change
Expand Up @@ -493,6 +493,10 @@ haaspt:
label: Patrick Tyler Haas
name: haaspt
url: https://github.com/haaspt
haleemur:
label: haleemur
name: haleemur
url: https://github.com/haleemur
harrystech:
label: harrystech
name: harrystech
Expand Down
7 changes: 4 additions & 3 deletions _data/meltano/extractors/tap-google-play/edgarrmondragon.yml
Original file line number Diff line number Diff line change
Expand Up @@ -6,13 +6,14 @@ capabilities:
- schema-flattening
- state
- stream-maps
description: Digital distribution service operated and developed by Google
description: Digital distribution service operated and developed by Google.
This tap uses a scraper to extract reviews from the Google Play Store.
domain_url: https://play.google.com/store/games
executable: tap-google-play
keywords:
- meltano_sdk
label: Google Play
logo_url: /assets/logos/extractors/google-play.svg
label: Google Play (Reviews Scraper)
logo_url: /assets/logos/extractors/playstore.png
maintenance_status: active
name: tap-google-play
namespace: tap_google_play
Expand Down
7 changes: 4 additions & 3 deletions _data/meltano/extractors/tap-google-play/hotgluexyz.yml
Original file line number Diff line number Diff line change
Expand Up @@ -5,13 +5,14 @@ capabilities:
- schema-flattening
- state
- stream-maps
description: Digital distribution service operated and developed by Google
description: Digital distribution service operated and developed by Google.
This tap uses a scraper to extract reviews from the Google Play Store.
domain_url: https://play.google.com/store/games?pli=1
executable: tap-google-play
keywords:
- meltano_sdk
label: Google Play
logo_url: /assets/logos/extractors/google-play.svg
label: Google Play (Reviews Scraper)
logo_url: /assets/logos/extractors/playstore.png
maintenance_status: active
name: tap-google-play
namespace: tap_google_play
Expand Down
103 changes: 103 additions & 0 deletions _data/meltano/extractors/tap-playstore/haleemur.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,103 @@
capabilities:
- about
- batch
- catalog
- discover
- schema-flattening
- state
- stream-maps
description: Digital distribution service operated and developed by Google.
This tap uses the data exported to your GCS bucket.
domain_url: https://play.google.com/store/games
executable: tap-playstore
keywords:
- meltano_sdk
label: Google Play Store (GCS Export)
logo_url: /assets/logos/extractors/playstore.png
maintenance_status: active
name: tap-playstore
namespace: tap_playstore
next_steps: ''
pip_url: git+https://github.com/haleemur/tap-playstore.git
quality: silver
repo: https://github.com/haleemur/tap-playstore
settings:
- description: Compression format to use for batch files.
kind: options
label: Batch Config Encoding Compression
name: batch_config.encoding.compression
options:
- label: Gzip
value: gzip
- label: None
value: none
- description: Format to use for batch files.
kind: options
label: Batch Config Encoding Format
name: batch_config.encoding.format
options:
- label: Jsonl
value: jsonl
- label: Parquet
value: parquet
- description: Prefix to use when writing batch files.
kind: string
label: Batch Config Storage Prefix
name: batch_config.storage.prefix
- description: Root path to use when writing batch files.
kind: string
label: Batch Config Storage Root
name: batch_config.storage.root
- description: The GCS Bucket where Play Console Reports are stored.
kind: string
label: Bucket Name
name: bucket_name
- description: 'The most recent record date to sync. NOTE: this has not been implemented
yet.'
kind: date_iso8601
label: End Date
name: end_date
- description: 'One or more LCID locale strings to produce localized output for: https://faker.readthedocs.io/en/master/#localization'
kind: array
label: Faker Config Locale
name: faker_config.locale
- description: 'Value to seed the Faker generator for deterministic output: https://faker.readthedocs.io/en/master/#seeding-the-generator'
kind: string
label: Faker Config Seed
name: faker_config.seed
- description: "'True' to enable schema flattening and automatically expand nested
properties."
kind: boolean
label: Flattening Enabled
name: flattening_enabled
- description: The max depth to flatten schemas.
kind: integer
label: Flattening Max Depth
name: flattening_max_depth
- description: Google Cloud Service Account JSON file
kind: string
label: Service Account Json File
name: service_account_json_file
- description: Google Cloud Service Account JSON string
kind: string
label: Service Account Json Str
name: service_account_json_str
- description: The earliest record date to sync
kind: date_iso8601
label: Start Date
name: start_date
- description: User-defined config values to be used within map expressions.
kind: object
label: Stream Map Config
name: stream_map_config
- description: Config object for stream maps capability. For more information check
out [Stream Maps](https://sdk.meltano.com/en/latest/stream_maps.html).
kind: object
label: Stream Maps
name: stream_maps
settings_group_validation:
- - bucket_name
- start_date
settings_preamble: ''
usage: ''
variant: haleemur
35 changes: 0 additions & 35 deletions static/assets/logos/extractors/google-play.svg

This file was deleted.

Binary file added static/assets/logos/extractors/playstore.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.

0 comments on commit 9671e57

Please sign in to comment.