Skip to content
This repository has been archived by the owner on Sep 23, 2024. It is now read-only.

Commit

Permalink
PipelineWise shrink Notice
Browse files Browse the repository at this point in the history
  • Loading branch information
louis-pie committed Sep 2, 2024
1 parent 481715f commit 28b16f5
Showing 1 changed file with 17 additions and 10 deletions.
27 changes: 17 additions & 10 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,10 @@
# Notice
To better serve Wise business and customer needs, the PipelineWise codebase needs to shrink.
We have made the difficult decision that, going forward many components of PipelineWise will be removed or incorporated in the main repo.
The last version before this decision is [v0.64.1](https://github.com/transferwise/pipelinewise/tree/v0.64.1)

We thank all in the open-source community, that over the past 6 years, have helped to make PipelineWise a robust product for heterogeneous replication of many many Terabytes, daily

# pipelinewise-tap-slack

[![PyPI version](https://badge.fury.io/py/pipelinewise-tap-slack.svg)](https://badge.fury.io/py/pipelinewise-tap-slack)
Expand Down Expand Up @@ -96,12 +103,12 @@ It's important to note that a bot *CANNOT* join an archived channel, so unless t
Due to the potentially high volume of data when syncing certain streams (messages, files, threads)
this tap implements date windowing based on a configuration parameter.

including
including
```json
"date_window_size": "5"
```

Will cause the tap to sync 5 days of data per request, for applicable streams. The default value if
Will cause the tap to sync 5 days of data per request, for applicable streams. The default value if
one is not defined is to window requests for 7 days at a time.

## Usage
Expand Down Expand Up @@ -155,39 +162,39 @@ The `Users` stream _does_ store information about when a User record was last up
- Primary Key Column: `id`
- Replication Strategy: `INCREMENTAL`
- API Documentation: [Link](https://api.slack.com/methods/users.list)

### Threads (Conversation Replies)

- Table Name: `threads`
- Description:
- Primary Key Columns: `channel_id`, `ts`, `thread_ts`
- Replication Strategy: `FULL_TABLE` for each parent `message`
- API Documentation: [Link](https://api.slack.com/methods/conversations.replies)
### User Groups

### User Groups

- Table Name: `user_groups`
- Description:
- Primary Key Column: `id`
- Replication Strategy: `FULL_TABLE`
- API Documentation: [Link](https://api.slack.com/methods/usergroups.list)
### Files

### Files

- Table Name: `files`
- Description:
- Primary Key Column: `id`
- Replication Strategy: `INCREMENTAL` query filtered using date windows and lookback window
- API Documentation: [Link](https://api.slack.com/methods/files.list)
### Remote Files

### Remote Files

- Table Name: `remote_files`
- Description:
- Primary Key Column: `id`
- Replication Strategy: `INCREMENTAL` query filtered using date windows and lookback window
- API Documentation: [Link](https://api.slack.com/methods/files.remote.list)

## Testing the Tap

Install test dependencies
Expand Down

0 comments on commit 28b16f5

Please sign in to comment.