Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Update clean stage layer script to be able to remove individual events from the stage layer by event name or by multiple event ids. It gets the s3 file the event is in, filters the file and removes the entries that correspond to the associated event id, creates a new file with the new filtered events and uploads it, then deletes the old file.
If cleaning by event name: filters the files in the stage layer key values table that have an event id associated to the event name and uploads new ones, and then removes all of the files from the stage layer table for the event name
if cleaning by event id: filters the files in the stage layer key values table that have the event ids that we want to remove and then uploads new ones, and then filters the files in the stage layer table that have the event ids that we want to remove and then uploads new ones
before:
after: