Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Preserve attributes of published files (take 2) #5660

Open
wants to merge 2 commits into
base: master
Choose a base branch
from

Conversation

bentsherman
Copy link
Member

Continuation of #4522

Allow COPY_ATTRIBUTES on S3 copy as a no-op, so that this attribute can be set generically when publishing files.

For some reason this issue did not surface in the previous PR but only once the PR was merged

@bentsherman bentsherman requested a review from pditommaso January 9, 2025 14:21
Copy link

netlify bot commented Jan 9, 2025

Deploy Preview for nextflow-docs-staging canceled.

Name Link
🔨 Latest commit d484182
🔍 Latest deploy log https://app.netlify.com/sites/nextflow-docs-staging/deploys/677fdea9c46d770008253ca8

Signed-off-by: Ben Sherman <[email protected]>
@bentsherman bentsherman changed the title Allow COPY_ATTRIBUTES on S3 copy Preserve attributes of published files (take 2) Jan 9, 2025
@pditommaso
Copy link
Member

Tagging @jordeu for visibility? Does Fusion honour the copy of file timestamps?

@pditommaso
Copy link
Member

If the copy attributes is only honoured by local and shared file system, we should consider making this an opt-in feature, because it's not a portable behaviour.

In alternative, instead of copying the file stamps, it could be tried to copy the files ordering them by timestamp. Even if the timestamp would be different it may guarantee they are consistent with expectation of the tool reported in the issue (tho is should be verified the the timestamp is set when stating the upload or when it completes).

@bentsherman
Copy link
Member Author

I don't think re-ordering the publish operations will matter because they are published concurrently

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants