Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Put project and spider in joblogs path #47

Open
wvengen opened this issue Jan 3, 2025 · 0 comments
Open

Put project and spider in joblogs path #47

wvengen opened this issue Jan 3, 2025 · 0 comments
Labels
documentation Improvements or additions to documentation

Comments

@wvengen
Copy link
Member

wvengen commented Jan 3, 2025

In #45 joblogs could be stored on container/object storage. This is currently configured with a bucket name, and the jobid is used for the filename. scrapyd uses project and spider name in the logs path (e.g. see here), let's do that here as well. Is also useful in practice.

As joblogs is still in beta phase, we can change the path without the need for backward compatibility.

@wvengen wvengen added the documentation Improvements or additions to documentation label Jan 3, 2025
@wvengen wvengen changed the title Put project and spider in joblogs Put project and spider in joblogs path Jan 3, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation Improvements or additions to documentation
Projects
None yet
Development

No branches or pull requests

1 participant