Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve docker build speed and caching #118

Merged
merged 10 commits into from
Dec 10, 2024
Merged

Conversation

stefpiatek
Copy link
Contributor

Didn't have a look into the build time of the application, but duckdb takes forever to build. Running make with 4 cores decreased build time from ~3300s to ~1000s. Also changed order to allow the dependencies to be cached.

@stefpiatek stefpiatek requested a review from milanmlft December 4, 2024 09:23
Copy link

codecov bot commented Dec 4, 2024

The author of this PR, stefpiatek, is not an activated member of this organization on Codecov.
Please activate this user on Codecov to display this PR comment.
Coverage data is still being uploaded to Codecov.io for purposes of overall coverage calculations.
Please don't hesitate to email us at [email protected] with any questions.

Copy link
Member

@milanmlft milanmlft left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks Stef! Looks like the caching is actually working now 🎉

preprocessing/Dockerfile Outdated Show resolved Hide resolved
@milanmlft
Copy link
Member

Followed renv's guide on multi-stage docker builds to separate the renv set up and installation so it would be cached across builds.

public.env.sample Outdated Show resolved Hide resolved
preprocessing/Dockerfile Outdated Show resolved Hide resolved
@milanmlft milanmlft enabled auto-merge (squash) December 10, 2024 16:08
@milanmlft milanmlft merged commit 67733da into main Dec 10, 2024
10 checks passed
@milanmlft milanmlft deleted the stefpiatek/preprocess-build branch December 10, 2024 16:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants