Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Replace DeepForest config with hydra. #847

Open
bw4sz opened this issue Dec 9, 2024 · 0 comments
Open

Replace DeepForest config with hydra. #847

bw4sz opened this issue Dec 9, 2024 · 0 comments
Labels
dependencies Pull requests that update a dependency file Feature Request New feature or request

Comments

@bw4sz
Copy link
Collaborator

bw4sz commented Dec 9, 2024

I have been working extensively with

https://hydra.cc/

which is an awesome tool for config management. I've really enjoyed it. It allows alot of great functionality for overriding parameters based on hardware, allows for easy parameter sweeps and even has a SLURM launcher

https://www.aidanscannell.com/notes/hpc-cluster/hydra/

For example see

https://github.com/weecology/BOEM/blob/1c6307d91b21195f077719376ae461d0316c7c0e/main.py#L7

https://github.com/weecology/BOEM/blob/main/conf/config.yaml

Roadmap

  1. Add hydra to dependencies
  2. Rename and move deepforest_config.yml to a conf/ folder.
  3. Add SLURM submission tests.
  4. Document on how to override config and use it in argparse like situations.

I think this is a good goal for DeepForest 2.0.

This feels like too delicate for an open-source contrib, @henrykironde you and I should probably work on this together.

Relates to #456.

@bw4sz bw4sz changed the title Replace DeepForest config with hyrda. Replace DeepForest config with hydra. Dec 9, 2024
@bw4sz bw4sz added this to the DeepForest 2.0 milestone Dec 9, 2024
@weecology weecology deleted a comment Dec 9, 2024
bw4sz added a commit that referenced this issue Jan 12, 2025
The config was not reading scientific notation. I think this another example of how moving to hydra (#847) would help us. Closes #881
@bw4sz bw4sz added Feature Request New feature or request dependencies Pull requests that update a dependency file labels Jan 16, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
dependencies Pull requests that update a dependency file Feature Request New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants