Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Question about weight decay #22

Open
Joker316701882 opened this issue Jan 19, 2022 · 0 comments
Open

Question about weight decay #22

Joker316701882 opened this issue Jan 19, 2022 · 0 comments

Comments

@Joker316701882
Copy link

Hi, Thank you for your great work! However, there are two points in this code that I don't understand.

  1. I saw 1e-7 is used as the weight decay for Adam. This is the first time of me seeing such a small weight decay for Adam. Any insights in that?
    weight_decay=1e-7,
  2. _I can understand using data augmentation in the training phase. Why is it still used in the testing phase? Especially cropping along the horizontal axis. Will it cause inaccurate testing results?
    crop_h = int((1 - np.mean(self.data_aug_conf['bot_pct_lim']))*newH) - fH
    crop_w = int(max(0, newW - fW) / 2)

Looking forward to your reploy!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant