Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

training results #10

Open
oneChubby opened this issue Sep 13, 2024 · 3 comments
Open

training results #10

oneChubby opened this issue Sep 13, 2024 · 3 comments

Comments

@oneChubby
Copy link

oneChubby commented Sep 13, 2024

1
Why are my training results so far from the experimental results (Kitchen Dataset)

@PanagiotisP
Copy link
Collaborator

Hi!
Hm, that's surprising. I can't give a clear answer without more information, but since it seems like the technique hasn't run at all, I'd bet is some kind of command-line argument parsing.
Did you run it with the configuration that uses the new options, as described at the full_eval script, as shown here?

@oneChubby
Copy link
Author

Thank you very much for your answer, after modifying the parameters, the effect in the paper has been achieved, but I would like to ask which of the three is this printed PSNR
image

@PanagiotisP
Copy link
Collaborator

Generally, you want to keep an eye on test PSNR, so the top one.
However, the numbers on the paper might differ (generally, be lower) ,as

  1. the k-means quantisation happens after the last iteration, so its effects are not printed on the screen and
  2. the results are generated by the full_eval.py script, which trains a model, renders images, saves them as png and then calculates the metrics based on these images. Any steps (training, rendering, metrics calculation) can be skipped with the respective flag. This is the standard way to evaluate and typically you expect some numbers to be lower

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants