Runtime Error in loading state_dict for TorchVisionODAdapter during predit command

[Quetzalcoatl89]

Hello

I'm getting familiar with RasterVision, and while running latest image on docker I tried ObjectDetection example on Potsdam cars data. Everything seems to go fine up to a point of running predict command, when this RunTime Error occurs. Can You point me in the direction, where the problem may lay.
Below I attach the error report.
Many thanks in advance for any guidance. :)

python -m rastervision.pipeline.cli run_command /RV_01/pipeline-config.json predict
Running predict command...
2022-12-19 18:48:15:rastervision.pytorch_learner.learner: INFO - Loading learner from bundle /RV_01/train/model-bundle.zip.
2022-12-19 18:48:16:rastervision.pytorch_learner.learner: INFO - Loading model weights from: /opt/data/tmp/tmp6e0m88yb/model-bundle/model.pth
Traceback (most recent call last):
File "/opt/conda/lib/python3.9/runpy.py", line 197, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/opt/conda/lib/python3.9/runpy.py", line 87, in _run_code
exec(code, run_globals)
File "/opt/src/rastervision_pipeline/rastervision/pipeline/cli.py", line 251, in
_main()
File "/opt/src/rastervision_pipeline/rastervision/pipeline/cli.py", line 247, in _main
main()
File "/opt/conda/lib/python3.9/site-packages/click/core.py", line 1130, in call
return self.main(*args, **kwargs)
File "/opt/conda/lib/python3.9/site-packages/click/core.py", line 1055, in main
rv = self.invoke(ctx)
File "/opt/conda/lib/python3.9/site-packages/click/core.py", line 1657, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/opt/conda/lib/python3.9/site-packages/click/core.py", line 1404, in invoke
return ctx.invoke(self.callback, **ctx.params)
File "/opt/conda/lib/python3.9/site-packages/click/core.py", line 760, in invoke
return __callback(*args, **kwargs)
File "/opt/src/rastervision_pipeline/rastervision/pipeline/cli.py", line 236, in run_command
_run_command(
File "/opt/src/rastervision_pipeline/rastervision/pipeline/cli.py", line 218, in _run_command
command_fn()
File "/opt/src/rastervision_core/rastervision/core/rv_pipeline/rv_pipeline.py", line 181, in predict
self.backend.load_model()
File "/opt/src/rastervision_pytorch_backend/rastervision/pytorch_backend/pytorch_learner_backend.py", line 123, in load_model
self.learner = self._build_learner_from_bundle(training=False)
File "/opt/src/rastervision_pytorch_backend/rastervision/pytorch_backend/pytorch_learner_backend.py", line 131, in _build_learner_from_bundle
return Learner.from_model_bundle(
File "/opt/src/rastervision_pytorch_learner/rastervision/pytorch_learner/learner.py", line 1000, in from_model_bundle
learner: cls = cfg.build(
File "/opt/src/rastervision_pytorch_learner/rastervision/pytorch_learner/object_detection_learner_config.py", line 217, in build
return ObjectDetectionLearner(
File "/opt/src/rastervision_pytorch_learner/rastervision/pytorch_learner/learner.py", line 234, in init
self.setup_model(
File "/opt/src/rastervision_pytorch_learner/rastervision/pytorch_learner/object_detection_learner.py", line 57, in setup_model
self.load_init_weights(model_weights_path)
File "/opt/src/rastervision_pytorch_learner/rastervision/pytorch_learner/learner.py", line 1099, in load_init_weights
self.load_weights(uri=uri, **args)
File "/opt/src/rastervision_pytorch_learner/rastervision/pytorch_learner/learner.py", line 1104, in load_weights
self.model.load_state_dict(
File "/opt/conda/lib/python3.9/site-packages/torch/nn/modules/module.py", line 1604, in load_state_dict
raise RuntimeError('Error(s) in loading state_dict for {}:\n\t{}'.format(
RuntimeError: Error(s) in loading state_dict for TorchVisionODAdapter:
Missing key(s) in state_dict: "model.backbone.body.conv1.weight".
Unexpected key(s) in state_dict: "model.backbone.body.conv1.1.0.weight", "model.backbone.body.conv1.1.1.weight".

[AdeelH]

Thanks for catching this! I have merged a fix for this bug (#1626). Please pull the latest docker image again.

[Quetzalcoatl89]

I will run tests today on new image.
Great thanks to You. Your outstanding work, and awesome framework is much appreciated. :)

[greenhawktobias]

I get the same error in the RV 0.20 Docker image tag. Can it also be fixed? Docker latest tag works fine!

[AdeelH]

I get the same error in the RV 0.20 Docker image tag. Can it also be fixed? Docker latest tag works fine!

Yes, the 0.20 tag will be fixed when we do the 0.20.1 release in a few days.