Permission Denied while training and eval

[JoseMoFi]

I encountered an issue while training and evaluating models using the specified setup. When the training process completed, a "Permission Denied" error occurred with the temporary file used to save intermediate results.

My system setup includes Windows 11 x64, an Intel i5-13500H processor, and an NVIDIA RTX 3050 laptop GPU.

The only solution I found was to modify the utils/training/common.py file. In the main function, I replaced the following line:
with tempfile.NamedTemporaryFile() as temp_output_file:

with:
with tempfile.NamedTemporaryFile(delete=False) as temp_output_file:

I believe this issue arises due to how Windows 11 manages permissions for temporary files, or potentially due to how these files are opened and closed in this specific context. However, this is just a hypothesis—if anyone has more insight, I would greatly appreciate your input.

I hope this comment helps others facing a similar issue.

[AngledLuffa]

I found similar issues here

bravoserver/bravo#111

pypa/pip-audit#646

I think this is because some steps such as the evaluation are shell calls. We could probably clean that up... but in the meantime, you can also save the output with the --save_output option and that avoids trying to make a temporary file.

Which model was the first one you noticed with this issue? All of them?