Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: declare arguments before reference in condor submission #108

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

toicca
Copy link
Contributor

@toicca toicca commented Jan 9, 2025

Condor execute script currently uses ARGS[remoteRepo] before declaration and has a bash syntax error. Fixed just by moving code around.

Copy link
Collaborator

@Ming-Yan Ming-Yan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hi @toicca thank you very much for the PR, indeed due to the changes in micromamba does not work again. this cause the problem happens.
As Clemens pointed out, we can get rid of mamba installation as they are installed in lxplus

Comment on lines +25 to +33
if [[ ${ARGS[remoteRepo]} != "" ]]; then
echo "remoteRepo is set to ${ARGS[remoteRepo]}"
wget -L micro.mamba.pm/install.sh
chmod +x install.sh
## FIXME parsing arguments does not work. will use defaults in install.sh instead, see https://github.com/mamba-org/micromamba-releases/blob/main/install.sh
## Tried solutions listed in https://stackoverflow.com/questions/14392525/passing-arguments-to-an-interactive-program-non-interactively
./install.sh <<< $'bin\nY\nY\nmicromamba\n'
source .bashrc
fi
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

As Clemens pointed out in the chat, should we remove these line?

Indeed the remoterepo here is to install the BTV commissioning repo from the git path not to take local environment wrapped as zip file.

for key in workflow output samplejson year campaign isSyst isArray noHist overwrite voms chunk skipbadfiles outputDir remoteRepo; do
ARGS[$key]=$(jq -r ".$key" $WORKDIR/arguments.json)
done

# Create base env with python=3.10 and setuptools<=70.1.1
micromamba activate
micromamba install python=3.10 -c conda-forge xrootd --yes
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we now have shared conda environment, maybe we can source the environment from eos
(namely /eos/home-m/milee/miniforge3/envs/btv_coffea)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants