Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ODF install on larger cluster ( 8 workers ) timed out - 5 mins not enough time #251

Open
stevenschader opened this issue Apr 6, 2022 · 0 comments

Comments

@stevenschader
Copy link
Member

Describe the bug
Running the ODF install, the config timed out after 5 mins checking for:

nest@ubuntu18:~$ oc get pv -n openshift-local-storage --no-headers=true | grep local-pv | grep -E "Available|Bound" | wc -l
16

This was on a larger cluster with 8 worker nodes.
a valid result eventually showed up after the job exited with failure.

FAILED - RETRYING: Waiting for pods to start (5 min max) (1 retries left).
fatal: [localhost]: FAILED! => {"attempts": 60, "changed": true, "cmd": "oc get pv -n openshift-local-storage --no-headers=true | grep local-pv | grep -E \"Available|Bound\" | wc -l", "delta": "0:00:00.442095", "end": "2022-04-06 13:49:20.870550", "msg": "", "rc": 0, "start": "2022-04-06 13:49:20.428455", "stderr": "", "stderr_lines": [], "stdout": "16", "stdout_lines": ["16"]}

NO MORE HOSTS LEFT ************************************************************************************************************************************

PLAY RECAP ********************************************************************************************************************************************
localhost                  : ok=30   changed=19   unreachable=0    failed=1    skipped=7    rescued=0    ignored=0   

Wednesday 06 April 2022  13:49:20 +0000 (0:05:53.857)       0:09:02.672 ******* 
=============================================================================== 
ibm_community_automation.ibm_community_automation.request_ocs_local_storage : Waiting for pods to start (5 min max) -------------------------- 353.86s
ibm_community_automation.ibm_community_automation.request_ocs_local_storage : checking for container storage to be ready (10 min max) --------- 66.44s
ibm_community_automation.ibm_community_automation.request_ocs_local_storage : checking for container storage to be ready (10 min max) --------- 44.19s
ibm_community_automation.ibm_community_automation.request_ocs_local_storage : Waiting for discovery pods to start on all worker nodes (5 min max) -- 24.83s
ibm_community_automation.ibm_community_automation.request_ocs_local_storage : update worker labels --------------------------------------------- 7.52s
ibm_community_automation.ibm_community_automation.request_ocs_local_storage : Install jq ------------------------------------------------------- 7.51s
ibm_community_automation.ibm_community_automation.request_ocs_local_storage : Generate OCS install files from templates and copy to dest ------- 5.11s
ibm_community_automation.ibm_community_automation.request_ocs_local_storage : OCS auto discovery of local volumes ------------------------------ 4.62s
ibm_community_automation.ibm_community_automation.request_ocs_local_storage : Apply  local storage operator yaml ------------------------------- 3.68s
ibm_community_automation.ibm_community_automation.request_ocs_local_storage : Apply OCS operator yaml ------------------------------------------ 3.41s
ibm_community_automation.ibm_community_automation.ocp_login : OCP login ------------------------------------------------------------------------ 2.43s
ibm_community_automation.ibm_community_automation.request_ocs_local_storage : Removing all setup files previously from previous run ------------ 2.36s
ibm_community_automation.ibm_community_automation.request_ocs_local_storage : Get number of workers -------------------------------------------- 1.85s
ibm_community_automation.ibm_community_automation.request_ocs_local_storage : Get ocs version major.minor -------------------------------------- 1.79s
Gathering Facts -------------------------------------------------------------------------------------------------------------------------------- 1.45s
ibm_community_automation.ibm_community_automation.request_ocs_local_storage : apply local volumeset yaml --------------------------------------- 1.39s
ibm_community_automation.ibm_community_automation.request_ocs_local_storage : create openshift-storage namespace ------------------------------- 1.31s
ibm_community_automation.ibm_community_automation.request_ocs_local_storage : create and set openshift-local-storage --------------------------- 1.21s
ibm_community_automation.ibm_community_automation.oc_client_install : check for oc client ------------------------------------------------------ 1.16s
ibm_community_automation.ibm_community_automation.request_ocs_local_storage : get number of workers -------------------------------------------- 1.05s
[nest@nest-oscert-container odf]$ 
nest@ubuntu18:~$ oc get nodes|grep worker|wc -l
8
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant