3 tests started to fail due to expired shub https certificate!

[yarikoptic]

From june 26 to 27 we started to have 3 tests to fail with a sample fail looking like

______________________________________________________________________________________________________ test_container_files ______________________________________________________________________________________________________
datalad_container/tests/test_run.py:94: in test_container_files
    ds.containers_add(
/usr/lib/python3/dist-packages/datalad/distribution/dataset.py:507: in apply_func
    return f(*args, **kwargs)
/usr/lib/python3/dist-packages/datalad/interface/base.py:773: in eval_func
    return return_func(*args, **kwargs)
/usr/lib/python3/dist-packages/datalad/interface/base.py:763: in return_func
    results = list(results)
/usr/lib/python3/dist-packages/datalad/interface/base.py:940: in _execute_command_
    raise IncompleteResultsError(
E   datalad.support.exceptions.IncompleteResultsError: Command did not complete successfully. 2 failed:
E   [{'action': 'containers_add',
E     'message': ('no image at %s',
E                 '/home/yoh/.tmp/datalad_temp_test_container_files8gz9m6xr/righthere'),
E     'path': '/home/yoh/.tmp/datalad_temp_test_container_files8gz9m6xr/righthere',
E     'status': 'error',
E     'type': 'file'},
E    {'action': 'containers_add',
E     'message': ('no image at %s',
E                 '/home/yoh/.tmp/datalad_temp_test_container_files8gz9m6xr/righthere'),
E     'path': '/home/yoh/.tmp/datalad_temp_test_container_files8gz9m6xr/righthere',
E     'status': 'error',
E     'type': 'file'}]
------------------------------------------------------------------------------------------------------- Captured log call --------------------------------------------------------------------------------------------------------
INFO     datalad:log.py:432 Clear progress bars
INFO     datalad:log.py:432 Refresh progress bars
INFO     datalad.customremotes:base.py:110 Initializing special remote datalad
======================================================================================================== warnings summary ========================================================================================================
../../../../../usr/lib/python3/dist-packages/datalad/tests/utils_pytest.py:76
  /usr/lib/python3/dist-packages/datalad/tests/utils_pytest.py:76: PytestUnknownMarkWarning: Unknown pytest.mark.network - is this a typo?  You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html
    return getattr(pytest.mark, name)

../../../../../usr/lib/python3/dist-packages/datalad/tests/utils_pytest.py:76
  /usr/lib/python3/dist-packages/datalad/tests/utils_pytest.py:76: PytestUnknownMarkWarning: Unknown pytest.mark.skip_if_no_network - is this a typo?  You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html
    return getattr(pytest.mark, name)

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
==================================================================================================== short test summary info =====================================================================================================
FAILED datalad_container/tests/test_run.py::test_container_files - datalad.support.exceptions.IncompleteResultsError: Command did not complete successfully. 2 failed:

so nothing really hinting on what is going on! Looking at what image we are trying to get, and calling singularity directly:

❯ singularity pull shub://datalad/datalad-container:testhelper
FATAL:   While pulling shub image: error fetching image to cache: failed to get manifest for: shub://datalad/datalad-container:testhelper: no response received from singularity hub

gives us a little clarity, but above we should have reported that -- that singularity failed to pull or smth like that instead of that image is not there! Then running with --debug got actual URL

❯ singularity --debug pull shub://datalad/datalad-container:testhelper
DEBUG   [U=47521,P=72252]  persistentPreRun()            Singularity version: 4.1.2
DEBUG   [U=47521,P=72252]  persistentPreRun()            Parsing configuration file /etc/singularity/singularity.conf
DEBUG   [U=47521,P=72252]  maybeReExec()                 Checking whether to re-exec
DEBUG   [U=47521,P=72252]  handleConfDir()               /home/yoh/.singularity already exists. Not creating.
DEBUG   [U=47521,P=72252]  getCacheParentDir()           environment variable SINGULARITY_CACHEDIR not set, using default image cache
DEBUG   [U=47521,P=72252]  GetManifest()                 shub request: https://singularity-hub.org/api/container/datalad/datalad-container:testhelper
FATAL   [U=47521,P=72252]  pullRun()                     While pulling shub image: error fetching image to cache: failed to get manifest for: shub://datalad/datalad-container:testhelper: no response received from singularity hub
❯ echo $?
255

to then realize that

So, ideally it is fixed by (in this order)

• seeing if we can give a better error/failure message. Needed PRs
  • ENH: Add information about __cause__ exception in the "exception" printout within result record and its short string version datalad#7647
  • Allow to communicate ErrorMsg for CHECKURL-FAILURE via RemoteError exception Lykos153/AnnexRemote#106
  • ENH: Add information about __cause__ exception in the "exception" printout within result record and its short string version datalad#7647
• renew https certification for the service on falkor (I thought it should have been auto renewed, oh well)

[yarikoptic]

we are green again:

❯ python -m pytest  --tb=short datalad_container/tests/test_run.py
=============================================================================== test session starts ================================================================================
platform linux -- Python 3.12.4, pytest-8.3.2, pluggy-1.5.0
rootdir: /home/yoh/proj/datalad/datalad-container
configfile: pyproject.toml
plugins: cov-5.0.0
collected 9 items                                                                                                                                                                  

datalad_container/tests/test_run.py .........