tests: add support for testing updates of Archlinux template

[marmarek]

No description provided.

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 69.71%. Comparing base (6cd9523) to head (a784c37).

Additional details and impacted files

@@            Coverage Diff             @@
##             main     #648      +/-   ##
==========================================
- Coverage   69.78%   69.71%   -0.07%     
==========================================
  Files          58       58              
  Lines       12499    12499              
==========================================
- Hits         8722     8714       -8     
- Misses       3777     3785       +8     

Flag	Coverage Δ
unittests	69.71% <ø> (-0.07%)	⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[qubesos-bot]

OpenQA test summary

Complete test suite and dependencies: https://openqa.qubes-os.org/tests/overview?distri=qubesos&version=4.3&build=2025012310-4.3&flavor=pull-requests

Test run included the following:

• Add filter for qubes stored on inaccessible storage pools qubes-manager#399 (QubesOS/qubes-manager@7dcb8b7)
• tests: add support for testing updates of Archlinux template #648 (a784c37)
• Remove hostname dependency for Archlinux qubes-core-agent-linux#547 (QubesOS/qubes-core-agent-linux@d0cab32)
• Relabel / and /rw if needed qubes-core-agent-linux#541 (QubesOS/qubes-core-agent-linux@31bb12a)
• Stop using qubes-rpc-multiplexer qubes-core-qrexec#141 (QubesOS/qubes-core-qrexec@51460e6)
• archlinux: package tools for fetching dom0 updates qubes-core-agent-linux#549 (QubesOS/qubes-core-agent-linux@e4ecb43)
• Package for Arch qubes-repo-templates#6 (QubesOS/qubes-repo-templates@50757e6)
• archlinux: install pdf-converter by default qubes-meta-packages#76 (QubesOS/qubes-meta-packages@a55be4d)
• Rebuild for Arch qubes-app-linux-pdf-converter#33 (QubesOS/qubes-app-linux-pdf-converter@e49eab2)
• tests: add qrexec performance tests #647 (94a3621)
• SystemD dropins for minimal sys-net and sys-usb qubes-core-agent-linux#540 (QubesOS/qubes-core-agent-linux@f4b3d19)
• Add Arch packaging qubes-core-admin-client#332 (QubesOS/qubes-core-admin-client@392f8a3)
• Replace pulseaudio with pipewire for Archlinux qubes-meta-packages#75 (QubesOS/qubes-meta-packages@c790dd8)

New failures, excluding unstable

Compared to: https://openqa.qubes-os.org/tests/overview?distri=qubesos&version=4.3&build=2024111705-4.3&flavor=update

• system_tests_network_updates

  • TC_11_QvmTemplateMgmtVM_whonix-gateway-17: test_010_template_install (failure)
    qvm-template: error: Template 'debian-12-minimal' not found.

• system_tests_dispvm

  • TC_20_DispVM_fedora-41-xfce: test_100_open_in_dispvm (failure)
    AssertionError: './open-file test.txt' failed with ./open-file test...

• system_tests_kde_gui_interactive

  • gui_keyboard_layout: wait_serial (wait serial expected)
    # wait_serial expected: "echo -e '[Layout]\nLayoutList=us,de' | sud...

• system_tests_guivm_vnc_gui_interactive

  • gui_filecopy: unnamed test (unknown)
  • gui_filecopy: Failed (test died)
    # Test died: no candidate needle with tag(s) 'file-copy-prompt' mat...

• system_tests_basic_vm_qrexec_gui_ext4

  • TC_30_Gui_daemon: test_002_clipboard_300k (failure)
    : Clipboard copy operation failed - content...

• system_tests_guivm_gui_interactive

  • clipboard_and_web: unnamed test (unknown)
  • clipboard_and_web: Failed (test died)
    # Test died: no candidate needle with tag(s) 'clipboard-copy-notifi...

Failed tests

10 failures

• system_tests_network_updates

  • TC_11_QvmTemplateMgmtVM_whonix-gateway-17: test_010_template_install (failure)
    qvm-template: error: Template 'debian-12-minimal' not found.

• system_tests_dispvm

  • TC_20_DispVM_fedora-41-xfce: test_100_open_in_dispvm (failure)
    AssertionError: './open-file test.txt' failed with ./open-file test...

• system_tests_kde_gui_interactive

  • gui_keyboard_layout: wait_serial (wait serial expected)
    # wait_serial expected: "echo -e '[Layout]\nLayoutList=us,de' | sud...

  • gui_keyboard_layout: Failed (test died)
    # Test died: command 'test "$(cd ~user;ls e1*)" = "$(qvm-run -p wor...

• system_tests_basic_vm_qrexec_gui_zfs

  • switch_pool: Failed (test died)
    # Test died: command 'qubes-dom0-update -y zfs' failed at /usr/lib/...

• system_tests_guivm_vnc_gui_interactive

  • gui_filecopy: unnamed test (unknown)
  • gui_filecopy: Failed (test died)
    # Test died: no candidate needle with tag(s) 'file-copy-prompt' mat...

• system_tests_basic_vm_qrexec_gui_ext4

  • TC_30_Gui_daemon: test_002_clipboard_300k (failure)
    : Clipboard copy operation failed - content...

• system_tests_guivm_gui_interactive

  • clipboard_and_web: unnamed test (unknown)
  • clipboard_and_web: Failed (test died)
    # Test died: no candidate needle with tag(s) 'clipboard-copy-notifi...

Fixed failures

Compared to: https://openqa.qubes-os.org/tests/119126#dependencies

2 fixed

• system_tests_extra

  • TC_00_QVCTest_whonix-gateway-17: test_010_screenshare (failure)
    ~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^... AssertionError: 0 == 0

• system_tests_audio@hw1

  • TC_20_AudioVM_PipeWire_whonix-workstation-17: test_260_audio_mic_enabled_switch_audiovm (failure)
    AssertionError: too short audio, expected 10s, got 0.00013605442176...

Unstable tests