This repository has been archived by the owner on Sep 11, 2024. It is now read-only.
Playwright Docker image updates #11871
Annotations
21 errors, 30 warnings, and 6 notices
pinned-messages/pinned-messages.spec.ts:42:9 › Pinned messages › should pin messages and show them in the pinned message panel:
matrix-react-sdk/playwright/e2e/pinned-messages/pinned-messages.spec.ts#L51
1) pinned-messages/pinned-messages.spec.ts:42:9 › Pinned messages › should pin messages and show them in the pinned message panel
Error: Screenshot comparison failed:
360 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/snapshots/pinned-messages/pinned-messages.spec.ts/pinned-messages-list-pin-3-linux.png
Received: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/pinned-messages-pinned-mes-db571-in-the-pinned-message-panel/pinned-messages-list-pin-3-actual.png
Diff: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/pinned-messages-pinned-mes-db571-in-the-pinned-message-panel/pinned-messages-list-pin-3-diff.png
Call log:
- expect.toHaveScreenshot(pinned-messages-list-pin-3.png) with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('#mx_RightPanel')
- locator resolved to <aside id="mx_RightPanel" class="mx_RightPanel">…</aside>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 360 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('#mx_RightPanel')
- locator resolved to <aside id="mx_RightPanel" class="mx_RightPanel">…</aside>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- 360 pixels (ratio 0.01 of all image pixels) are different.
49 | await util.openPinnedMessagesList();
50 | await util.assertPinnedMessagesList(["Msg1", "Msg2", "Msg4"]);
> 51 | await expect(util.getRightPanel()).toMatchScreenshot(`pinned-messages-list-pin-3.png`);
| ^
52 | });
53 |
54 | test("should unpin one message", async ({ page, app, room1, util }) => {
at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/pinned-messages/pinned-messages.spec.ts:51:44
|
pinned-messages/pinned-messages.spec.ts:54:9 › Pinned messages › should unpin one message:
matrix-react-sdk/playwright/e2e/pinned-messages/pinned-messages.spec.ts#L63
2) pinned-messages/pinned-messages.spec.ts:54:9 › Pinned messages › should unpin one message ─────
Error: Screenshot comparison failed:
314 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/snapshots/pinned-messages/pinned-messages.spec.ts/pinned-messages-list-unpin-2-linux.png
Received: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/pinned-messages-pinned-mes-d655e-es-should-unpin-one-message/pinned-messages-list-unpin-2-actual.png
Diff: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/pinned-messages-pinned-mes-d655e-es-should-unpin-one-message/pinned-messages-list-unpin-2-diff.png
Call log:
- expect.toHaveScreenshot(pinned-messages-list-unpin-2.png) with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('#mx_RightPanel')
- locator resolved to <aside id="mx_RightPanel" class="mx_RightPanel">…</aside>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 314 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('#mx_RightPanel')
- locator resolved to <aside id="mx_RightPanel" class="mx_RightPanel">…</aside>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- 314 pixels (ratio 0.01 of all image pixels) are different.
61 | await util.unpinMessageFromMessageList("Msg2");
62 | await util.assertPinnedMessagesList(["Msg1", "Msg4"]);
> 63 | await expect(util.getRightPanel()).toMatchScreenshot(`pinned-messages-list-unpin-2.png`);
| ^
64 | await util.backPinnedMessagesList();
65 | await util.assertPinnedCountInRoomInfo(2);
66 | });
at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/pinned-messages/pinned-messages.spec.ts:63:44
|
read-receipts/room-list-order.spec.ts:23:13 › Read receipts › Room list order › Rooms with unread messages appear at the top of room list if 'unread first' is selected:
matrix-react-sdk/playwright/e2e/read-receipts/room-list-order.spec.ts#L1
1) read-receipts/room-list-order.spec.ts:23:13 › Read receipts › Room list order › Rooms with unread messages appear at the top of room list if 'unread first' is selected
Test timeout of 30000ms exceeded while setting up "homeserver".
|
read-receipts/room-list-order.spec.ts:23:13 › Read receipts › Room list order › Rooms with unread messages appear at the top of room list if 'unread first' is selected:
matrix-react-sdk/playwright/e2e/read-receipts/room-list-order.spec.ts#L1
1) read-receipts/room-list-order.spec.ts:23:13 › Read receipts › Room list order › Rooms with unread messages appear at the top of room list if 'unread first' is selected
Error: Command failed: docker run --name react-sdk-playwright-synapse-f83181fb -d -v /tmp/react-sdk-synapsedocker-oP4uO9:/data -p 35365:8008/tcp -u 1001:127 --add-host host.containers.internal:host-gateway ghcr.io/element-hq/synapse:develop@sha256:66754900135e521174366618aa64ea9a5246564d2561ea9381c0a3f329e10b06 run
Unable to find image 'ghcr.io/element-hq/synapse:develop@sha256:66754900135e521174366618aa64ea9a5246564d2561ea9381c0a3f329e10b06' locally
docker: Error response from daemon: Get "https://ghcr.io/v2/element-hq/synapse/manifests/sha256:66754900135e521174366618aa64ea9a5246564d2561ea9381c0a3f329e10b06": dial tcp 140.82.116.34:443: i/o timeout.
See 'docker run --help'.
|
read-receipts/room-list-order.spec.ts:23:13 › Read receipts › Room list order › Rooms with unread messages appear at the top of room list if 'unread first' is selected:
matrix-react-sdk/playwright/e2e/read-receipts/room-list-order.spec.ts#L1
1) read-receipts/room-list-order.spec.ts:23:13 › Read receipts › Room list order › Rooms with unread messages appear at the top of room list if 'unread first' is selected
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Test timeout of 30000ms exceeded while setting up "homeserver".
|
read-receipts/room-list-order.spec.ts:23:13 › Read receipts › Room list order › Rooms with unread messages appear at the top of room list if 'unread first' is selected:
matrix-react-sdk/playwright/e2e/read-receipts/room-list-order.spec.ts#L1
1) read-receipts/room-list-order.spec.ts:23:13 › Read receipts › Room list order › Rooms with unread messages appear at the top of room list if 'unread first' is selected
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Command failed: docker run --name react-sdk-playwright-synapse-0d96548e -d -v /tmp/react-sdk-synapsedocker-6tiQPF:/data -p 45295:8008/tcp -u 1001:127 --add-host host.containers.internal:host-gateway ghcr.io/element-hq/synapse:develop@sha256:66754900135e521174366618aa64ea9a5246564d2561ea9381c0a3f329e10b06 run
Unable to find image 'ghcr.io/element-hq/synapse:develop@sha256:66754900135e521174366618aa64ea9a5246564d2561ea9381c0a3f329e10b06' locally
docker: Error response from daemon: Get "https://ghcr.io/v2/element-hq/synapse/manifests/sha256:66754900135e521174366618aa64ea9a5246564d2561ea9381c0a3f329e10b06": dial tcp 140.82.116.34:443: i/o timeout.
See 'docker run --help'.
|
read-receipts/room-list-order.spec.ts:23:13 › Read receipts › Room list order › Rooms with unread messages appear at the top of room list if 'unread first' is selected:
matrix-react-sdk/playwright/e2e/read-receipts/room-list-order.spec.ts#L1
1) read-receipts/room-list-order.spec.ts:23:13 › Read receipts › Room list order › Rooms with unread messages appear at the top of room list if 'unread first' is selected
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Test timeout of 30000ms exceeded while setting up "homeserver".
|
read-receipts/room-list-order.spec.ts:23:13 › Read receipts › Room list order › Rooms with unread messages appear at the top of room list if 'unread first' is selected:
matrix-react-sdk/playwright/e2e/read-receipts/room-list-order.spec.ts#L1
1) read-receipts/room-list-order.spec.ts:23:13 › Read receipts › Room list order › Rooms with unread messages appear at the top of room list if 'unread first' is selected
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: Command failed: docker run --name react-sdk-playwright-synapse-aa6ca08c -d -v /tmp/react-sdk-synapsedocker-g32iSu:/data -p 46329:8008/tcp -u 1001:127 --add-host host.containers.internal:host-gateway ghcr.io/element-hq/synapse:develop@sha256:66754900135e521174366618aa64ea9a5246564d2561ea9381c0a3f329e10b06 run
Unable to find image 'ghcr.io/element-hq/synapse:develop@sha256:66754900135e521174366618aa64ea9a5246564d2561ea9381c0a3f329e10b06' locally
ghcr.io/element-hq/synapse@sha256:66754900135e521174366618aa64ea9a5246564d2561ea9381c0a3f329e10b06: Pulling from element-hq/synapse
docker: Get "https://ghcr.io/v2/element-hq/synapse/manifests/sha256:6f396bdba0cc533576f096c10e0db7de6133afa37af90399a683ef9a551551df": dial tcp 140.82.116.33:443: i/o timeout.
See 'docker run --help'.
|
read-receipts/room-list-order.spec.ts:41:13 › Read receipts › Room list order › Rooms with unread threads appear at the top of room list if 'unread first' is selected:
matrix-react-sdk/playwright/e2e/read-receipts/room-list-order.spec.ts#L1
2) read-receipts/room-list-order.spec.ts:41:13 › Read receipts › Room list order › Rooms with unread threads appear at the top of room list if 'unread first' is selected
Test timeout of 30000ms exceeded while setting up "homeserver".
|
read-receipts/room-list-order.spec.ts:41:13 › Read receipts › Room list order › Rooms with unread threads appear at the top of room list if 'unread first' is selected:
matrix-react-sdk/playwright/e2e/read-receipts/room-list-order.spec.ts#L1
2) read-receipts/room-list-order.spec.ts:41:13 › Read receipts › Room list order › Rooms with unread threads appear at the top of room list if 'unread first' is selected
Error: Command failed: docker run --name react-sdk-playwright-synapse-4c3392cf -d -v /tmp/react-sdk-synapsedocker-ZT0CVS:/data -p 42431:8008/tcp -u 1001:127 --add-host host.containers.internal:host-gateway ghcr.io/element-hq/synapse:develop@sha256:66754900135e521174366618aa64ea9a5246564d2561ea9381c0a3f329e10b06 run
Unable to find image 'ghcr.io/element-hq/synapse:develop@sha256:66754900135e521174366618aa64ea9a5246564d2561ea9381c0a3f329e10b06' locally
ghcr.io/element-hq/synapse@sha256:66754900135e521174366618aa64ea9a5246564d2561ea9381c0a3f329e10b06: Pulling from element-hq/synapse
docker: Get "https://ghcr.io/v2/element-hq/synapse/manifests/sha256:6f396bdba0cc533576f096c10e0db7de6133afa37af90399a683ef9a551551df": dial tcp 140.82.116.33:443: i/o timeout.
See 'docker run --help'.
|
read-receipts/room-list-order.spec.ts:41:13 › Read receipts › Room list order › Rooms with unread threads appear at the top of room list if 'unread first' is selected:
matrix-react-sdk/playwright/e2e/read-receipts/room-list-order.spec.ts#L1
2) read-receipts/room-list-order.spec.ts:41:13 › Read receipts › Room list order › Rooms with unread threads appear at the top of room list if 'unread first' is selected
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Test timeout of 30000ms exceeded while setting up "homeserver".
|
read-receipts/room-list-order.spec.ts:41:13 › Read receipts › Room list order › Rooms with unread threads appear at the top of room list if 'unread first' is selected:
matrix-react-sdk/playwright/e2e/read-receipts/room-list-order.spec.ts#L1
2) read-receipts/room-list-order.spec.ts:41:13 › Read receipts › Room list order › Rooms with unread threads appear at the top of room list if 'unread first' is selected
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Command failed: docker run --name react-sdk-playwright-synapse-09089ab9 -d -v /tmp/react-sdk-synapsedocker-JzzRLm:/data -p 42883:8008/tcp -u 1001:127 --add-host host.containers.internal:host-gateway ghcr.io/element-hq/synapse:develop@sha256:66754900135e521174366618aa64ea9a5246564d2561ea9381c0a3f329e10b06 run
Unable to find image 'ghcr.io/element-hq/synapse:develop@sha256:66754900135e521174366618aa64ea9a5246564d2561ea9381c0a3f329e10b06' locally
docker: Error response from daemon: Get "https://ghcr.io/v2/element-hq/synapse/manifests/sha256:66754900135e521174366618aa64ea9a5246564d2561ea9381c0a3f329e10b06": dial tcp 140.82.116.34:443: i/o timeout.
See 'docker run --help'.
|
end-to-end-tests:
right-panel/file-panel.spec.ts/empty-linux.png#L1
Stale screenshot file
|
|
end-to-end-tests:
register/register.spec.ts/use-case-selection-linux.png#L1
Stale screenshot file
|
end-to-end-tests:
register/register.spec.ts/terms-prompt-linux.png#L1
Stale screenshot file
|
end-to-end-tests:
register/register.spec.ts/server-picker-linux.png#L1
Stale screenshot file
|
end-to-end-tests:
register/register.spec.ts/registration-linux.png#L1
Stale screenshot file
|
end-to-end-tests:
register/register.spec.ts/email-prompt-linux.png#L1
Stale screenshot file
|
end-to-end-tests:
register/email.spec.ts/registration-check-your-email-linux.png#L1
Stale screenshot file
|
end-to-end-tests
Process completed with exit code 1.
|
Slow Test:
matrix-react-sdk/timeline/timeline.spec.ts#L1
matrix-react-sdk/timeline/timeline.spec.ts took 2.7m
|
Slow Test:
matrix-react-sdk/spotlight/spotlight.spec.ts#L1
matrix-react-sdk/spotlight/spotlight.spec.ts took 2.0m
|
Slow Test:
matrix-react-sdk/spaces/threads-activity-centre/threadsActivityCentre.spec.ts#L1
matrix-react-sdk/spaces/threads-activity-centre/threadsActivityCentre.spec.ts took 1.6m
|
Slow Test:
matrix-react-sdk/threads/threads.spec.ts#L1
matrix-react-sdk/threads/threads.spec.ts took 35.2s
|
Slow Test:
matrix-react-sdk/user-onboarding/user-onboarding-new.spec.ts#L1
matrix-react-sdk/user-onboarding/user-onboarding-new.spec.ts took 31.3s
|
Slow Test:
matrix-react-sdk/read-receipts/high-level.spec.ts#L1
matrix-react-sdk/read-receipts/high-level.spec.ts took 3.2m
|
Slow Test:
matrix-react-sdk/read-receipts/new-messages-in-threads.spec.ts#L1
matrix-react-sdk/read-receipts/new-messages-in-threads.spec.ts took 1.6m
|
Slow Test:
matrix-react-sdk/read-receipts/editing-messages-in-threads.spec.ts#L1
matrix-react-sdk/read-receipts/editing-messages-in-threads.spec.ts took 1.3m
|
Slow Test:
matrix-react-sdk/read-receipts/editing-messages-main-timeline.spec.ts#L1
matrix-react-sdk/read-receipts/editing-messages-main-timeline.spec.ts took 1.2m
|
Slow Test:
matrix-react-sdk/read-receipts/new-messages-main-timeline.spec.ts#L1
matrix-react-sdk/read-receipts/new-messages-main-timeline.spec.ts took 1.1m
|
Slow Test:
matrix-react-sdk/messages/messages.spec.ts#L1
matrix-react-sdk/messages/messages.spec.ts took 2.2m
|
Slow Test:
matrix-react-sdk/integration-manager/read_events.spec.ts#L1
matrix-react-sdk/integration-manager/read_events.spec.ts took 42.6s
|
Slow Test:
matrix-react-sdk/login/login.spec.ts#L1
matrix-react-sdk/login/login.spec.ts took 37.4s
|
Slow Test:
matrix-react-sdk/knock/knock-into-room.spec.ts#L1
matrix-react-sdk/knock/knock-into-room.spec.ts took 35.6s
|
Slow Test:
matrix-react-sdk/polls/polls.spec.ts#L1
matrix-react-sdk/polls/polls.spec.ts took 35.3s
|
Slow Test:
matrix-react-sdk/read-receipts/redactions-in-threads.spec.ts#L1
matrix-react-sdk/read-receipts/redactions-in-threads.spec.ts took 2.8m
|
Slow Test:
matrix-react-sdk/read-receipts/redactions-main-timeline.spec.ts#L1
matrix-react-sdk/read-receipts/redactions-main-timeline.spec.ts took 2.1m
|
Slow Test:
matrix-react-sdk/read-receipts/read-receipts.spec.ts#L1
matrix-react-sdk/read-receipts/read-receipts.spec.ts took 1.2m
|
Slow Test:
matrix-react-sdk/read-receipts/reactions-in-threads.spec.ts#L1
matrix-react-sdk/read-receipts/reactions-in-threads.spec.ts took 1.1m
|
Slow Test:
matrix-react-sdk/read-receipts/new-messages-thread-roots.spec.ts#L1
matrix-react-sdk/read-receipts/new-messages-thread-roots.spec.ts took 1.0m
|
Slow Test:
matrix-react-sdk/audio-player/audio-player.spec.ts#L1
matrix-react-sdk/audio-player/audio-player.spec.ts took 1.3m
|
Slow Test:
matrix-react-sdk/composer/RTE.spec.ts#L1
matrix-react-sdk/composer/RTE.spec.ts took 1.2m
|
Slow Test:
matrix-react-sdk/crypto/crypto.spec.ts#L1
matrix-react-sdk/crypto/crypto.spec.ts took 1.1m
|
Slow Test:
matrix-react-sdk/crypto/decryption-failure-messages.spec.ts#L1
matrix-react-sdk/crypto/decryption-failure-messages.spec.ts took 54.7s
|
Slow Test:
matrix-react-sdk/crypto/device-verification.spec.ts#L1
matrix-react-sdk/crypto/device-verification.spec.ts took 51.0s
|
Slow Test:
matrix-react-sdk/spaces/spaces.spec.ts#L1
matrix-react-sdk/spaces/spaces.spec.ts took 1.1m
|
Slow Test:
matrix-react-sdk/right-panel/right-panel.spec.ts#L1
matrix-react-sdk/right-panel/right-panel.spec.ts took 51.7s
|
Slow Test:
matrix-react-sdk/settings/account-user-settings-tab.spec.ts#L1
matrix-react-sdk/settings/account-user-settings-tab.spec.ts took 38.3s
|
Slow Test:
matrix-react-sdk/settings/appearance-user-settings-tab/theme-choice-panel.spec.ts#L1
matrix-react-sdk/settings/appearance-user-settings-tab/theme-choice-panel.spec.ts took 29.9s
|
Slow Test:
matrix-react-sdk/room/room-header.spec.ts#L1
matrix-react-sdk/room/room-header.spec.ts took 28.2s
|
🎭 Playwright Run Summary
4 skipped
67 passed (9.3m)
|
🎭 Playwright Run Summary
31 skipped
50 passed (9.5m)
|
🎭 Playwright Run Summary
2 flaky
pinned-messages/pinned-messages.spec.ts:42:9 › Pinned messages › should pin messages and show them in the pinned message panel
pinned-messages/pinned-messages.spec.ts:54:9 › Pinned messages › should unpin one message ──────
2 skipped
72 passed (10.3m)
|
🎭 Playwright Run Summary
15 skipped
60 passed (10.5m)
|
🎭 Playwright Run Summary
1 skipped
75 passed (11.8m)
|
🎭 Playwright Run Summary
10 failed
read-receipts/room-list-order.spec.ts:23:13 › Read receipts › Room list order › Rooms with unread messages appear at the top of room list if 'unread first' is selected
read-receipts/room-list-order.spec.ts:41:13 › Read receipts › Room list order › Rooms with unread threads appear at the top of room list if 'unread first' is selected
register/email.spec.ts:49:9 › Email Registration › registers an account and lands on the use case selection screen
register/register.spec.ts:26:9 › Registration › registers an account and lands on the home screen
register/register.spec.ts:87:9 › Registration › should require username to fulfil requirements and be available
regression-tests/pills-click-in-app.spec.ts:24:9 › Pills › should navigate clicks internally to the app
release-announcement/releaseAnnouncement.spec.ts:31:9 › Release announcement › should display the release announcement process
right-panel/file-panel.spec.ts:51:13 › FilePanel › render › should render empty state ──────────
sliding-sync/sliding-sync.spec.ts:186:9 › Sliding Sync › should update user settings promptly ──
sliding-sync/sliding-sync.spec.ts:259:9 › Sliding Sync › should show a favourite DM only in the favourite sublist
1 flaky
right-panel/file-panel.spec.ts:59:13 › FilePanel › render › should list tiles on the panel ─────
9 skipped
53 passed (24.6m)
|
Artifacts
Produced during runtime
Name | Size | |
---|---|---|
all-blob-reports-1
Expired
|
741 KB |
|
all-blob-reports-2
Expired
|
7.13 MB |
|
all-blob-reports-3
Expired
|
506 KB |
|
all-blob-reports-4
Expired
|
498 KB |
|
all-blob-reports-5
Expired
|
16.1 MB |
|
all-blob-reports-6
Expired
|
852 KB |
|
html-report
Expired
|
23.8 MB |
|
webapp
Expired
|
37.8 MB |
|