This repository has been archived by the owner on Oct 22, 2024. It is now read-only.
End to End Tests #923
Annotations
7 errors, 30 warnings, and 6 notices
sliding-sync/sliding-sync.spec.ts:178:9 › Sliding Sync › should update user settings promptly:
matrix-react-sdk/playwright/e2e/sliding-sync/sliding-sync.spec.ts#L18
1) sliding-sync/sliding-sync.spec.ts:178:9 › Sliding Sync › should update user settings promptly ─
Test timeout of 30000ms exceeded while running "beforeEach" hook.
16 | let roomId: string;
17 |
> 18 | test.beforeEach(async ({ slidingSyncProxy, page, user, app }) => {
| ^
19 | roomId = await app.client.createRoom({ name: "Test Room" });
20 | });
21 |
at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/sliding-sync/sliding-sync.spec.ts:18:10
|
sliding-sync/sliding-sync.spec.ts:178:9 › Sliding Sync › should update user settings promptly:
matrix-react-sdk/playwright/element-web-test.ts#L281
1) sliding-sync/sliding-sync.spec.ts:178:9 › Sliding Sync › should update user settings promptly ─
Error: page.waitForSelector: Test timeout of 30000ms exceeded.
Call log:
- waiting for locator('.mx_MatrixChat') to be visible
at ../element-web-test.ts:281
279 | }, proxyAddress);
280 | await page.goto("/");
> 281 | await page.waitForSelector(".mx_MatrixChat", { timeout: 30000 });
| ^
282 | await use(proxyInstance);
283 | await proxy.stop();
284 | },
at Object.slidingSyncProxy (/home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/element-web-test.ts:281:20)
|
login/login.spec.ts:199:21 › Login › Password login › verification after login › with force_verification on › Shows unskippable verification prompt after login if signing keys are set up:
matrix-react-sdk/playwright/e2e/login/login.spec.ts#L220
1) login/login.spec.ts:199:21 › Login › Password login › verification after login › with force_verification on › Shows unskippable verification prompt after login if signing keys are set up
Error: expect(locator).not.toBeVisible()
Locator: getByRole('heading', { name: 'Verify this device', level: 1 }).locator('.mx_CompleteSecurity_skip')
Expected: not visible
Received: visible
Call log:
- expect.not.toBeVisible with timeout 5000ms
- waiting for getByRole('heading', { name: 'Verify this device', level: 1 }).locator('.mx_CompleteSecurity_skip')
218 | await expect(h1).toBeVisible();
219 |
> 220 | expect(h1.locator(".mx_CompleteSecurity_skip")).not.toBeVisible();
| ^
221 | });
222 | });
223 | });
at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/login/login.spec.ts:220:73
|
read-receipts/new-messages-main-timeline.spec.ts:16:17 › Read receipts › new messages › in the main timeline › Receiving a message makes a room unread:
matrix-react-sdk/playwright/e2e/read-receipts/new-messages-main-timeline.spec.ts#L1
1) read-receipts/new-messages-main-timeline.spec.ts:16:17 › Read receipts › new messages › in the main timeline › Receiving a message makes a room unread
Test timeout of 30000ms exceeded while setting up "homeserver".
|
spaces/threads-activity-centre/threadsActivityCentre.spec.ts:19:9 › Threads Activity Centre › should have the button correctly aligned and displayed in the space panel when expanded:
matrix-react-sdk/playwright/e2e/spaces/threads-activity-centre/threadsActivityCentre.spec.ts#L1
1) spaces/threads-activity-centre/threadsActivityCentre.spec.ts:19:9 › Threads Activity Centre › should have the button correctly aligned and displayed in the space panel when expanded
Test timeout of 30000ms exceeded while setting up "homeserver".
|
spaces/threads-activity-centre/threadsActivityCentre.spec.ts:47:9 › Threads Activity Centre › should show a highlight indicator when there is a mention in a thread:
matrix-react-sdk/playwright/e2e/spaces/threads-activity-centre/index.ts#L297
2) spaces/threads-activity-centre/threadsActivityCentre.spec.ts:47:9 › Threads Activity Centre › should show a highlight indicator when there is a mention in a thread
Error: Timed out 5000ms waiting for expect(locator).toBeVisible()
Locator: getByRole('navigation', { name: 'Spaces' }).getByLabel('Threads').locator('[data-indicator=\'critical\']')
Expected: visible
Received: <element(s) not found>
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for getByRole('navigation', { name: 'Spaces' }).getByLabel('Threads').locator('[data-indicator=\'critical\']')
at spaces/threads-activity-centre/index.ts:297
295 | */
296 | assertHighlightIndicator() {
> 297 | return expect(this.getTacButton().locator("[data-indicator='critical']")).toBeVisible();
| ^
298 | }
299 |
300 | /**
at Helpers.assertHighlightIndicator (/home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/spaces/threads-activity-centre/index.ts:297:83)
at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/spaces/threads-activity-centre/threadsActivityCentre.spec.ts:62:20
|
threads/threads.spec.ts:354:9 › Threads › should send location and reply to the location on ThreadView:
matrix-react-sdk/playwright/e2e/threads/threads.spec.ts#L403
3) threads/threads.spec.ts:354:9 › Threads › should send location and reply to the location on ThreadView
Error: Screenshot comparison failed:
2332 pixels (ratio 0.02 of all image pixels) are different.
Expected: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/snapshots/threads/threads.spec.ts/Reply-to-the-location-on-ThreadView-linux.png
Received: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/threads-threads-Threads-sh-e51e8--the-location-on-ThreadView/Reply-to-the-location-on-ThreadView-actual.png
Diff: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/threads-threads-Threads-sh-e51e8--the-location-on-ThreadView/Reply-to-the-location-on-ThreadView-diff.png
Call log:
- expect.toHaveScreenshot(Reply-to-the-location-on-ThreadView.png) with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('.mx_ThreadView')
- locator resolved to <div class="mx_BaseCard mx_ThreadView mx_ThreadPanel">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 2332 pixels (ratio 0.02 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('.mx_ThreadView')
- locator resolved to <div class="mx_BaseCard mx_ThreadView mx_ThreadPanel">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- 2332 pixels (ratio 0.02 of all image pixels) are different.
401 | // Take a snapshot of reply to the shared location
402 | await page.addStyleTag({ content: css });
> 403 | await expect(page.locator(".mx_ThreadView")).toMatchScreenshot("Reply_to_the_location_on_ThreadView.png");
| ^
404 | });
405 |
406 | test("right panel behaves correctly", async ({ page, app, user }) => {
at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/threads/threads.spec.ts:403:54
|
Slow Test:
matrix-react-sdk/read-receipts/high-level.spec.ts#L1
matrix-react-sdk/read-receipts/high-level.spec.ts took 3.5m
|
Slow Test:
matrix-react-sdk/read-receipts/new-messages-in-threads.spec.ts#L1
matrix-react-sdk/read-receipts/new-messages-in-threads.spec.ts took 1.8m
|
Slow Test:
matrix-react-sdk/read-receipts/editing-messages-in-threads.spec.ts#L1
matrix-react-sdk/read-receipts/editing-messages-in-threads.spec.ts took 1.4m
|
Slow Test:
matrix-react-sdk/read-receipts/editing-messages-main-timeline.spec.ts#L1
matrix-react-sdk/read-receipts/editing-messages-main-timeline.spec.ts took 1.2m
|
Slow Test:
matrix-react-sdk/read-receipts/editing-messages-thread-roots.spec.ts#L1
matrix-react-sdk/read-receipts/editing-messages-thread-roots.spec.ts took 57.1s
|
Slow Test:
matrix-react-sdk/audio-player/audio-player.spec.ts#L1
matrix-react-sdk/audio-player/audio-player.spec.ts took 1.2m
|
Slow Test:
matrix-react-sdk/composer/RTE.spec.ts#L1
matrix-react-sdk/composer/RTE.spec.ts took 1.1m
|
Slow Test:
matrix-react-sdk/crypto/crypto.spec.ts#L1
matrix-react-sdk/crypto/crypto.spec.ts took 1.0m
|
Slow Test:
matrix-react-sdk/crypto/event-shields.spec.ts#L1
matrix-react-sdk/crypto/event-shields.spec.ts took 1.0m
|
Slow Test:
matrix-react-sdk/crypto/decryption-failure-messages.spec.ts#L1
matrix-react-sdk/crypto/decryption-failure-messages.spec.ts took 49.6s
|
Slow Test:
matrix-react-sdk/read-receipts/redactions-thread-roots.spec.ts#L1
matrix-react-sdk/read-receipts/redactions-thread-roots.spec.ts took 1.2m
|
Slow Test:
matrix-react-sdk/spaces/spaces.spec.ts#L1
matrix-react-sdk/spaces/spaces.spec.ts took 1.1m
|
Slow Test:
matrix-react-sdk/right-panel/right-panel.spec.ts#L1
matrix-react-sdk/right-panel/right-panel.spec.ts took 1.0m
|
Slow Test:
matrix-react-sdk/right-panel/file-panel.spec.ts#L1
matrix-react-sdk/right-panel/file-panel.spec.ts took 42.7s
|
Slow Test:
matrix-react-sdk/settings/account-user-settings-tab.spec.ts#L1
matrix-react-sdk/settings/account-user-settings-tab.spec.ts took 42.3s
|
Slow Test:
matrix-react-sdk/messages/messages.spec.ts#L1
matrix-react-sdk/messages/messages.spec.ts took 2.5m
|
Slow Test:
matrix-react-sdk/pinned-messages/pinned-messages.spec.ts#L1
matrix-react-sdk/pinned-messages/pinned-messages.spec.ts took 1.7m
|
Slow Test:
matrix-react-sdk/knock/knock-into-room.spec.ts#L1
matrix-react-sdk/knock/knock-into-room.spec.ts took 40.9s
|
Slow Test:
matrix-react-sdk/integration-manager/read_events.spec.ts#L1
matrix-react-sdk/integration-manager/read_events.spec.ts took 40.0s
|
Slow Test:
matrix-react-sdk/polls/polls.spec.ts#L1
matrix-react-sdk/polls/polls.spec.ts took 37.8s
|
Slow Test:
matrix-react-sdk/read-receipts/redactions-in-threads.spec.ts#L1
matrix-react-sdk/read-receipts/redactions-in-threads.spec.ts took 2.9m
|
Slow Test:
matrix-react-sdk/read-receipts/redactions-main-timeline.spec.ts#L1
matrix-react-sdk/read-receipts/redactions-main-timeline.spec.ts took 2.2m
|
Slow Test:
matrix-react-sdk/read-receipts/read-receipts.spec.ts#L1
matrix-react-sdk/read-receipts/read-receipts.spec.ts took 1.2m
|
Slow Test:
matrix-react-sdk/read-receipts/reactions-in-threads.spec.ts#L1
matrix-react-sdk/read-receipts/reactions-in-threads.spec.ts took 1.1m
|
Slow Test:
matrix-react-sdk/read-receipts/new-messages-thread-roots.spec.ts#L1
matrix-react-sdk/read-receipts/new-messages-thread-roots.spec.ts took 47.3s
|
Slow Test:
matrix-react-sdk/timeline/timeline.spec.ts#L1
matrix-react-sdk/timeline/timeline.spec.ts took 3.2m
|
Slow Test:
matrix-react-sdk/spotlight/spotlight.spec.ts#L1
matrix-react-sdk/spotlight/spotlight.spec.ts took 2.3m
|
Slow Test:
matrix-react-sdk/user-onboarding/user-onboarding-new.spec.ts#L1
matrix-react-sdk/user-onboarding/user-onboarding-new.spec.ts took 35.0s
|
Slow Test:
matrix-react-sdk/widgets/widget-pip-close.spec.ts#L1
matrix-react-sdk/widgets/widget-pip-close.spec.ts took 24.2s
|
Slow Test:
matrix-react-sdk/widgets/layout.spec.ts#L1
matrix-react-sdk/widgets/layout.spec.ts took 22.8s
|
🎭 Playwright Run Summary
32 skipped
42 passed (9.0m)
|
🎭 Playwright Run Summary
1 skipped
77 passed (11.3m)
|
🎭 Playwright Run Summary
1 flaky
sliding-sync/sliding-sync.spec.ts:178:9 › Sliding Sync › should update user settings promptly ──
10 skipped
69 passed (11.0m)
|
🎭 Playwright Run Summary
1 flaky
login/login.spec.ts:199:21 › Login › Password login › verification after login › with force_verification on › Shows unskippable verification prompt after login if signing keys are set up
1 skipped
77 passed (11.4m)
|
🎭 Playwright Run Summary
1 flaky
read-receipts/new-messages-main-timeline.spec.ts:16:17 › Read receipts › new messages › in the main timeline › Receiving a message makes a room unread
14 skipped
61 passed (11.6m)
|
🎭 Playwright Run Summary
3 flaky
spaces/threads-activity-centre/threadsActivityCentre.spec.ts:19:9 › Threads Activity Centre › should have the button correctly aligned and displayed in the space panel when expanded
spaces/threads-activity-centre/threadsActivityCentre.spec.ts:47:9 › Threads Activity Centre › should show a highlight indicator when there is a mention in a thread
threads/threads.spec.ts:354:9 › Threads › should send location and reply to the location on ThreadView
4 skipped
64 passed (11.8m)
|
Artifacts
Produced during runtime
Name | Size | |
---|---|---|
all-blob-reports-1
Expired
|
786 KB |
|
all-blob-reports-2
Expired
|
6.21 MB |
|
all-blob-reports-3
Expired
|
448 KB |
|
all-blob-reports-4
Expired
|
2.3 MB |
|
all-blob-reports-5
Expired
|
3.5 MB |
|
all-blob-reports-6
Expired
|
12.4 MB |
|
html-report
Expired
|
23.3 MB |
|
webapp
Expired
|
37.1 MB |
|