Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bump IREE requirement pins to their latest versions. #867

Open
wants to merge 3 commits into
base: main
Choose a base branch
from

Conversation

shark-pr-automator[bot]
Copy link
Contributor

github-actions bot and others added 2 commits January 24, 2025 11:04
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
@ScottTodd
Copy link
Member

Data-dependent tests seem to be stalled (again): https://github.com/nod-ai/shark-ai/actions/runs/12953227720/job/36132422966?pr=867
Cancelling for now and will get the timeouts in: #868

@ScottTodd
Copy link
Member

That workflow stalled again on a retry: https://github.com/nod-ai/shark-ai/actions/runs/12953227720/job/36139239387?pr=867

@ScottTodd
Copy link
Member

Still stalling (taking longer than 30 minutes): https://github.com/nod-ai/shark-ai/actions/runs/12953227720/job/36149738058?pr=867. Need one of the maintainers of those tests to take over from here. I can't tell from the minimal logs what test is even running, let alone if there is a potential real regression (e.g. to compile time) in there.

@ScottTodd
Copy link
Member

Got a successful run of all CI jobs. Some tests are very slow, but I think that is true before this change as well?

https://github.com/nod-ai/shark-ai/actions/runs/12976351582/job/36188507710?pr=867#step:6:49

============================== slowest durations ===============================
352.65s setup    integration/models/punet/integration_test.py::test_sdxl_export_int8_mlir
142.33s setup    integration/models/punet/integration_test.py::test_sdxl_export_fp16_mlir

(4 durations < 0.005s hidden.  Use -vv to show these durations.)
========== 2 passed, 303 deselected, 5 warnings in [50](https://github.com/nod-ai/shark-ai/actions/runs/12976351582/job/36188507710?pr=867#step:6:51)4.70s (0:08:24) ===========

https://github.com/nod-ai/shark-ai/actions/runs/12976351582/job/36188508213?pr=867#step:6:585

============================== slowest durations ===============================
246.22s call     tests/models/flux/flux_test.py::FluxTest::testCompareDevIreeF32AgainstHuggingFaceF32
207.24s call     tests/models/flux/flux_test.py::FluxTest::testCompareDevIreeBf16AgainstHuggingFaceF32
202.73s call     tests/models/flux/flux_test.py::FluxTest::testCompareDevTorchEagerBf16AgainstHuggingFaceF32
189.03s call     tests/models/flux/flux_test.py::FluxTest::testCompareDevTorchEagerF32AgainstHuggingFaceF32
89.87s call     tests/models/t5/t5_test.py::T5EncoderIreeTest::testV1_1CompareXxlIreeF32AgainstTorchEagerF32
69.20s call     tests/models/t5/t5_test.py::T5EncoderIreeTest::testV1_1CompareXxlIreeBf16AgainstTorchEagerF32
62.86s call     tests/models/flux/flux_test.py::FluxTest::testExportSchnellTransformerFromHuggingFace
51.78s call     tests/models/flux/flux_test.py::FluxTest::testExportDevTransformerFromHuggingFace
48.85s call     tests/models/t5/t5_test.py::T5EncoderEagerTest::testV1_1XxlBf16CompareTorchEagerAgainstHuggingFaceF32
47.78s call     tests/models/t5/t5_test.py::T5EncoderEagerTest::testV1_1XxlF32CompareTorchEagerAgainstHuggingFace
...
====== 47 passed, 1 skipped, 5 xfailed, 26 warnings in 1551.35s (0:25:51) ======

Baseline logs sample here: https://github.com/nod-ai/shark-ai/actions/runs/12976350067

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant