Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

rocmPackages.llvm: add setuptools #325909

Merged
merged 2 commits into from
Jul 10, 2024
Merged

Conversation

khaneliman
Copy link
Contributor

@khaneliman khaneliman commented Jul 9, 2024

distutils removed in python 3.12, need to add setuptools.

EDIT: marked as draft because it still failed adding next to lit. even though https://docs.python.org/3.11/library/distutils.html#module-distutils says setuptools should resolve it. Not sure if it needs to be added somewhere else.

Added setuptools to python scope for rocmPackages.llvm.
Added a few more tests to the list of excluded tests blocking libcxx.

Description of changes

Resolves #325907 #324235

Things done

  • Built on platform(s)
    • x86_64-linux
    • aarch64-linux
    • x86_64-darwin
    • aarch64-darwin
  • For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)
    • sandbox = relaxed
    • sandbox = true
  • Tested, as applicable:
  • Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
  • Tested basic functionality of all binary files (usually in ./result/bin/)
  • 24.11 Release Notes (or backporting 23.11 and 24.05 Release notes)
    • (Package updates) Added a release notes entry if the change is major or breaking
    • (Module updates) Added a release notes entry if the change is significant
    • (Module addition) Added a release notes entry if adding a new NixOS module
  • Fits CONTRIBUTING.md.

Add a 👍 reaction to pull requests you find important.

@khaneliman khaneliman marked this pull request as draft July 9, 2024 18:43
@superherointj superherointj self-requested a review July 9, 2024 18:58
@superherointj
Copy link
Contributor

#324235

@khaneliman
Copy link
Contributor Author

khaneliman commented Jul 9, 2024

#324235

Ah alright, didn't notice that PR when I was searching for this failure for some reason... I was gonna try pinning to 311 but saw the first module error was able to be worked around with setuptools (according to docs). Looks like doronbehar ran into the same thing in that PR...

distutils removed in python 3.12, need to add setuptools.
@khaneliman
Copy link
Contributor Author

khaneliman commented Jul 10, 2024

@superherointj This way seems to build it for me. But, it looks like it'll be a bigger rebuild... I'll try running a nixpkgs-review on it to see how it goes. Unless someone has a more clever way of attaching the .withPackages (p: [ p.setuptools ])) only to the compiler-rt derivation that gets passed to base.

73 packages updated:
blender clang-ocl clr composable_kernel half hip-common hipblas hipcc hipcub hipfft hipfort hipify hiprand hipsolver hipsparse hsa-amd-aqlprofile-bin migraphx miopen mivisionx-cpu mivisionx-hip mivisionx-hip ollama python3.12-tensile rccl rdc rocalution rocblas rocdbgapi rocfft rocgdb rocm-cmake rocm-comgr rocm-core rocm-device-libs rocm-llvm-binutils-wrapper rocm-llvm-clang-tools-extra rocm-llvm-clang-unwrapped rocm-llvm-clang-wrapper rocm-llvm-compiler-rt rocm-llvm-flang rocm-llvm-libc rocm-llvm-libclc rocm-llvm-libcxx rocm-llvm-libcxxabi rocm-llvm-libunwind rocm-llvm-lld rocm-llvm-lldb rocm-llvm-llvm rocm-llvm-mlir rocm-llvm-openmp rocm-llvm-polly rocm-llvm-pstl rocm-runtime rocm-smi rocm-thunk rocminfo rocmlir rocmlir-rock rocprim rocprofiler rocr-debug-agent rocrand rocsolver rocsparse rocthrust roctracer rocwmma rpp-cpu rpp-cpu rpp-hip rpp-hip stdenv-linux zluda

@khaneliman
Copy link
Contributor Author

khaneliman commented Jul 10, 2024

Le sad.

Result of nixpkgs-review pr 325909 run on x86_64-linux 1

11 packages marked as broken and skipped:
  • rocmPackages.llvm.flang
  • rocmPackages.llvm.flang.doc
  • rocmPackages.llvm.flang.info
  • rocmPackages.llvm.flang.man
  • rocmPackages.llvm.libclc
  • rocmPackages.migraphx
  • rocmPackages.mivisionx
  • rocmPackages.mivisionx-cpu
  • rocmPackages.mivisionx-hip
  • rocmPackages.rdc
  • rocmPackages.rdc.doc
74 packages failed to build:
  • blender-hip
  • ollama-rocm
  • rocmPackages.clang-ocl
  • rocmPackages.clr
  • rocmPackages.clr.icd
  • rocmPackages.composable_kernel
  • rocmPackages.half
  • rocmPackages.hip-common
  • rocmPackages.hipblas
  • rocmPackages.hipcc
  • rocmPackages.hipcub
  • rocmPackages.hipfft
  • rocmPackages.hipfort
  • rocmPackages.hipify
  • rocmPackages.hiprand
  • rocmPackages.hipsolver
  • rocmPackages.hipsparse
  • rocmPackages.hsa-amd-aqlprofile-bin
  • rocmPackages.llvm.clang
  • rocmPackages.llvm.clang-tools-extra
  • rocmPackages.llvm.clang-tools-extra.doc
  • rocmPackages.llvm.clang-tools-extra.info
  • rocmPackages.llvm.clang-tools-extra.man
  • rocmPackages.llvm.libcxx
  • rocmPackages.llvm.libcxx.doc
  • rocmPackages.llvm.lldb
  • rocmPackages.llvm.lldb.doc
  • rocmPackages.llvm.lldb.info
  • rocmPackages.llvm.lldb.man
  • rocmPackages.llvm.mlir
  • rocmPackages.llvm.openmp
  • rocmPackages.llvm.openmp.doc
  • rocmPackages.llvm.openmp.info
  • rocmPackages.llvm.openmp.man
  • rocmPackages.llvm.polly
  • rocmPackages.llvm.polly.doc
  • rocmPackages.llvm.polly.info
  • rocmPackages.llvm.polly.man
  • rocmPackages.llvm.pstl
  • rocmPackages.llvm.rocmClangStdenv
  • rocmPackages.miopen
  • rocmPackages.rccl
  • rocmPackages.rocalution
  • rocmPackages.rocblas
  • rocmPackages.rocdbgapi
  • rocmPackages.rocdbgapi.doc
  • rocmPackages.rocfft
  • rocmPackages.rocgdb
  • rocmPackages.rocm-cmake
  • rocmPackages.rocm-comgr
  • rocmPackages.rocm-core
  • rocmPackages.rocm-device-libs
  • rocmPackages.rocm-runtime
  • rocmPackages.rocm-smi
  • rocmPackages.rocm-thunk
  • rocmPackages.rocminfo
  • rocmPackages.rocmlir
  • rocmPackages.rocmlir-rock
  • rocmPackages.rocmlir.external
  • rocmPackages.rocprim
  • rocmPackages.rocprofiler
  • rocmPackages.rocr-debug-agent
  • rocmPackages.rocrand
  • rocmPackages.rocsolver
  • rocmPackages.rocsparse
  • rocmPackages.rocthrust
  • rocmPackages.roctracer
  • rocmPackages.rocwmma
  • rocmPackages.rpp (rocmPackages.rpp-hip)
  • rocmPackages.rpp-cpu
  • rocmPackages.rpp-opencl
  • rocmPackages.tensile
  • rocmPackages.tensile.dist
  • zluda
17 packages built:
  • rocmPackages.llvm.bintools
  • rocmPackages.llvm.clang-unwrapped
  • rocmPackages.llvm.clang-unwrapped.doc
  • rocmPackages.llvm.clang-unwrapped.info
  • rocmPackages.llvm.clang-unwrapped.man
  • rocmPackages.llvm.compiler-rt
  • rocmPackages.llvm.libc
  • rocmPackages.llvm.libc.doc
  • rocmPackages.llvm.libcxxabi
  • rocmPackages.llvm.libunwind
  • rocmPackages.llvm.libunwind.doc
  • rocmPackages.llvm.lld
  • rocmPackages.llvm.lld.doc
  • rocmPackages.llvm.llvm
  • rocmPackages.llvm.llvm.doc
  • rocmPackages.llvm.llvm.info
  • rocmPackages.llvm.llvm.man

@khaneliman
Copy link
Contributor Author

khaneliman commented Jul 10, 2024

Libcxx is failing on 3 tests. I see there's a large ignore tests file... sounds tempting...

llvm-libc++-shared.cfg.in :: std/language.support/support.dynamic/hardware_inference_size.compile.pass.cpp
llvm-libc++-shared.cfg.in :: std/language.support/support.dynamic/new.delete/new.delete.array/sized_delete_array14.pass.cpp
llvm-libc++-shared.cfg.in :: std/language.support/support.dynamic/new.delete/new.delete.single/sized_delete14.pass.cpp

@DamitusThyYeetus123
Copy link
Contributor

Decided to update my system today of all days so i'm trying your fork, will post updates.

@khaneliman
Copy link
Contributor Author

Result of nixpkgs-review pr 325909 run on x86_64-linux 1

11 packages marked as broken and skipped:
  • rocmPackages.llvm.flang
  • rocmPackages.llvm.flang.doc
  • rocmPackages.llvm.flang.info
  • rocmPackages.llvm.flang.man
  • rocmPackages.llvm.libclc
  • rocmPackages.migraphx
  • rocmPackages.mivisionx
  • rocmPackages.mivisionx-cpu
  • rocmPackages.mivisionx-hip
  • rocmPackages.rdc
  • rocmPackages.rdc.doc
6 packages failed to build:
  • rocmPackages.miopen
  • rocmPackages.rocmlir
  • rocmPackages.rocmlir-rock
  • rocmPackages.rocmlir.external
  • rocmPackages.rocprofiler
  • zluda
85 packages built:
  • blender-hip
  • ollama-rocm
  • rocmPackages.clang-ocl
  • rocmPackages.clr
  • rocmPackages.clr.icd
  • rocmPackages.composable_kernel
  • rocmPackages.half
  • rocmPackages.hip-common
  • rocmPackages.hipblas
  • rocmPackages.hipcc
  • rocmPackages.hipcub
  • rocmPackages.hipfft
  • rocmPackages.hipfort
  • rocmPackages.hipify
  • rocmPackages.hiprand
  • rocmPackages.hipsolver
  • rocmPackages.hipsparse
  • rocmPackages.hsa-amd-aqlprofile-bin
  • rocmPackages.llvm.bintools
  • rocmPackages.llvm.clang
  • rocmPackages.llvm.clang-tools-extra
  • rocmPackages.llvm.clang-tools-extra.doc
  • rocmPackages.llvm.clang-tools-extra.info
  • rocmPackages.llvm.clang-tools-extra.man
  • rocmPackages.llvm.clang-unwrapped
  • rocmPackages.llvm.clang-unwrapped.doc
  • rocmPackages.llvm.clang-unwrapped.info
  • rocmPackages.llvm.clang-unwrapped.man
  • rocmPackages.llvm.compiler-rt
  • rocmPackages.llvm.libc
  • rocmPackages.llvm.libc.doc
  • rocmPackages.llvm.libcxx
  • rocmPackages.llvm.libcxx.doc
  • rocmPackages.llvm.libcxxabi
  • rocmPackages.llvm.libunwind
  • rocmPackages.llvm.libunwind.doc
  • rocmPackages.llvm.lld
  • rocmPackages.llvm.lld.doc
  • rocmPackages.llvm.lldb
  • rocmPackages.llvm.lldb.doc
  • rocmPackages.llvm.lldb.info
  • rocmPackages.llvm.lldb.man
  • rocmPackages.llvm.llvm
  • rocmPackages.llvm.llvm.doc
  • rocmPackages.llvm.llvm.info
  • rocmPackages.llvm.llvm.man
  • rocmPackages.llvm.mlir
  • rocmPackages.llvm.openmp
  • rocmPackages.llvm.openmp.doc
  • rocmPackages.llvm.openmp.info
  • rocmPackages.llvm.openmp.man
  • rocmPackages.llvm.polly
  • rocmPackages.llvm.polly.doc
  • rocmPackages.llvm.polly.info
  • rocmPackages.llvm.polly.man
  • rocmPackages.llvm.pstl
  • rocmPackages.llvm.rocmClangStdenv
  • rocmPackages.rccl
  • rocmPackages.rocalution
  • rocmPackages.rocblas
  • rocmPackages.rocdbgapi
  • rocmPackages.rocdbgapi.doc
  • rocmPackages.rocfft
  • rocmPackages.rocgdb
  • rocmPackages.rocm-cmake
  • rocmPackages.rocm-comgr
  • rocmPackages.rocm-core
  • rocmPackages.rocm-device-libs
  • rocmPackages.rocm-runtime
  • rocmPackages.rocm-smi
  • rocmPackages.rocm-thunk
  • rocmPackages.rocminfo
  • rocmPackages.rocprim
  • rocmPackages.rocr-debug-agent
  • rocmPackages.rocrand
  • rocmPackages.rocsolver
  • rocmPackages.rocsparse
  • rocmPackages.rocthrust
  • rocmPackages.roctracer
  • rocmPackages.rocwmma
  • rocmPackages.rpp (rocmPackages.rpp-hip)
  • rocmPackages.rpp-cpu
  • rocmPackages.rpp-opencl
  • rocmPackages.tensile
  • rocmPackages.tensile.dist

@khaneliman khaneliman marked this pull request as ready for review July 10, 2024 12:39
@khaneliman
Copy link
Contributor Author

khaneliman commented Jul 10, 2024

rocmlir packages fail with

[3067/3788] Building CXX object mlir/lib/Dialect/Rock/Transforms/CMakeFiles/obj.MLIRRockTransforms.dir/ViewToTransform.cpp.o
FAILED: mlir/lib/Dialect/Rock/Transforms/CMakeFiles/obj.MLIRRockTransforms.dir/ViewToTransform.cpp.o
/nix/store/13bz9lziadqbfrf14301zbkk8yj99fwg-rocm-llvm-clang-wrapper-6.0.2/bin/clang++ -DGTEST_HAS_RTTI=0 -D_DEBUG -D_GLIBCXX_ASSERTIONS -D_LIBCPP_ENABLE_ASSERTIONS -D__STDC_CONSTANT_MACROS -D__STDC_FORMAT_MACROS -D__STDC_LIMIT_MACROS -I/build/source/build/mlir/lib/Dialect/Rock/Transforms -I/build/source/mlir/lib/Dialect/Rock/Transforms -I/build/source/external/llvm-project/llvm/include -I/build/source/build/external/llvm-project/llvm/include -I/build/sou>
In file included from /build/source/mlir/lib/Dialect/Rock/Transforms/ViewToTransform.cpp:14:
/build/source/mlir/include/mlir/Conversion/TosaToRock/TosaToRock.h:21:10: fatal error: 'mlir/Conversion/RocMLIRPasses.h.inc' file not found
#include "mlir/Conversion/RocMLIRPasses.h.inc"
         ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
1 error generated.

@khaneliman
Copy link
Contributor Author

khaneliman commented Jul 10, 2024

Looks like the profiler one was just a timeout during the mass rebuild.

Result of nixpkgs-review pr 325909 run on x86_64-linux 1

22 packages marked as broken and skipped:
  • rocmPackages.llvm.flang
  • rocmPackages.llvm.flang.doc
  • rocmPackages.llvm.flang.info
  • rocmPackages.llvm.flang.man
  • rocmPackages.llvm.libclc
  • rocmPackages.migraphx
  • rocmPackages.mivisionx
  • rocmPackages.mivisionx-cpu
  • rocmPackages.mivisionx-hip
  • rocmPackages.rdc
  • rocmPackages.rdc.doc
  • rocmPackages_6.llvm.flang
  • rocmPackages_6.llvm.flang.doc
  • rocmPackages_6.llvm.flang.info
  • rocmPackages_6.llvm.flang.man
  • rocmPackages_6.llvm.libclc
  • rocmPackages_6.migraphx
  • rocmPackages_6.mivisionx
  • rocmPackages_6.mivisionx-cpu
  • rocmPackages_6.mivisionx-hip
  • rocmPackages_6.rdc
  • rocmPackages_6.rdc.doc
5 packages failed to build:
  • rocmPackages.miopen (rocmPackages.miopen-hip ,rocmPackages_6.miopen ,rocmPackages_6.miopen-hip)
  • rocmPackages.rocmlir (rocmPackages_6.rocmlir)
  • rocmPackages.rocmlir-rock (rocmPackages_6.rocmlir-rock)
  • rocmPackages.rocmlir.external (rocmPackages_6.rocmlir.external)
  • zluda
86 packages built:
  • blender-hip
  • ollama-rocm
  • rocmPackages.clang-ocl (rocmPackages_6.clang-ocl)
  • rocmPackages.clr (rocmPackages_6.clr)
  • rocmPackages.clr.icd (rocmPackages_6.clr.icd)
  • rocmPackages.composable_kernel (rocmPackages_6.composable_kernel)
  • rocmPackages.half (rocmPackages_6.half)
  • rocmPackages.hip-common (rocmPackages_6.hip-common)
  • rocmPackages.hipblas (rocmPackages_6.hipblas)
  • rocmPackages.hipcc (rocmPackages_6.hipcc)
  • rocmPackages.hipcub (rocmPackages_6.hipcub)
  • rocmPackages.hipfft (rocmPackages_6.hipfft)
  • rocmPackages.hipfort (rocmPackages_6.hipfort)
  • rocmPackages.hipify (rocmPackages_6.hipify)
  • rocmPackages.hiprand (rocmPackages_6.hiprand)
  • rocmPackages.hipsolver (rocmPackages_6.hipsolver)
  • rocmPackages.hipsparse (rocmPackages_6.hipsparse)
  • rocmPackages.hsa-amd-aqlprofile-bin (rocmPackages_6.hsa-amd-aqlprofile-bin)
  • rocmPackages.llvm.bintools (rocmPackages_6.llvm.bintools)
  • rocmPackages.llvm.clang (rocmPackages_6.llvm.clang)
  • rocmPackages.llvm.clang-tools-extra (rocmPackages_6.llvm.clang-tools-extra)
  • rocmPackages.llvm.clang-tools-extra.doc (rocmPackages_6.llvm.clang-tools-extra.doc)
  • rocmPackages.llvm.clang-tools-extra.info (rocmPackages_6.llvm.clang-tools-extra.info)
  • rocmPackages.llvm.clang-tools-extra.man (rocmPackages_6.llvm.clang-tools-extra.man)
  • rocmPackages.llvm.clang-unwrapped (rocmPackages_6.llvm.clang-unwrapped)
  • rocmPackages.llvm.clang-unwrapped.doc (rocmPackages_6.llvm.clang-unwrapped.doc)
  • rocmPackages.llvm.clang-unwrapped.info (rocmPackages_6.llvm.clang-unwrapped.info)
  • rocmPackages.llvm.clang-unwrapped.man (rocmPackages_6.llvm.clang-unwrapped.man)
  • rocmPackages.llvm.compiler-rt (rocmPackages_6.llvm.compiler-rt)
  • rocmPackages.llvm.libc (rocmPackages_6.llvm.libc)
  • rocmPackages.llvm.libc.doc (rocmPackages_6.llvm.libc.doc)
  • rocmPackages.llvm.libcxx (rocmPackages_6.llvm.libcxx)
  • rocmPackages.llvm.libcxx.doc (rocmPackages_6.llvm.libcxx.doc)
  • rocmPackages.llvm.libcxxabi (rocmPackages_6.llvm.libcxxabi)
  • rocmPackages.llvm.libunwind (rocmPackages_6.llvm.libunwind)
  • rocmPackages.llvm.libunwind.doc (rocmPackages_6.llvm.libunwind.doc)
  • rocmPackages.llvm.lld (rocmPackages_6.llvm.lld)
  • rocmPackages.llvm.lld.doc (rocmPackages_6.llvm.lld.doc)
  • rocmPackages.llvm.lldb (rocmPackages_6.llvm.lldb)
  • rocmPackages.llvm.lldb.doc (rocmPackages_6.llvm.lldb.doc)
  • rocmPackages.llvm.lldb.info (rocmPackages_6.llvm.lldb.info)
  • rocmPackages.llvm.lldb.man (rocmPackages_6.llvm.lldb.man)
  • rocmPackages.llvm.llvm (rocmPackages_6.llvm.llvm)
  • rocmPackages.llvm.llvm.doc (rocmPackages_6.llvm.llvm.doc)
  • rocmPackages.llvm.llvm.info (rocmPackages_6.llvm.llvm.info)
  • rocmPackages.llvm.llvm.man (rocmPackages_6.llvm.llvm.man)
  • rocmPackages.llvm.mlir (rocmPackages_6.llvm.mlir)
  • rocmPackages.llvm.openmp (rocmPackages_6.llvm.openmp)
  • rocmPackages.llvm.openmp.doc (rocmPackages_6.llvm.openmp.doc)
  • rocmPackages.llvm.openmp.info (rocmPackages_6.llvm.openmp.info)
  • rocmPackages.llvm.openmp.man (rocmPackages_6.llvm.openmp.man)
  • rocmPackages.llvm.polly (rocmPackages_6.llvm.polly)
  • rocmPackages.llvm.polly.doc (rocmPackages_6.llvm.polly.doc)
  • rocmPackages.llvm.polly.info (rocmPackages_6.llvm.polly.info)
  • rocmPackages.llvm.polly.man (rocmPackages_6.llvm.polly.man)
  • rocmPackages.llvm.pstl (rocmPackages_6.llvm.pstl)
  • rocmPackages.llvm.rocmClangStdenv (rocmPackages_6.llvm.rocmClangStdenv)
  • rocmPackages.rccl (rocmPackages_6.rccl)
  • rocmPackages.rocalution (rocmPackages_6.rocalution)
  • rocmPackages.rocblas (rocmPackages_6.rocblas)
  • rocmPackages.rocdbgapi (rocmPackages_6.rocdbgapi)
  • rocmPackages.rocdbgapi.doc (rocmPackages_6.rocdbgapi.doc)
  • rocmPackages.rocfft (rocmPackages_6.rocfft)
  • rocmPackages.rocgdb (rocmPackages_6.rocgdb)
  • rocmPackages.rocm-cmake (rocmPackages_6.rocm-cmake)
  • rocmPackages.rocm-comgr (rocmPackages_6.rocm-comgr)
  • rocmPackages.rocm-core (rocmPackages_6.rocm-core)
  • rocmPackages.rocm-device-libs (rocmPackages_6.rocm-device-libs)
  • rocmPackages.rocm-runtime (rocmPackages_6.rocm-runtime)
  • rocmPackages.rocm-smi (rocmPackages_6.rocm-smi)
  • rocmPackages.rocm-thunk (rocmPackages_6.rocm-thunk)
  • rocmPackages.rocminfo (rocmPackages_6.rocminfo)
  • rocmPackages.rocprim (rocmPackages_6.rocprim)
  • rocmPackages.rocprofiler (rocmPackages_6.rocprofiler)
  • rocmPackages.rocr-debug-agent (rocmPackages_6.rocr-debug-agent)
  • rocmPackages.rocrand (rocmPackages_6.rocrand)
  • rocmPackages.rocsolver (rocmPackages_6.rocsolver)
  • rocmPackages.rocsparse (rocmPackages_6.rocsparse)
  • rocmPackages.rocthrust (rocmPackages_6.rocthrust)
  • rocmPackages.roctracer (rocmPackages_6.roctracer)
  • rocmPackages.rocwmma (rocmPackages_6.rocwmma)
  • rocmPackages.rpp (rocmPackages.rpp-hip ,rocmPackages_6.rpp ,rocmPackages_6.rpp-hip)
  • rocmPackages.rpp-cpu (rocmPackages_6.rpp-cpu)
  • rocmPackages.rpp-opencl (rocmPackages_6.rpp-opencl)
  • rocmPackages.tensile (rocmPackages_6.tensile)
  • rocmPackages.tensile.dist (rocmPackages_6.tensile.dist)

@khaneliman
Copy link
Contributor Author

This is currently limited in scope to the _6 packages that were failing. Did we want to include the change to _5 or break them up?

Copy link
Contributor

@superherointj superherointj left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Tested on my host with AMD GPU and indeed it fixes the build [that was broken] and system is working.
If no other better solution is known atm, I think we should go ahead with this. Particularly because this unblock upgrades for those having AMD GPU.

@superherointj
Copy link
Contributor

This is currently limited in scope to the _6 packages that were failing. Did we want to include the change to _5 or break them up?

Up to you.

@khaneliman
Copy link
Contributor Author

khaneliman commented Jul 10, 2024

This is currently limited in scope to the _6 packages that were failing. Did we want to include the change to _5 or break them up?

Up to you.

I'll break it up to let this unblock the currently broken packages that are affecting people, I dont know how many are using _5 atm.

EDIT: looks like 3 dependencies of the _5 version only so I'll spin up another PR for that one.

@superherointj
Copy link
Contributor

@acowley @mschwaig @lovesegfault @Flakebi @Madouura @doronbehar @SuperSandro2000 @ulrikstrid

I think, the PR is ready for more reviews. Please, review it if you can. (And whoever has an interest in this.)

I'd like to speed this merge because this is breaking nixos-unstable for AMD GPU users.
Still, I'd prefer having more reviewers to acknowledge this is good to go.

@superherointj superherointj requested a review from mweinelt July 10, 2024 13:35
Copy link
Contributor

@doronbehar doronbehar left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

While trying to fix this I noticed the sources could use an update, perhaps you'd like to check them while at it.

@@ -86,7 +86,7 @@ in stdenv.mkDerivation (finalAttrs: {
cmake
ninja
git
python3Packages.python
(python3Packages.python.withPackages (p: [ p.setuptools ]))
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What bothers me a bit is that recommonmark used a bit down below is not included in this environment. But if it works, I guess it is OK.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah, the first iteration of the PR was including it similar to that package, I dont understand why this works and that didn't...

@khaneliman
Copy link
Contributor Author

khaneliman commented Jul 10, 2024

While trying to fix this I noticed the sources could use an update, perhaps you'd like to check them while at it.

@doronbehar Do you mean an actual version update from 6.0.2 to a new 6.1.2 or something?

@doronbehar
Copy link
Contributor

While trying to fix this I noticed the sources could use an update, perhaps you'd like to check them while at it.

@doronbehar Do you mean an actual version update from 6.0.2 to a new 6.1.2 or something?

Yes.

@Naxdy
Copy link
Contributor

Naxdy commented Jul 10, 2024

I'd say let's do one thing at a time. Getting it fixed and unblocking AMD GPU users is more important imo. As I understand it, the update is also a bit more involved, so could take additional time.

@khaneliman
Copy link
Contributor Author

khaneliman commented Jul 10, 2024

I'd say let's do one thing at a time. Getting it fixed and unblocking AMD GPU users is more important imo. As I understand it, the update is also a bit more involved, so could take additional time.

Yeah, If I were to try bumping i'd be interested in trying to remove the disabled tests and might have to update patches to see what succeeds and the compile times for this are pretty long.

EDIT: With that said, I am curious about bumping it so I'll try doing it locally and see how it goes and if I am able to get through it I'll open a PR for the bump.

@superherointj
Copy link
Contributor

superherointj commented Jul 10, 2024

@doronbehar Can we merge this and unblock stable? While khaneliman calmly works in an upgrade solution? And then, we have to re-test. (Which also takes a long time.) We don't know yet how long this is going to take.

My upgrade is not blocked because I have cherry-picked commits, my concern is mostly minding unstable users.

@doronbehar doronbehar merged commit b029aeb into NixOS:master Jul 10, 2024
26 of 28 checks passed
@khaneliman khaneliman deleted the rocm-llvm branch July 10, 2024 15:00
@superherointj
Copy link
Contributor

Result of nixpkgs-review pr 325909 run on x86_64-linux 1

22 packages marked as broken and skipped:
  • rocmPackages.llvm.flang
  • rocmPackages.llvm.flang.doc
  • rocmPackages.llvm.flang.info
  • rocmPackages.llvm.flang.man
  • rocmPackages.llvm.libclc
  • rocmPackages.migraphx
  • rocmPackages.mivisionx
  • rocmPackages.mivisionx-cpu
  • rocmPackages.mivisionx-hip
  • rocmPackages.rdc
  • rocmPackages.rdc.doc
  • rocmPackages_6.llvm.flang
  • rocmPackages_6.llvm.flang.doc
  • rocmPackages_6.llvm.flang.info
  • rocmPackages_6.llvm.flang.man
  • rocmPackages_6.llvm.libclc
  • rocmPackages_6.migraphx
  • rocmPackages_6.mivisionx
  • rocmPackages_6.mivisionx-cpu
  • rocmPackages_6.mivisionx-hip
  • rocmPackages_6.rdc
  • rocmPackages_6.rdc.doc
5 packages failed to build:
  • rocmPackages.miopen (rocmPackages.miopen-hip ,rocmPackages_6.miopen ,rocmPackages_6.miopen-hip)
  • rocmPackages.rocmlir (rocmPackages_6.rocmlir)
  • rocmPackages.rocmlir-rock (rocmPackages_6.rocmlir-rock)
  • rocmPackages.rocmlir.external (rocmPackages_6.rocmlir.external)
  • zluda
86 packages built:
  • blender-hip
  • ollama-rocm
  • rocmPackages.clang-ocl (rocmPackages_6.clang-ocl)
  • rocmPackages.clr (rocmPackages_6.clr)
  • rocmPackages.clr.icd (rocmPackages_6.clr.icd)
  • rocmPackages.composable_kernel (rocmPackages_6.composable_kernel)
  • rocmPackages.half (rocmPackages_6.half)
  • rocmPackages.hip-common (rocmPackages_6.hip-common)
  • rocmPackages.hipblas (rocmPackages_6.hipblas)
  • rocmPackages.hipcc (rocmPackages_6.hipcc)
  • rocmPackages.hipcub (rocmPackages_6.hipcub)
  • rocmPackages.hipfft (rocmPackages_6.hipfft)
  • rocmPackages.hipfort (rocmPackages_6.hipfort)
  • rocmPackages.hipify (rocmPackages_6.hipify)
  • rocmPackages.hiprand (rocmPackages_6.hiprand)
  • rocmPackages.hipsolver (rocmPackages_6.hipsolver)
  • rocmPackages.hipsparse (rocmPackages_6.hipsparse)
  • rocmPackages.hsa-amd-aqlprofile-bin (rocmPackages_6.hsa-amd-aqlprofile-bin)
  • rocmPackages.llvm.bintools (rocmPackages_6.llvm.bintools)
  • rocmPackages.llvm.clang (rocmPackages_6.llvm.clang)
  • rocmPackages.llvm.clang-tools-extra (rocmPackages_6.llvm.clang-tools-extra)
  • rocmPackages.llvm.clang-tools-extra.doc (rocmPackages_6.llvm.clang-tools-extra.doc)
  • rocmPackages.llvm.clang-tools-extra.info (rocmPackages_6.llvm.clang-tools-extra.info)
  • rocmPackages.llvm.clang-tools-extra.man (rocmPackages_6.llvm.clang-tools-extra.man)
  • rocmPackages.llvm.clang-unwrapped (rocmPackages_6.llvm.clang-unwrapped)
  • rocmPackages.llvm.clang-unwrapped.doc (rocmPackages_6.llvm.clang-unwrapped.doc)
  • rocmPackages.llvm.clang-unwrapped.info (rocmPackages_6.llvm.clang-unwrapped.info)
  • rocmPackages.llvm.clang-unwrapped.man (rocmPackages_6.llvm.clang-unwrapped.man)
  • rocmPackages.llvm.compiler-rt (rocmPackages_6.llvm.compiler-rt)
  • rocmPackages.llvm.libc (rocmPackages_6.llvm.libc)
  • rocmPackages.llvm.libc.doc (rocmPackages_6.llvm.libc.doc)
  • rocmPackages.llvm.libcxx (rocmPackages_6.llvm.libcxx)
  • rocmPackages.llvm.libcxx.doc (rocmPackages_6.llvm.libcxx.doc)
  • rocmPackages.llvm.libcxxabi (rocmPackages_6.llvm.libcxxabi)
  • rocmPackages.llvm.libunwind (rocmPackages_6.llvm.libunwind)
  • rocmPackages.llvm.libunwind.doc (rocmPackages_6.llvm.libunwind.doc)
  • rocmPackages.llvm.lld (rocmPackages_6.llvm.lld)
  • rocmPackages.llvm.lld.doc (rocmPackages_6.llvm.lld.doc)
  • rocmPackages.llvm.lldb (rocmPackages_6.llvm.lldb)
  • rocmPackages.llvm.lldb.doc (rocmPackages_6.llvm.lldb.doc)
  • rocmPackages.llvm.lldb.info (rocmPackages_6.llvm.lldb.info)
  • rocmPackages.llvm.lldb.man (rocmPackages_6.llvm.lldb.man)
  • rocmPackages.llvm.llvm (rocmPackages_6.llvm.llvm)
  • rocmPackages.llvm.llvm.doc (rocmPackages_6.llvm.llvm.doc)
  • rocmPackages.llvm.llvm.info (rocmPackages_6.llvm.llvm.info)
  • rocmPackages.llvm.llvm.man (rocmPackages_6.llvm.llvm.man)
  • rocmPackages.llvm.mlir (rocmPackages_6.llvm.mlir)
  • rocmPackages.llvm.openmp (rocmPackages_6.llvm.openmp)
  • rocmPackages.llvm.openmp.doc (rocmPackages_6.llvm.openmp.doc)
  • rocmPackages.llvm.openmp.info (rocmPackages_6.llvm.openmp.info)
  • rocmPackages.llvm.openmp.man (rocmPackages_6.llvm.openmp.man)
  • rocmPackages.llvm.polly (rocmPackages_6.llvm.polly)
  • rocmPackages.llvm.polly.doc (rocmPackages_6.llvm.polly.doc)
  • rocmPackages.llvm.polly.info (rocmPackages_6.llvm.polly.info)
  • rocmPackages.llvm.polly.man (rocmPackages_6.llvm.polly.man)
  • rocmPackages.llvm.pstl (rocmPackages_6.llvm.pstl)
  • rocmPackages.llvm.rocmClangStdenv (rocmPackages_6.llvm.rocmClangStdenv)
  • rocmPackages.rccl (rocmPackages_6.rccl)
  • rocmPackages.rocalution (rocmPackages_6.rocalution)
  • rocmPackages.rocblas (rocmPackages_6.rocblas)
  • rocmPackages.rocdbgapi (rocmPackages_6.rocdbgapi)
  • rocmPackages.rocdbgapi.doc (rocmPackages_6.rocdbgapi.doc)
  • rocmPackages.rocfft (rocmPackages_6.rocfft)
  • rocmPackages.rocgdb (rocmPackages_6.rocgdb)
  • rocmPackages.rocm-cmake (rocmPackages_6.rocm-cmake)
  • rocmPackages.rocm-comgr (rocmPackages_6.rocm-comgr)
  • rocmPackages.rocm-core (rocmPackages_6.rocm-core)
  • rocmPackages.rocm-device-libs (rocmPackages_6.rocm-device-libs)
  • rocmPackages.rocm-runtime (rocmPackages_6.rocm-runtime)
  • rocmPackages.rocm-smi (rocmPackages_6.rocm-smi)
  • rocmPackages.rocm-thunk (rocmPackages_6.rocm-thunk)
  • rocmPackages.rocminfo (rocmPackages_6.rocminfo)
  • rocmPackages.rocprim (rocmPackages_6.rocprim)
  • rocmPackages.rocprofiler (rocmPackages_6.rocprofiler)
  • rocmPackages.rocr-debug-agent (rocmPackages_6.rocr-debug-agent)
  • rocmPackages.rocrand (rocmPackages_6.rocrand)
  • rocmPackages.rocsolver (rocmPackages_6.rocsolver)
  • rocmPackages.rocsparse (rocmPackages_6.rocsparse)
  • rocmPackages.rocthrust (rocmPackages_6.rocthrust)
  • rocmPackages.roctracer (rocmPackages_6.roctracer)
  • rocmPackages.rocwmma (rocmPackages_6.rocwmma)
  • rocmPackages.rpp (rocmPackages.rpp-hip ,rocmPackages_6.rpp ,rocmPackages_6.rpp-hip)
  • rocmPackages.rpp-cpu (rocmPackages_6.rpp-cpu)
  • rocmPackages.rpp-opencl (rocmPackages_6.rpp-opencl)
  • rocmPackages.tensile (rocmPackages_6.tensile)
  • rocmPackages.tensile.dist (rocmPackages_6.tensile.dist)

@DamitusThyYeetus123
Copy link
Contributor

From what i’ve seen this blocks not only AMD users but also steam users, as steam FHS adds all gpu drivers no matter what, including rocm.

LuNeder added a commit to LuNeder/compiz-reloaded-nix that referenced this pull request Jul 15, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Build failure: rocmPackages.llvm.compiler-rt-6.0.2
5 participants