Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

python311Packages.connectorx: init at 0.3.3 #312884

Open
wants to merge 5 commits into
base: master
Choose a base branch
from

Conversation

coastalwhite
Copy link

@coastalwhite coastalwhite commented May 19, 2024

Description of changes

This adds the connectorx python package. These are used by several of the data science and dataframe libraries in the python ecosystem. Specifically, these are packaged now with the hope of better packaging of the polars in the future.

Things done

  • Built on platform(s)
    • x86_64-linux
    • aarch64-linux
    • x86_64-darwin
    • aarch64-darwin
  • For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)
    • sandbox = relaxed
    • sandbox = true
  • Tested, as applicable:
  • Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
  • Tested basic functionality of all binary files (usually in ./result/bin/)
  • 24.05 Release Notes (or backporting 23.05 and 23.11 Release notes)
    • (Package updates) Added a release notes entry if the change is major or breaking
    • (Module updates) Added a release notes entry if the change is significant
    • (Module addition) Added a release notes entry if adding a new NixOS module
  • Fits CONTRIBUTING.md.

Add a 👍 reaction to pull requests you find important.

@github-actions github-actions bot added 6.topic: python 8.has: maintainer-list (update) This PR changes `maintainers/maintainer-list.nix` labels May 19, 2024
@NixOSInfra NixOSInfra added the 12. first-time contribution This PR is the author's first one; please be gentle! label May 19, 2024
@coastalwhite coastalwhite force-pushed the py-connectorx-deltalake branch from 3726a82 to b126aa2 Compare May 19, 2024 12:51
@ofborg ofborg bot added 8.has: package (new) This PR adds a new package 11.by: package-maintainer This PR was created by the maintainer of the package it changes 10.rebuild-darwin: 1-10 10.rebuild-linux: 1-10 labels May 19, 2024
Copy link
Contributor

@pluiedev pluiedev left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please also rename the PR to fit contributing conventions: pythonPackages.connectorx: init at 0.3.3; pythonPackages.deltalake: init at 0.17.4

pkgs/development/python-modules/connectorx/default.nix Outdated Show resolved Hide resolved
pkgs/development/python-modules/connectorx/default.nix Outdated Show resolved Hide resolved
pkgs/development/python-modules/connectorx/default.nix Outdated Show resolved Hide resolved
pkgs/development/python-modules/deltalake/default.nix Outdated Show resolved Hide resolved
pkgs/development/python-modules/deltalake/default.nix Outdated Show resolved Hide resolved
pkgs/development/python-modules/deltalake/default.nix Outdated Show resolved Hide resolved
pkgs/development/python-modules/deltalake/default.nix Outdated Show resolved Hide resolved
pkgs/development/python-modules/deltalake/default.nix Outdated Show resolved Hide resolved
pkgs/development/python-modules/deltalake/default.nix Outdated Show resolved Hide resolved
@coastalwhite coastalwhite changed the title Python-Modules: Add connectorx and deltalake pythonPackages.connectorx: init at 0.3.3; pythonPackages.deltalake: init at 0.17.4 May 21, 2024
@coastalwhite coastalwhite force-pushed the py-connectorx-deltalake branch from b126aa2 to 904b723 Compare May 21, 2024 18:34
@coastalwhite coastalwhite force-pushed the py-connectorx-deltalake branch from 904b723 to d45ac5b Compare May 21, 2024 19:02
];

pythonImportsCheck = [ "connectorx" ];

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

pkgs/development/python-modules/connectorx/default.nix Outdated Show resolved Hide resolved
Copy link
Member

@natsukium natsukium left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please use python311Packages instead of pythonPackages.
pythonPackages means python2 in nixpkgs.

@wegank wegank added the 12.approvals: 1 This PR was reviewed and approved by one reputable person label May 22, 2024
@coastalwhite coastalwhite changed the title pythonPackages.connectorx: init at 0.3.3; pythonPackages.deltalake: init at 0.17.4 python311Packages.connectorx: init at 0.3.3; python311Packages.deltalake: init at 0.17.4 May 26, 2024
@harvidsen
Copy link
Contributor

Note that deltalake already has a PR #320485.

@wegank wegank added the 2.status: merge conflict This PR has merge conflicts with the target branch label Jul 4, 2024
@coastalwhite coastalwhite changed the title python311Packages.connectorx: init at 0.3.3; python311Packages.deltalake: init at 0.17.4 python311Packages.connectorx: init at 0.3.3 Aug 10, 2024
@coastalwhite coastalwhite force-pushed the py-connectorx-deltalake branch from d45ac5b to 1184aab Compare August 10, 2024 08:21
@github-actions github-actions bot added 6.topic: nixos Issues or PRs affecting NixOS modules, or package usability issues specific to NixOS 6.topic: vscode 6.topic: llvm/clang Issues related to llvmPackages, clangStdenv and related labels Aug 10, 2024
@coastalwhite coastalwhite force-pushed the py-connectorx-deltalake branch 2 times, most recently from dd76ff6 to 8e6dfa2 Compare August 10, 2024 08:27
@github-actions github-actions bot removed 6.topic: nixos Issues or PRs affecting NixOS modules, or package usability issues specific to NixOS 6.topic: vscode labels Aug 10, 2024
@github-actions github-actions bot removed the 6.topic: llvm/clang Issues related to llvmPackages, clangStdenv and related label Aug 10, 2024
@coastalwhite coastalwhite force-pushed the py-connectorx-deltalake branch from 8e6dfa2 to 4d03c1a Compare August 10, 2024 08:33
@ofborg ofborg bot removed the 2.status: merge conflict This PR has merge conflicts with the target branch label Aug 10, 2024
@RossComputerGuy RossComputerGuy removed their request for review August 10, 2024 14:54
@coastalwhite coastalwhite requested a review from natsukium August 20, 2024 06:58
Copy link
Member

@natsukium natsukium left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could you format it with nixfmt-rfc-style and look into the build error?

error: failed to load manifest for dependency `connectorx`
Caused by:
  failed to parse manifest at `/build/source/connectorx/Cargo.toml`
Caused by:
  dependency (serde) specified without providing a local path, Git repository, version, or workspace dependency to use

pkgs/development/python-modules/connectorx/default.nix Outdated Show resolved Hide resolved
pkgs/development/python-modules/connectorx/default.nix Outdated Show resolved Hide resolved
@wegank wegank removed the 12.approvals: 1 This PR was reviewed and approved by one reputable person label Sep 7, 2024
@FliegendeWurst FliegendeWurst added the awaiting_changes (old Marvin label, do not use) label Dec 2, 2024
- move maturingBuildHook to build-system
- use pkgs.krb5
pkgs/development/python-modules/connectorx/default.nix Outdated Show resolved Hide resolved
pkgs/development/python-modules/connectorx/default.nix Outdated Show resolved Hide resolved
@@ -2065,6 +2065,10 @@ self: super: with self; {

connection-pool = callPackage ../development/python-modules/connection-pool { };

connectorx = callPackage ../development/python-modules/connectorx {
krb5-c = pkgs.krb5;
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is this necessary? (Why not just use krb5 directly?)

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is because it will otherwise try to use python3Packages.krb5. This is following the comment from above #312884 (comment).

pkgs/development/python-modules/connectorx/default.nix Outdated Show resolved Hide resolved
@SigmaSquadron SigmaSquadron removed the awaiting_changes (old Marvin label, do not use) label Jan 5, 2025
@coastalwhite coastalwhite requested a review from pluiedev January 12, 2025 16:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
6.topic: python 8.has: maintainer-list (update) This PR changes `maintainers/maintainer-list.nix` 8.has: package (new) This PR adds a new package 10.rebuild-darwin: 1-10 10.rebuild-linux: 1-10 11.by: package-maintainer This PR was created by the maintainer of the package it changes 12. first-time contribution This PR is the author's first one; please be gentle!
Projects
None yet
Development

Successfully merging this pull request may close these issues.

8 participants