-
Notifications
You must be signed in to change notification settings - Fork 145
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Tokenizers] Added support for conda-forge, archive installations #782
[Tokenizers] Added support for conda-forge, archive installations #782
Conversation
b43b517
to
4511001
Compare
sys.exit(f"Error: extension does not support the platform {sys.platform}") | ||
|
||
# conda-forge case | ||
conda_forge_lib_path = Path(os.path.join(os.path.dirname(__file__), "..", "..", "..")) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Maybe it would be better to search extension in the os.environ["PATH"]?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
if conda env is not activated, it will not work.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Is there a scenario when a user installs openvino_tokenizers with conda, but uses it without activating any conda env?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
potentially I can use /abs/path/to/conda/env/python and openvino_tokenizers will find libraries.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
It should be more robust. We had problems with pip install -e .
when trying to find libraries relative to the __file__
path. There may be similar problems with a conda installation.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
conda does not work in editable mode
renamed component core => tokenizers
1aec93c
to
fb7f895
Compare
modules/custom_operations/user_ie_extensions/tokenizer/python/openvino_tokenizers/__init__.py
Show resolved
Hide resolved
modules/custom_operations/user_ie_extensions/tokenizer/python/openvino_tokenizers/__init__.py
Show resolved
Hide resolved
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Merge after moving from os.path.*
to Path
I'll merge as is and fix comments in next PR #784 |
No description provided.