Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[TOKENIZERS] Extended extension searching paths #797

Merged
merged 2 commits into from
Dec 21, 2023

Conversation

mryzhov
Copy link
Contributor

@mryzhov mryzhov commented Dec 21, 2023

Extended extension searching paths, using the following order

  1. os.environ.get("OV_TOKENIZER_PREBUILD_EXTENSION_PATH")
  2. in the same folder as init.py
  3. user site-packages
  4. system site-packages

@mryzhov mryzhov requested a review from a team as a code owner December 21, 2023 09:17
@github-actions github-actions bot added the category: custom operations OpenVINO Runtime Extension with custom operations label Dec 21, 2023
@mryzhov mryzhov requested a review from apaniukov December 21, 2023 11:58
@ilya-lavrenov ilya-lavrenov enabled auto-merge (squash) December 21, 2023 12:16
@ilya-lavrenov ilya-lavrenov merged commit 1cd5cfb into openvinotoolkit:master Dec 21, 2023
6 checks passed
@ilya-lavrenov ilya-lavrenov added the port to 2023.3 Need port from master to 2023.3 LTS label Dec 21, 2023
@ilya-lavrenov ilya-lavrenov added this to the 2024.0 milestone Dec 21, 2023
ilya-lavrenov pushed a commit to ilya-lavrenov/openvino_contrib that referenced this pull request Dec 21, 2023
* extended site-packages pathes

* Apply suggestions from code review

Co-authored-by: Artur Paniukov <[email protected]>

---------

Co-authored-by: Artur Paniukov <[email protected]>
@ilya-lavrenov ilya-lavrenov removed the port to 2023.3 Need port from master to 2023.3 LTS label Dec 21, 2023
ilya-lavrenov added a commit that referenced this pull request Dec 22, 2023
* [TOKENIZERS] Disabled  C4703 (#796)

* disabled error C4703

* Update modules/custom_operations/user_ie_extensions/tokenizer/CMakeLists.txt

---------

Co-authored-by: Ilya Lavrenov <[email protected]>

* [Tokenizer] Add CLI Tokenizer Converter (#792)

* Add CLI Tokenizer Converter

* Fix space

* Add more flags to CLI tool

* [TOKENIZERS] Update license field and version (#793)

* update license field and version

* flex dependency in master

* removed version of openvino in master

* [TOKENIZERS] Extended extension searching paths (#797)

* extended site-packages pathes

* Apply suggestions from code review

Co-authored-by: Artur Paniukov <[email protected]>

---------

Co-authored-by: Artur Paniukov <[email protected]>

* [TOKENIZERS] added build of tokenizers in wheel (#798)

* added build tokenizers for wheel

* fixed azure pipeline

* [Tokenizers] Update README.md (#799)

* Fix --streaming-detokenizer flag

* Rewrite README.md

* Rewrite README.md

* Rewrite README.md

---------

Co-authored-by: Mikhail Ryzhov <[email protected]>
Co-authored-by: Artur Paniukov <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
category: custom operations OpenVINO Runtime Extension with custom operations
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants