Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[intel-npu] Adding NPU_DYNAMIC_QUANTIZATION property #28316

Open
wants to merge 9 commits into from
Open

[intel-npu] Adding NPU_DYNAMIC_QUANTIZATION property #28316

wants to merge 9 commits into from
+127 −16

Conversation

csoka
Copy link
Contributor

@csoka csoka commented Jan 8, 2025 •
edited
Loading

Details:

  • Adding NPU_DYNAMIC_QUANTIZATION public RW boolean property

Tickets:

  • EISW-148716

@csoka csoka requested review from a team as code owners January 8, 2025 12:56
@csoka csoka requested review from akopytko and removed request for a team January 8, 2025 12:56
@github-actions github-actions bot added category: inference OpenVINO Runtime library - Inference category: docs OpenVINO documentation category: CPP API OpenVINO CPP API bindings category: NPU OpenVINO NPU plugin labels Jan 8, 2025
@ZoranZomborat
Copy link
Contributor

https://github.com/intel-innersource/applications.ai.vpu-accelerators.vpux-plugin/pull/15283 PR bumping the minor version

This was referenced Jan 9, 2025
Merged
Merged
@csoka csoka requested a review from a team as a code owner January 9, 2025 22:32
@github-actions github-actions bot added the category: Python API OpenVINO Python bindings label Jan 9, 2025
@csoka csoka requested a review from ilya-lavrenov January 10, 2025 12:36
@PatrikStepan PatrikStepan added this to the 2025.0 milestone Jan 13, 2025
@csoka csoka force-pushed the npu_compiler_dq branch 2 times, most recently from f990c81 to 53d78b0 Compare January 13, 2025 17:41
github-merge-queue bot pushed a commit to openvinotoolkit/openvino.genai that referenced this pull request Jan 13, 2025
@smirnov-alexey
[LLM] [NPU] StaticLLMPipeline: Compiler DQ update (#1515)
3d226ec 
Depends on openvinotoolkit/openvino#28316
Related to openvinotoolkit/openvino#28343
github-merge-queue bot pushed a commit to openvinotoolkit/openvino.genai that referenced this pull request Jan 13, 2025
@smirnov-alexey
[LLM] [NPU] StaticLLMPipeline: Compiler DQ update (#1515)
64b2c15 
Depends on openvinotoolkit/openvino#28316
Related to openvinotoolkit/openvino#28343
github-merge-queue bot pushed a commit to openvinotoolkit/openvino.genai that referenced this pull request Jan 14, 2025
@smirnov-alexey
[LLM] [NPU] StaticLLMPipeline: Compiler DQ update (#1515)
723f956 
Depends on openvinotoolkit/openvino#28316
Related to openvinotoolkit/openvino#28343
github-merge-queue bot pushed a commit that referenced this pull request Jan 14, 2025
@smirnov-alexey
[NPUW] Update compiler DQ query in LLMCompiledModel (#28343)
57025dc 
Depends on #28316
Related to openvinotoolkit/openvino.genai#1515
@moslex moslex added the priority: high High piority label Jan 15, 2025
@csoka csoka added this pull request to the merge queue Jan 15, 2025
@csoka csoka removed this pull request from the merge queue due to a manual request Jan 15, 2025
@csoka csoka enabled auto-merge January 15, 2025 21:40
@csoka csoka added this pull request to the merge queue Jan 15, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@lmielick lmielick lmielick approved these changes

@akuporos akuporos akuporos approved these changes

@ZoranZomborat ZoranZomborat ZoranZomborat approved these changes

@akopytko akopytko Awaiting requested review from akopytko akopytko is a code owner automatically assigned from openvinotoolkit/openvino-docs-maintainers

@ilya-lavrenov ilya-lavrenov Awaiting requested review from ilya-lavrenov

Assignees
No one assigned
Labels
category: CPP API OpenVINO CPP API bindings category: docs OpenVINO documentation category: inference OpenVINO Runtime library - Inference category: NPU OpenVINO NPU plugin category: Python API OpenVINO Python bindings Code Freeze priority: high High piority
Projects
None yet
Milestone
2025.0
Development

Successfully merging this pull request may close these issues.
7 participants
@csoka @ZoranZomborat @ilya-lavrenov @akuporos @lmielick @PatrikStepan @moslex