Skip to content

For bs=1 set kv_cache_type to paged. #3671

For bs=1 set kv_cache_type to paged.

For bs=1 set kv_cache_type to paged. #3671

Triggered via pull request January 10, 2025 18:57
Status Success
Total duration 27s
Artifacts

pre-commit.yaml

on: pull_request
pre-commit
20s
pre-commit
Fit to window
Zoom out
Zoom in

Annotations

1 warning
pre-commit
The `python-version` input is not set. The version of Python currently in `PATH` will be used.